A Novel Distributed Collaborative Filtering Algorithm and Its Implementation on P2P Overlay Network Export

@incollection{han-etal-pakdd04, abstract = {Collaborative filtering (CF) has proved to be one of the most effective information filtering techniques. However, as their calculation complexity increased quickly both in time and space when the record in user database increases, traditional centralized CF algorithms has suffered from their shortage in scalability. In this paper, we first propose a novel distributed CF algorithm called PipeCF through which we can do both the user database management and prediction task in a decentralized way. We then propose two novel approaches: significance refinement (SR) and unanimous amplification (UA), to further improve the scalability and prediction accuracy of PipeCF. Finally we give the algorithm framework and system architecture of the implementation of PipeCF on Peer-to-Peer (P2P) overlay network through distributed hash table (DHT) method, which is one of the most popular and effective routing algorithm in P2P. The experimental data show that our distributed CF algorithm has much better scalability than traditional centralized ones with comparable prediction efficiency and accuracy.}, author = {Han, Peng and Xie, Bo and Yang, Fan and Wang, Jiajun and Shen, Ruimin}, citeulike-article-id = {6090999}, citeulike-linkout-0 = {http://www.springerlink.com/content/kf28mh4f1wxhmk7m}, journal = {Advances in Knowledge Discovery and Data Mining}, keywords = {collaborative, distributed, filtering, p2p}, pages = {106--115}, posted-at = {2009-11-10 00:54:13}, priority = {2}, title = {A Novel Distributed Collaborative Filtering Algorithm and Its Implementation on P2P Overlay Network}, url = {http://www.springerlink.com/content/kf28mh4f1wxhmk7m}, year = {2004} }

TY - CHAP ID - han-etal-pakdd04 L3 - citeulike-article-id:6090999 N2 - Collaborative filtering (CF) has proved to be one of the most effective information filtering techniques. However, as their calculation complexity increased quickly both in time and space when the record in user database increases, traditional centralized CF algorithms has suffered from their shortage in scalability. In this paper, we first propose a novel distributed CF algorithm called PipeCF through which we can do both the user database management and prediction task in a decentralized way. We then propose two novel approaches: significance refinement (SR) and unanimous amplification (UA), to further improve the scalability and prediction accuracy of PipeCF. Finally we give the algorithm framework and system architecture of the implementation of PipeCF on Peer-to-Peer (P2P) overlay network through distributed hash table (DHT) method, which is one of the most popular and effective routing algorithm in P2P. The experimental data show that our distributed CF algorithm has much better scalability than traditional centralized ones with comparable prediction efficiency and accuracy. JF - Advances in Knowledge Discovery and Data Mining EP - 115 TI - A Novel Distributed Collaborative Filtering Algorithm and Its Implementation on P2P Overlay Network SP - 106 KW - collaborative KW - distributed KW - filtering KW - p2p AU - Han, Peng AU - Xie, Bo AU - Yang, Fan AU - Wang, Jiajun AU - Shen, Ruimin PY - 2004/// UR - http://www.springerlink.com/content/kf28mh4f1wxhmk7m ER -