GRID Based Federated Digital Library Export

@inproceedings{citeulike:3376602, abstract = {With the growing acceptance of the Open Archive Initiative (OAI) [16] framework, a number of digital libraries are becoming OAI compliant. This is making it feasible to build an effective federated digital library, which harvests metadata from the OAI-compliant libraries and provides a unified search service over the aggregated metadata. Arc [10] is an example of such a federated digital library. Assuming that a rapid increase (e.g., several orders of magnitude) in the adoption of OAI-PMH [16] occurs, we now have a different problem: how to efficiently discover, harvest and index the burgeoning OAI-PMH corpus. In this project, we are working on using Grid and cluster technology to address these performance issues. In this paper, we focus on the use of Grid for parallelizing the harvesting task for an OAI-based federated digital library. We propose a Grid-based architecture for parallel harvesting that supports: dynamic allocation of harvesting nodes, scheduling of harvesting tasks to maximize the performance, and uniform load distribution for the indexing node. We have implemented and evaluated the proposed architecture on a Grid based on the GT3 toolkit}, address = {New York, NY, USA}, author = {Maly, Kurt and Zubair, Mohammad and Chilukamarri, Vamshi and Kothari, Pratik}, booktitle = {CF '05: Proceedings of the 2nd conference on Computing frontiers}, citeulike-article-id = {3376602}, citeulike-linkout-0 = {http://portal.acm.org/citation.cfm?id=1062261.1062281}, citeulike-linkout-1 = {http://dx.doi.org/10.1145/1062261.1062281}, doi = {10.1145/1062261.1062281}, isbn = {1-59593-019-1}, keywords = {digital-library, grid, hlt-grid, nlp}, location = {Ischia, Italy}, pages = {97--105}, posted-at = {2008-10-05 08:59:31}, priority = {2}, publisher = {ACM}, title = {GRID Based Federated Digital Library}, url = {http://dx.doi.org/10.1145/1062261.1062281}, year = {2005} }

TY - CONF ID - citeulike:3376602 L3 - citeulike-article-id:3376602 N2 - With the growing acceptance of the Open Archive Initiative (OAI) [16] framework, a number of digital libraries are becoming OAI compliant. This is making it feasible to build an effective federated digital library, which harvests metadata from the OAI-compliant libraries and provides a unified search service over the aggregated metadata. Arc [10] is an example of such a federated digital library. Assuming that a rapid increase (e.g., several orders of magnitude) in the adoption of OAI-PMH [16] occurs, we now have a different problem: how to efficiently discover, harvest and index the burgeoning OAI-PMH corpus. In this project, we are working on using Grid and cluster technology to address these performance issues. In this paper, we focus on the use of Grid for parallelizing the harvesting task for an OAI-based federated digital library. We propose a Grid-based architecture for parallel harvesting that supports: dynamic allocation of harvesting nodes, scheduling of harvesting tasks to maximize the performance, and uniform load distribution for the indexing node. We have implemented and evaluated the proposed architecture on a Grid based on the GT3 toolkit CY - Ischia, Italy SN - 1-59593-019-1 AD - New York, NY, USA EP - 105 TI - GRID Based Federated Digital Library PB - ACM T2 - CF '05: Proceedings of the 2nd conference on Computing frontiers SP - 97 KW - digital-library KW - grid KW - hlt-grid KW - nlp AU - Maly, Kurt AU - Zubair, Mohammad AU - Chilukamarri, Vamshi AU - Kothari, Pratik PY - 2005/// UR - http://dx.doi.org/10.1145/1062261.1062281 ER -