Space/time trade-offs in hash coding with allowable errors Export

@article{citeulike:3151635, abstract = {In this paper trade-offs among certain computational factors in hash coding are analyzed. The paradigm problem con-sidered is that of testing a series of messages one-by-one for membership in a given set of messages. Two new hash-coding methods are examined and compared with a par-ticular conventional hash-coding method. The computational factors considered are the size of the hash area (space), the time required to identify a message as a nonmember of the given set (reject time), and an allowable error frequency. The new methods are intended to reduce the amount of space required to contain the hash-coded information from that associated with conventional methods. The reduction in space is accomplished by exploiting the possibility that a small fraction of errors of commission may be tolerable in some applications, in particular, applications in which a large amount of data is involved and a core resident hash area is consequently not feasible using conventional methods. In such applications, it is envisaged that overall performance could be improved by using a smaller core resident hash area in conjunction with the new methods and, when necessary, by using some secondary and perhaps time-consuming test to \"catch \" the small fraction of errors associated with the new methods. An example is discussed which illustrates possible areas of application for the new methods. Analysis of the paradigm problem demonstrates that al-lowing a small number of test messages to be falsely identified as members of the given set will permit a much smaller hash area to be used without increasing reject time. KEY WORDS AND PHRASES: hash coding, hash addressing, scatter storage, searching, storage layout, retrieval trade-ofFs, retrieval efficiency, storage}, author = {Bloom, Burton H.}, citeulike-article-id = {3151635}, citeulike-linkout-0 = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.2080}, journal = {Communications of the ACM}, keywords = {bloom, filters}, pages = {422--426}, posted-at = {2009-04-27 22:04:18}, priority = {2}, title = {Space/time trade-offs in hash coding with allowable errors}, url = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.2080}, volume = {13}, year = {1970} }

TY - JOUR ID - citeulike:3151635 L3 - citeulike-article-id:3151635 N2 - In this paper trade-offs among certain computational factors in hash coding are analyzed. The paradigm problem con-sidered is that of testing a series of messages one-by-one for membership in a given set of messages. Two new hash-coding methods are examined and compared with a par-ticular conventional hash-coding method. The computational factors considered are the size of the hash area (space), the time required to identify a message as a nonmember of the given set (reject time), and an allowable error frequency. The new methods are intended to reduce the amount of space required to contain the hash-coded information from that associated with conventional methods. The reduction in space is accomplished by exploiting the possibility that a small fraction of errors of commission may be tolerable in some applications, in particular, applications in which a large amount of data is involved and a core resident hash area is consequently not feasible using conventional methods. In such applications, it is envisaged that overall performance could be improved by using a smaller core resident hash area in conjunction with the new methods and, when necessary, by using some secondary and perhaps time-consuming test to "catch " the small fraction of errors associated with the new methods. An example is discussed which illustrates possible areas of application for the new methods. Analysis of the paradigm problem demonstrates that al-lowing a small number of test messages to be falsely identified as members of the given set will permit a much smaller hash area to be used without increasing reject time. KEY WORDS AND PHRASES: hash coding, hash addressing, scatter storage, searching, storage layout, retrieval trade-ofFs, retrieval efficiency, storage JF - Communications of the ACM EP - 426 TI - Space/time trade-offs in hash coding with allowable errors VL - 13 SP - 422 KW - bloom KW - filters AU - Bloom, Burton PY - 1970/// UR - http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.2080 ER -