Additive Models, Boosting, and Inference for Generalized Divergences Export

@inproceedings{citeulike:4873077, abstract = {We present a framework for designing incremental learning algorithms derived from generalized entropy functionals. Our approach is based on the use of Bregman divergences together with the associated class of additive models constructed using the Legendre transform. A particular one-parameter family of Bregman divergences is shown to yield a family of loss functions that includes the log-likelihood criterion of logistic regression as a special case, and that closely approximates the exponential loss criterion used in the AdaBoost algorithms of Schapire et al., as the natural parameter of the family varies. We also show how the quadratic approximation of the gain in Bregman divergence results in a weighted least-squares criterion. This leads to a family of incremental learning algorithms that builds upon and extends the recent interpretation of boosting in terms of additive models proposed by Friedman, Hastie, and Tibshirani. 1 Introduction Logistic regression is a widely used statisti...}, author = {Lafferty, John}, booktitle = {In Proc. 12th Annu. Conf. on Comput. Learning Theory}, citeulike-article-id = {4873077}, citeulike-linkout-0 = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.17.4755}, keywords = {learning, machine}, pages = {125--133}, posted-at = {2009-06-16 19:42:24}, priority = {2}, title = {Additive Models, Boosting, and Inference for Generalized Divergences}, url = {http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.17.4755}, year = {1999} }

TY - CONF ID - citeulike:4873077 L3 - citeulike-article-id:4873077 N2 - We present a framework for designing incremental learning algorithms derived from generalized entropy functionals. Our approach is based on the use of Bregman divergences together with the associated class of additive models constructed using the Legendre transform. A particular one-parameter family of Bregman divergences is shown to yield a family of loss functions that includes the log-likelihood criterion of logistic regression as a special case, and that closely approximates the exponential loss criterion used in the AdaBoost algorithms of Schapire et al., as the natural parameter of the family varies. We also show how the quadratic approximation of the gain in Bregman divergence results in a weighted least-squares criterion. This leads to a family of incremental learning algorithms that builds upon and extends the recent interpretation of boosting in terms of additive models proposed by Friedman, Hastie, and Tibshirani. 1 Introduction Logistic regression is a widely used statisti... EP - 133 TI - Additive Models, Boosting, and Inference for Generalized Divergences T2 - In Proc. 12th Annu. Conf. on Comput. Learning Theory SP - 125 KW - learning KW - machine AU - Lafferty, John PY - 1999/// UR - http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.17.4755 ER -