Applications of strong convexity--strong smoothness duality to learning with matrices Export

@article{citeulike:5918210, abstract = {It is known that a function is strongly convex with respect to some norm if and only if its conjugate function is strongly smooth with respect to the dual norm. This result has already been found to be a key component in deriving and analyzing several learning algorithms. Utilizing this duality, we isolate a single inequality which seamlessly implies both generalization bounds and online regret bounds; and we show how to construct strongly convex functions over matrices based on strongly convex functions over vectors. The newly constructed functions (over matrices) inherit the strong convexity properties of the underlying vector functions. We demonstrate the potential of this framework by analyzing several learning algorithms including group Lasso, kernel learning, and online control with adversarial quadratic costs.}, archivePrefix = {arXiv}, author = {Kakade, Sham M. and Shalev-Shwartz, Shai and Tewari, Ambuj}, citeulike-article-id = {5918210}, citeulike-linkout-0 = {http://arxiv.org/abs/0910.0610}, citeulike-linkout-1 = {http://arxiv.org/pdf/0910.0610}, day = {4}, eprint = {0910.0610}, keywords = {bounds, convexity, duality, online, radamacher}, month = {Oct}, posted-at = {2009-10-10 04:07:34}, priority = {3}, title = {Applications of strong convexity\&\#45;\&\#45;strong smoothness duality to learning with matrices}, url = {http://arxiv.org/abs/0910.0610}, year = {2009} }

TY - JOUR ID - citeulike:5918210 L3 - citeulike-article-id:5918210 N2 - It is known that a function is strongly convex with respect to some norm if and only if its conjugate function is strongly smooth with respect to the dual norm. This result has already been found to be a key component in deriving and analyzing several learning algorithms. Utilizing this duality, we isolate a single inequality which seamlessly implies both generalization bounds and online regret bounds; and we show how to construct strongly convex functions over matrices based on strongly convex functions over vectors. The newly constructed functions (over matrices) inherit the strong convexity properties of the underlying vector functions. We demonstrate the potential of this framework by analyzing several learning algorithms including group Lasso, kernel learning, and online control with adversarial quadratic costs. TI - Applications of strong convexity--strong smoothness duality to learning with matrices KW - bounds KW - convexity KW - duality KW - online KW - radamacher AU - Kakade, Sham AU - Shalev-Shwartz, Shai AU - Tewari, Ambuj PY - 2009/Oct/04/ UR - http://arxiv.org/abs/0910.0610 ER -