EBLA: A Perceptually Grounded Model of Language Acquisition Export

@inproceedings{citeulike:332685, abstract = {This paper introduces an open computational framework for visual perception and grounded language acquisition called Experience-Based Language Acquisition (EBLA). EBLA can ” watch” a series of short videos and acquire a simple language of nouns and verbs corresponding to the objects and object-object relations in those videos. Upon acquiring this protolanguage, EBLA can perform basic scene analysis to generate descriptions of novel videos. The performance of EBLA has been evaluated based on accuracy and speed of protolanguage acquisition as well as on accuracy of generated scene descriptions. For a test set of simple animations, EBLA had average acquisition success rates as high as 100\% and average description success rates as high as 96.7\%. For a larger set of real videos, EBLA had average acquisition success rates as high as 95.8\% and average description success rates as high as 65.3\%. The lower description success rate for the videos is attributed to the wide variance in the appearance of objects across the test set. While there have been several systems capable of learning object or event labels for vid- eos, EBLA is the first known system to acquire both nouns and verbs using a grounded computer vision system.}, author = {Pangburn, Brian E. and Iyengar, Sitharama S. and Mathews, Robert C. and Ayo, Jonathan P.}, citeulike-article-id = {332685}, citeulike-linkout-0 = {http://www.ldc.upenn.edu/acl/W/W03/W03-0607.pdf}, keywords = {acquisition, ebla, language, vision}, organization = {HLT-NAACL}, posted-at = {2005-09-26 20:47:41}, priority = {0}, title = {EBLA: A Perceptually Grounded Model of Language Acquisition}, url = {http://www.ldc.upenn.edu/acl/W/W03/W03-0607.pdf}, year = {2003} }

TY - CONF ID - citeulike:332685 L3 - citeulike-article-id:332685 N2 - This paper introduces an open computational framework for visual perception and grounded language acquisition called Experience-Based Language Acquisition (EBLA). EBLA can “watch” a series of short videos and acquire a simple language of nouns and verbs corresponding to the objects and object-object relations in those videos. Upon acquiring this protolanguage, EBLA can perform basic scene analysis to generate descriptions of novel videos. The performance of EBLA has been evaluated based on accuracy and speed of protolanguage acquisition as well as on accuracy of generated scene descriptions. For a test set of simple animations, EBLA had average acquisition success rates as high as 100% and average description success rates as high as 96.7%. For a larger set of real videos, EBLA had average acquisition success rates as high as 95.8% and average description success rates as high as 65.3%. The lower description success rate for the videos is attributed to the wide variance in the appearance of objects across the test set. While there have been several systems capable of learning object or event labels for vid- eos, EBLA is the first known system to acquire both nouns and verbs using a grounded computer vision system. OR - HLT-NAACL TI - EBLA: A Perceptually Grounded Model of Language Acquisition KW - acquisition KW - ebla KW - language KW - vision AU - Pangburn, Brian AU - Iyengar, Sitharama AU - Mathews, Robert AU - Ayo, Jonathan PY - 2003/// UR - http://www.ldc.upenn.edu/acl/W/W03/W03-0607.pdf ER -