Publication Details
Title: There is No Data Like Less Data: Percepts for Video Concept Detection on Consumer-Produced Media
Author: G. Friedland, B. Martinez Elizalde, H. Lei, and A. Divakaran
Group: ICSI Technical Reports
Date: April 12, 2012
PDF: http://www.icsi.berkeley.edu/pubs/techreports/TR-12-006.pdf
Overview:
Video concept detection aims to find videos that show a certain event described as a high-level concept, e.g., “wedding ceremony” or “changing a tire.” This paper presents a theoretical framework and experimental evidence to suggest that video concept detection on consumer-produced videos can be performed by what we call “percepts,” i.e., a set of observable units with Zipfian distribution. We present an unsupervised approach to extract percepts from audio tracks, which we then use to perform experiments to provide evidence for the validity of the proposed theoretical framework using the TrecVID MED 2011 dataset. The approach suggests selecting the most relevant percepts automatically, thereby actually reducing the amount of training data. We show that our framework provides a highly usable foundation for doing video retrieval on consumer-produced content and is applicable for acoustic, visual, as well as multimodal content analysis.
Acknowledgements:
Supported by the Intelligence Advanced Research Projects Activity (IARPA) via Department of Interior National Business Center contract number D11PC20066. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon. The views and conclusion contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsement, either expressed or implied, of IARPA, DOI/NBC, or the U.S. Government.
Bibliographic Information:
ICSI Technical Report TR-12-006
Bibliographic Reference:
G. Friedland, B. Martinez Elizalde, H. Lei, and A. Divakaran. There is No Data Like Less Data: Percepts for Video Concept Detection on Consumer-Produced Media. ICSI Technical Report TR-12-006, April 12, 2012
Author: G. Friedland, B. Martinez Elizalde, H. Lei, and A. Divakaran
Group: ICSI Technical Reports
Date: April 12, 2012
PDF: http://www.icsi.berkeley.edu/pubs/techreports/TR-12-006.pdf
Overview:
Video concept detection aims to find videos that show a certain event described as a high-level concept, e.g., “wedding ceremony” or “changing a tire.” This paper presents a theoretical framework and experimental evidence to suggest that video concept detection on consumer-produced videos can be performed by what we call “percepts,” i.e., a set of observable units with Zipfian distribution. We present an unsupervised approach to extract percepts from audio tracks, which we then use to perform experiments to provide evidence for the validity of the proposed theoretical framework using the TrecVID MED 2011 dataset. The approach suggests selecting the most relevant percepts automatically, thereby actually reducing the amount of training data. We show that our framework provides a highly usable foundation for doing video retrieval on consumer-produced content and is applicable for acoustic, visual, as well as multimodal content analysis.
Acknowledgements:
Supported by the Intelligence Advanced Research Projects Activity (IARPA) via Department of Interior National Business Center contract number D11PC20066. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon. The views and conclusion contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsement, either expressed or implied, of IARPA, DOI/NBC, or the U.S. Government.
Bibliographic Information:
ICSI Technical Report TR-12-006
Bibliographic Reference:
G. Friedland, B. Martinez Elizalde, H. Lei, and A. Divakaran. There is No Data Like Less Data: Percepts for Video Concept Detection on Consumer-Produced Media. ICSI Technical Report TR-12-006, April 12, 2012