SRI-Sarnoff AURORA System at TRECVID 2012 Multimedia Event Detection and Recounting

TitleSRI-Sarnoff AURORA System at TRECVID 2012 Multimedia Event Detection and Recounting
Publication TypeConference Paper
Year of Publication2012
AuthorsCheng, H., Liu J., Ali S., Javed O., Yu Q., Tamrakar A., Divakaran A., Sawhney H. S., Manmatha R.., Allan J., Hauptmann A., Shah M., Bhattacharyya S., Dehghan A., Friedland G., Elizalde B. Martinez, Darrell T., Witbrock M., & Curtis J.
Other Numbers3637

In this paper, we describe the evaluation results for TRECVID 2012 Multimedia Event Detection (MED) and Multimedia Event Recounting (MER) tasks as a part of SRI-Sarnoff AURORA system that is devel- oped under the IARPA ALDDIN program. In AURORA system, we incorporated various low-level fea- tures that capture color, appearance, motion, and audio information in videos. Based on these low-level features, we developed Fixed-Pattern and Object-Orientated spatial feature pooling, which result in signif- icant performance improvement to our system. In addition, we collected more than 1800 concepts and designed a set of concept pooling approaches to build the Concept Based Event Representation (CBER, i.e., high-level features). We submitted six runs exploring various fusions of low-level features, high-level features, and ASR/OCR features for MED task. All runs achieve satisfactory results. In particular, two EK10Ex runs for both pre-specified events (PS-Events) and ad-hoc events (AH-Events) obtain relatively better results. In MER task, we developed an approach to provide a breakdown of the evidences of why the MED decision has been made by exploring the SVM-based event detector. Furthermore, we designed evidence specific verification and detection to reduce uncertainty and improve key evidence discovery. Our MER evaluation results for MER-to-Event are very good.

Bibliographic Notes

Proceedings of the 2012 TREC Video Retrieval Evaluation (TRECVID 2012), Gaithersburg, Maryland

Abbreviated Authors

H. Cheng, Jingen Liu, S. Ali, O. Javed, Q. Yu, A. Tamrakar, A. Divakaran, H. S. Sawhney, R. Manmatha, J. Allan, A. Hauptmann, M. Shah, S. Bhattacharyya, A. Dehghan, G. Friedland, B. Martinez Elizalde, T. Darrell, M. Witbrock, and J. Curtis

ICSI Research Group

Audio and Multimedia

ICSI Publication Type

Article in conference proceedings