Narrative Theme Navigation for Sitcoms Supported by Fan-Generated Scripts

TitleNarrative Theme Navigation for Sitcoms Supported by Fan-Generated Scripts
Publication TypeJournal Article
Year of Publication2013
AuthorsFriedland, G., Janin A., & Gottlieb L.
Published inMultimedia Tools and Applications
Other Numbers3199

The following article presents a novel method to generateindexing information for the navigation of TV content andpresents an implementation that extends the Joke-O-Matsitcom navigation system, presented in [1]. The extendedsystem enhances Joke-o-mat’s capability to browse a sitcomby scene, punchline, dialog segment, and actor withword-level keyword search. The indexing is performed basedon the alignment of the multimedia content with closedcaptions and “found” fan-generated scripts processed withspeech and speaker recognition systems. This significantlyreduces the amount of manual intervention required for trainingnew episodes, and the final narrative-theme segmentationhas proven indistinguishable from expert annotation.This article describes the new Joke-o-mat system, discussesproblems with using fan-generated data, and presents resultson episodes from the sitcom Seinfeld, showing segmentationaccuracy and user satisfaction as determined by a human subjectstudy.


This work was partially supported by funding provided to ICSI by Microsoft, Intel, and U.C. Discovery.

Bibliographic Notes

Multimedia Tools and Applications, Vol. 63, Issue 2, pp. 387-406, Springer.

Abbreviated Authors

G. Friedland, A. Janin, and L. Gottlieb

ICSI Research Group

Audio and Multimedia

ICSI Publication Type

Article in journal or magazine