Joke-O-Mat HD Demonstration Page

Fansourced Transcripts + Closed Caption → Video Navigation
JERRY: I don't know. Uh, it must be love.
At Monks
========
PATRICE: What did I do?
GEORGE: Nothing. It's not you. It's me. I have a 
  fear of commitment. I don't know how to love.
PATRICE: You hate my earrings, don't you?

+

00:04:52,691 --> 00:04:54,716
I don't know. It must be love.

00:05:04,136 --> 00:05:06,468
-What did I do?
-Nothing. It isn't you.

00:05:06,639 --> 00:05:10,598
It's me. I have a fear of commitment.

00:05:10,776 --> 00:05:13,677
-I don't know how to love.
-You hate my earrings, don't you?

Demo Screenshot from Seinfeld

Introduction

This page contains the demonstration material for our 2010 ACM Multimedia Demo and Exhibit entry, Joke-O-Mat HD.

We assume the following use case: When a sitcom is watched a second, third, or later time, a user might want to show a very funny scene to a friend, point out and post the sharpest punchline to his or her Facebook network, or even create a home-made YouTube video composed of the most hilarious moments of his or her favorite actor. In order to do this quickly, we present the user with the basic narrative elements of a sitcom such as the scenes, punchlines, and individual dialog segments on top of a standard video player interface. A per-actor filter helps to search only for elements that contain a certain protagonist. The user is now able to selectively skip certain parts and to directly navigate into elements he or she remembers from the past. For more information on the concept and the underlying technology, please see references below. The Joke-O-Mat HD system (as compared to the non-HD system) has been augmented with keyword filtering using a speech and speaker-recogniton-based process to generate the segmentations from human derived (HD) "found" data, i.e. a combination of fan-sourced manual transcripts and closed captioning.

Java Applet Demonstrators

Here we present three demos. One that was generated using human derived, fan sourced data, one that has been generated fully automatically including ASR for words, and finally one where the acoustic event and speaker identification is based on expert manual annotation (There are no expert word-level annotations available). The Java Applets require a java-compatible browser with Java 1.4 or higher. The video is first downloaded into memory (about 30MB) so a cable Internet connection or better is recommended. Please be patient. Sometimes the navigation bar takes a bit longer to load (due to many icons). We developed it under Linux with Firefox.

Joke-o-Mat (non HD)

The 2009 version of Joke-o-Mat, which won the ACM Multimedia Grand Challenge, can be found here: Joke-O-Mat 2009

References to Joke-o-mat

Joke-O-Mat HD: Joke-O-Mat Non HD:

Disclaimer

The content contained in this website and linked to from the website is Copyright (c) 2009, 2010 by International Computer Science Institute. The authors are: Gerald Friedland, Luke Gottlieb, and Adam Janin. Please contact us for any questions. The software is provided as is, use it at your own risk. The shown Seinfeld, I Love Lucy, and Big Bang Theory episodes are copyright by its respective copyright holders. The excerpts of these are used here solely for the purpose of demonstrating nonprofit scientific research. Please do not illegally use or distribute copyrighted content.