Patent Number: 6,490,580

Title: Hypervideo information retrieval usingmultimedia

Abstract: Disclosed is a method and device for selecting documents, such as Web pages or sites, for presentation to a user, in response to a user expression of interest, during the course of presentation to the user of a document, such as a video or audio selection, whose content varies with time. The method takes advantage of information retrieval techniques to select documents related to the portion of the temporal document in which the user has expressed interest. The method generates the search query to use to select documents by reference to text associated with the portion of the temporal document in which the user has expressed interest, as by using the closed caption test associated with the video, or by using speech recognition techniques. The method further uses a weighting function to weigh the terms used in the search query, depending on their temporal relationship to the user expression of interest. To conserve resources, the method does not transmit the closed caption or other synchronized multimedia information to the user, and obtains the necessary information about the temporal occurrence of terms in the temporal document from a database.

Inventors: Dey; Jayanta Kumar (Cambridge, MA), Xu; Haiping (Acton, MA)

Assignee: Verizon Laboratories Inc.

International Classification: G06F 17/30 (20060101); G06T 001/00 (); G06F 017/30 ()

Expiration Date: 12/03/2019