US20030038796A1 - Segmentation metadata for audio-visual content - Google Patents
Segmentation metadata for audio-visual content Download PDFInfo
- Publication number
- US20030038796A1 US20030038796A1 US10/058,869 US5886902A US2003038796A1 US 20030038796 A1 US20030038796 A1 US 20030038796A1 US 5886902 A US5886902 A US 5886902A US 2003038796 A1 US2003038796 A1 US 2003038796A1
- Authority
- US
- United States
- Prior art keywords
- segment
- segments
- group
- program
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/60—Memory management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C7/00—Arrangements for writing information into, or reading information out from, a digital store
- G11C7/10—Input/output [I/O] data interface arrangements, e.g. I/O data control circuits, I/O data buffers
- G11C7/1015—Read-write modes for single port memories, i.e. having either a random port or a serial port
- G11C7/1042—Read-write modes for single port memories, i.e. having either a random port or a serial port using interleaving techniques, i.e. read-write of one part of the memory while preparing another part
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4828—End-user interface for program selection for searching program descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/46—Receiver circuitry for the reception of television signals according to analogue transmission standards for receiving on more than one standard at will
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
- H04N5/7416—Projection arrangements for image reproduction, e.g. using eidophor involving the use of a spatial light modulator, e.g. a light valve, controlled by a video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/012—Conversion between an interlaced and a progressive signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
- H04N7/0132—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter the field or frame frequency of the incoming video signal being multiplied by a positive integer, e.g. for flicker reduction
Definitions
- the present invention relates to descriptions of audio-visual material.
- Digital audiovisual material is becoming increasingly available to users through digital TV broadcast, digital video cameras, digital video discs, and personal computer based access to multimedia on the Internet or other network.
- persistent large-volume storage and non-linear access to audiovisual content is becoming available in consumer devices. Consequently, there is a need for rapid navigation and searching capabilities to enable users to efficiently discover and consume the contents of audiovisual material.
- DVD movies normally provide “scene selections” or “chapter selections” that have a visual array of thumbnails and textual titles associated with each scene. This permits the user to click on the thumbnail of the desired scene, jump to that scene, and start playback. Playback typically continues until the end of the movie, unless the user makes another selection. While somewhat limited, these features provide the capability to index for the purpose of jumping to an arbitrary position and continue playback from that position.
- a system 10 may be used for the presentation of video, audio, or audiovisual information to a user.
- the information may be presented to the user using any suitable medium, such as for example, the Internet, a computer network, the radio, a personal computer, and a television.
- the user or the user's agent interacts with the system 10 to receive the information in a desirable manner and to define preferences as to what type of information is obtained.
- the term user is intended to refer to the recipient of the information, which may be for example, a person, a machine, or a software program operating on a machine.
- a set of description schemes containing data describing the content of the material may be used.
- User preferences 12 may be used in several different areas to maximize both the user's enjoyment and the system functionality.
- the preferences describing the topics and subject matter of interest to the user is used in both searching for and navigating the audiovisual programs 14 .
- These two sets of data, the user preferences 12 and program descriptions 14 are correlated in the filtering and search engine 16 to identify the preferred programs.
- the programs identified by the filtering and search engine 16 are then forwarded to a browsing module 18 along with the user's browsing preferences. Another output of the filtering and search engine 16 are preferred programs that the user has designated for storage. These are stored in the storage module 20 .
- the programs selected by the user with the browsing module 18 are then sent to a display 22 .
- the user may utilize multimedia title descriptions of preferred programs to navigate among the programs that the user wants to consume. Once a program is selected, a summary description of that particular program is correlated with user's browsing preferences to offer the user a preferred summary.
- the display 22 receives the programs and displays them in accordance with the user's device preferences as to the operation of the display.
- User's device preferences may include, for example, device settings such as volume setting that may vary with the genre of the program that is being consumed.
- the display and user's interaction with the display such as stopping a program before its end and consuming certain types of programs with certain device settings, also provides information in a manner analogous to a feedback loop to update and log the usage history 24 .
- the usage history 24 may be mapped against the preferences by a mapping module 26 . This information is then used in conjunction with user inputs by the user preference module 12 .
- User preferences and usage history may be transmitted to the provider of audiovisual programs 14 to receive selected programming or directly receive program segments that are preferred by the user. In the latter case, user preferences may be correlated with summary descriptions at the provider side to select and directly deliver summarized audiovisual programs to the user. The preferences may also be transferred to a “smart card” 28 or similar, portable storage and ultimately transferred to another system by the user.
- the audiovisual programs 14 includes descriptions of the programs in a description framework.
- the description framework can have several different types of descriptive structures, such as those described in MPEG-7, incorporated by reference herein.
- searching includes information related to the content of the media, such as for example, actors, title, genre, etc.
- the searching description scheme, as described in MPEG-7 corresponds to a single video as a whole. A different searching description scheme is included for each video.
- the navigation description scheme includes information related to navigating or otherwise selecting content for viewing, such as for example, table of contents, highlights, key frames, summaries, segments, etc.
- the navigation description scheme as described in MPEG-7, corresponds to segments of the video. Referring to segments of the video is consistent with the desire of the user to navigate a particular video in a particular manner.
- FIG. 1 illustrates a system including preferences.
- FIG. 2 illustrates a searching description scheme and a navigation description scheme.
- FIG. 3 illustrates a combined searching and navigation description scheme.
- FIG. 4 illustrates a generic hierarchical relationship.
- FIG. 5 illustrates permitted grouping.
- FIG. 6 illustrates alternative groups.
- FIG. 7 illustrates a group and related segments.
- FIG. 8 illustrates a table of contents presentation.
- FIG. 9 illustrates a virtual program
- FIG. 10 illustrates a temporal time base for video.
- FIG. 11 illustrates entity relationships
- the present inventors came to the realization that the previously existing searching description scheme (segment description scheme in MPEG-7) and the navigation description scheme (summary description scheme in MPEG-7), as described in MPEG-7, are inconsistent with one another if it is desirable to navigate portions of a video and simultaneously obtain information regarding the content of those portions.
- MPEG-7 does not provide sufficient syntax structures to physically or logically link the segments identified by the navigation description scheme with the video identified by the searching description scheme.
- a modified description scheme syntax incorporates both information related to the searching description scheme and the navigation description scheme (e.g., segmentation description scheme), both within a single description scheme.
- both the searching description scheme and the navigation description scheme are associated with the same segment definition (e.g., specifies physical location of segment within the video).
- the description scheme structure within MPEG-7 permits a hierarchical nesting structure for segment descriptions of the video and descriptions for groups of segments of the video.
- the permitted hierarchical nesting structure is very flexible and permits nearly any desirable interrelationship to be defined.
- FIG. 4 a sample hierarchical nesting structure is illustrated. While such a hierarchical nesting structure is flexible, it turns out to be extremely difficult determining the order to present the segments of video within such a structure. Within a particular level it is difficult to determine which segments to present first and is further complicated by determining which segment to present within the different hierarchical levels. Moreover, the parsing of such a structure is complex which reduces the computational efficiency of the system.
- a segment group may reference either other segments or other segment groups, but not both, as illustrated in FIG. 5.
- a segment group references other segments or other segment groups, but does not contain segments itself.
- a segment group may reference a single segment or otherwise contain a single segment, in which case it is considered a segment.
- any particular segment group will either reference a set of segments which may be readily ordered, or one or more segment groups. Segments may not reference other segments or segment groups.
- a set of rules is useful in order to permit the user to view the available content in an organized manner or otherwise select a set of segments for presentation in a particular order. In this manner the playback, navigation, and presentation order may be unambiguously defined. Therefore different systems will interpret the segmentation data the same.
- One type of organizational technique is to define segments type “alternativeGroups” , which may not contain segments and shall only contain subgroups. The user may select one of the groups from the set of groups at the same hierarchical level originating from the same parent group. Referring to FIG. 6, for example, the user may select Group 1 or Group 2 . If Group 1 is selected, then the user may select Group 3 or Group 4 . Group 3 consists of one segment.
- Group 4 the set of segments referenced by Group 4 are made available to the user. If the user selects Group 4 the segments defined within Group 4 may be presented, as illustrated in FIG. 7. The order of presentation of the segments defined by a Group may be presented to the user in an order defined by the order listed within the Group, such as the first in the list is first played or the last in the list is first played.
- Another type of organizational technique is to define a set of segments of type “tableOfContents”, which presents the groups and segments defined therein in an ordered manner such that the hierarchical order may be observed. For example, a portion of the ordered groups shown in FIG. 6 may be organized as a tableOfContents, as shown in FIG. 8.
- the tableOfContents representation facilitates the user being able to select portions of video content that may be of particular interest to the user in a convenient manner.
- Portions of the hierarchical structure of segment groups may be designated as “alternativeGroups” and other portions of the hierarchical structure may be designated as “tableOfContents”.
- the two different designations of the hierarchical structure are non-overlapping, but may be overlapping, if desired. These designations are preferably not directly associated with segments.
- Existing video summarization systems provide segmentation data for each video and permit the selective viewing of each video according to the segmentation data. While beneficial, the present inventors determined that facilitating the grouping of segments from a plurality of different programs to be viewed within a single presentation defined by a single description scheme is beneficial and not previously possible.
- a “virtual program” consisting of segments from a plurality of different programs may be dynamically constructed and presented, without the need for physically creating the program on a persistent storage medium.
- the description scheme syntax may facilitate the identification of the “virtual program” where the relevant segments may be located with multiple different segments of multiple different programs being identified within a single description scheme syntax, as illustrated in FIG. 9.
- the modified description scheme includes a time base indicator of the time base associated with the particular segment, as illustrated in FIG. 10.
- the time base defined, either explicitly or implicitly, the beginning of the segment is defined together with an offset indicating the duration of the segment.
- the offset is in time units, such as seconds, minutes, frames, fields, etc., and may have a default or implicit definition.
- BasicSegmentDescriptionType Defines basic segment description. Tittle A title of the segment (optional). A segment can have several titles when necessary, e.g. in different languages. Synopsis A synopsis of textual description of the segment (optional). A segment can have several synopses when necessary, e.g. in different languages or lengths. Keywords A keyword associated with the segment (optional). A segment can have several keywords when necessary, e.g. in different languages.
- RelatedMaterial A link to external material related to the segment (optional). A segment can have multiple links.
- SegmentInformation An element that instantiates the SegmentInformationType.
- SegmentInformationType Defines an individual segment.
- ProgramRef A reference to the program this segment belongs to.
- the ProgramRef element When the ProgramRef element is not instantiated within a segment, the program that the segment belongs to is specified by the ProgramRef element of its parent segment group(s).
- Description A description of the content of the segment.
- SegmentLocator Locates the segment within a program (instance) in terms of start time and duration (optional). Defined as an MPEG-7 datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a detailed description). If the duration is not specified, the segment ends at the end of the program.
- KeyFrameLocator Locates a key frame of the segment within a program in terms of a time point (optional). Defined as an MPEG-7 datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a detailed description). MediaDuration and MediaIncrDuration elements of a KeyFrameLocator element should not be used. Multiple key frames may be associated with a single segment.
- timeBase and/or timeUnit attributes for the KeyFrameLocator element are instantiated, they override the default or global time base and time unit definitions provided with the SegmentInformationTable description.
- segmentId The unique identifier of the segment. version The version number of the segment information (optional).
- SegmentGroupInformation An element that instantiates the SegmentGroupInformationType.
- SegmentGroupInformationType Defines an individual segment group.
- ProgramRef A reference to the program this segment belongs to.
- the ProgramRef element references a group CRID that is resolved into the individual programs CRIDs.
- Description A description of the content of the segment group.
- GroupInterval References a single segment that defines the temporal range of the segment group. Segments Defines the segments that are part of this group by providing a list of references to the identifiers of elements of type SegmentInformationType (optional).
- the order of the references to segments in this list determines the ordering of segments within this group.
- Groups Defines the segment groups that are subgroups of this group by providing a list of references to the identifiers of elements of type SegmentGroupInformationType (optional). The order of the references to segment groups in this list determines their ordering within this group.
- KeyFrameLocator Locates a key frame of the segment group within a program in terms of a time point (optional). Defined as an MPEG-7 datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a detailed description). MediaDuration and MediaIncrDuration elements of a KeyFrameLocator element should not be used. Multiple key frames may be associated with a single segment group.
- groupID The unique identifier of the segment group.
- groupType The type of the segment group. A list of the valid segment group types is defined by SegmentGroupTypeType. ordered Specifies whether the given segment group presents an ordered list (i.e. whether order of the segment or segment groups within the given segment group is significant) (optional).
- numberOfSegments The number of segments in the segment group (optional). The value of this attribute specifies only the segments that are direct members of the segment group.
- numberOfKeyFrames The number of key frames in the segment group (optional). The value of this attribute specifies only the key frames of the segments that are direct members of the segment group. duration The sum of the durations of the segments contained within this group (optional).
- topLevel Specifies whether the given segment group is a top-level group (optional). version The version number of the segment group (optional). SegmentGroupTypeType A simple type that specifies the valid types of segment groups.
- highlights The group of segments represents selected highlights from one or more programs.
- the segments that constitute a highlight group are presented seamlessly in sequence, without any temporal interruptions.
- highlights/objects The group of segments represents selected highlights from a program (or programs) that share a common object or objects (e.g. Seinfeld highlights with Kramer).
- highlights/events The group of segments represents selected highlights from a program (or programs) that share a common event or events (e.g. touchdowns in the Super Bowl).
- bookmarks The segment group defines a set of access points to a program. If the member segments of a segment group of type bookmarks contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended”.
- bookmarks/objects The segment group defines a set of access points to a program, where the selected access points share a common object or objects. If the member segments of a segment group of type bookmarks/objects contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended.”
- bookmarks/events The segment group defines a set of access points to a program, where the selected access points share a common event or events. If the member segments of a segment group of type bookmarks/events contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended.”
- themeGroup The segment group comprises segments that share a common topic or theme.
- the common theme can be specified in the segment group description.
- a theme group does not necessarily require direct continuous playback.
- preview The segment group defines a preview of a program.
- preview/title The segment group defines a preview of a program, where the preview serves as a promotional title or trailer for the program.
- preview/slideshow The segment group defines a preview of a program, where the preview serves as a compact slideshow of the program content.
- tableOfContents The segment group defines a navigable table of contents for the program.
- synopsis The segment group provides a summary or synopsis of the program.
- shots The segment group provides a list of the shots in the program.
- alternativeGroups Each member of this type of segment group provides an alternative view of representation, with the same functionality but different durations or levels of detail.
- a segment group may contain either segments, or subgroups, but not both.
- a segment group of type “alternativeGroups” may not contain segments and shall only contain subgroups.
- a segment group of any type other than “tableOfContents” and “alternativeGroups” may only contain segments.
- a group of type “tableOfContents” may contain other segment groups of type “tableOfContents”.
- Program The program entity represents an editorially coherent audiovisual content.
- Program Program Location provides a physical location where Location the program is available.
- a program may be available at multiple program locations; however, the time lines of the different instances of a program are preferably identical.
- Segment A segment is a continuous fragment of a program.
- a particular segment should belong to a single program, but it may be a member of multiple segment groups.
- Segment A segment group is a collection of segments that are grouped Group together, for a particular purpose or due to a shared property.
- a segment group may contain segments, or other segment groups.
- Program-to-Segment A Segment is part of a single program.
- a Program may contain multiple segments.
- Segment-to-Segment Group A Segment may belong to zero or more Segment Groups.
- a Segment Group may contain zero or more Segments (possibly from multiple Programs).
- Segment Group-to-Segment Group A Segment Group may be a member of zero or more Segment Groups, and it may contain zero or more Segment Groups.
- a Segment Group may contain either segments, or subgroups, but not both.
- SegmentInformationTable An element that instantiates the SegmentInformationTableType.
- SegmentInformationTableType Defines a structure for holding segmentation-related metadata.
- SegmentList The list of the segments in the SegmentInformationTable SegmentGroupList
- TimeBaseReference Defines the time base reference(s) for the current description. Multiple time base references can be specified for a single SegmentInformationTable. These references can be referred to by the timeBase attributes of the SegmentLocator and KeyFrameLocator elements of the description. If no TimeBaseReference is provided in the description, the time base is taken to be the start point of the program identified by the associated CRID.
- TimeBaseReference element specifies the time base for all the segments in the description.
- RefMediaTime Specifies the time base reference using an element of MPEG-7 type mediaTimePointType (See Sec. 6.3.9 of MPEG-7 for a detailed description).
- RefURI Specifies the time base reference using an element of type any URI.
- timeUnit Specifies the duration of the time intervals used in the incremental specifications of relative time points and duration. Default time unit is milliseconds. version The version number of the segment information table (optional).
Abstract
Descriptions of audio-visual material.
Description
- The present invention relates to descriptions of audio-visual material.
- Digital audiovisual material is becoming increasingly available to users through digital TV broadcast, digital video cameras, digital video discs, and personal computer based access to multimedia on the Internet or other network. In addition, persistent large-volume storage and non-linear access to audiovisual content is becoming available in consumer devices. Consequently, there is a need for rapid navigation and searching capabilities to enable users to efficiently discover and consume the contents of audiovisual material.
- The extensive proliferation of audio-visual material available to users has the potential to overwhelm the consumer and lead to frustration at the inability to search and view content in an efficient manner. Viewing summaries of the content allows the consumer to skip irrelevant content and view the desired content quickly and easily. Further, multiple different summaries, if available, may provide the user with alternative views of a particular program that the user could choose from depending on personal preferences or usage conditions.
- Limited summary selection capabilities are appearing more frequently in current technologies, such as the digital video disk (DVD). DVD movies normally provide “scene selections” or “chapter selections” that have a visual array of thumbnails and textual titles associated with each scene. This permits the user to click on the thumbnail of the desired scene, jump to that scene, and start playback. Playback typically continues until the end of the movie, unless the user makes another selection. While somewhat limited, these features provide the capability to index for the purpose of jumping to an arbitrary position and continue playback from that position.
- Referring to FIG. 1, a
system 10 may be used for the presentation of video, audio, or audiovisual information to a user. The information may be presented to the user using any suitable medium, such as for example, the Internet, a computer network, the radio, a personal computer, and a television. The user or the user's agent interacts with thesystem 10 to receive the information in a desirable manner and to define preferences as to what type of information is obtained. The term user is intended to refer to the recipient of the information, which may be for example, a person, a machine, or a software program operating on a machine. - To define these interactions, a set of description schemes containing data describing the content of the material may be used.
User preferences 12 may be used in several different areas to maximize both the user's enjoyment and the system functionality. The preferences describing the topics and subject matter of interest to the user is used in both searching for and navigating theaudiovisual programs 14. These two sets of data, theuser preferences 12 andprogram descriptions 14, are correlated in the filtering andsearch engine 16 to identify the preferred programs. - The programs identified by the filtering and
search engine 16 are then forwarded to abrowsing module 18 along with the user's browsing preferences. Another output of the filtering andsearch engine 16 are preferred programs that the user has designated for storage. These are stored in thestorage module 20. The programs selected by the user with thebrowsing module 18 are then sent to adisplay 22. The user may utilize multimedia title descriptions of preferred programs to navigate among the programs that the user wants to consume. Once a program is selected, a summary description of that particular program is correlated with user's browsing preferences to offer the user a preferred summary. - The
display 22 receives the programs and displays them in accordance with the user's device preferences as to the operation of the display. User's device preferences may include, for example, device settings such as volume setting that may vary with the genre of the program that is being consumed. The display and user's interaction with the display, such as stopping a program before its end and consuming certain types of programs with certain device settings, also provides information in a manner analogous to a feedback loop to update and log theusage history 24. Theusage history 24 may be mapped against the preferences by amapping module 26. This information is then used in conjunction with user inputs by theuser preference module 12. - These user preferences may be useful in many contexts, not just an audiovisual presentation system. User preferences and usage history may be transmitted to the provider of
audiovisual programs 14 to receive selected programming or directly receive program segments that are preferred by the user. In the latter case, user preferences may be correlated with summary descriptions at the provider side to select and directly deliver summarized audiovisual programs to the user. The preferences may also be transferred to a “smart card” 28 or similar, portable storage and ultimately transferred to another system by the user. - However, it is noted that a framework for the description of the individual description schemes at the user, program, or device level are needed. As illustrated in FIG. 1, the
audiovisual programs 14 includes descriptions of the programs in a description framework. The description framework can have several different types of descriptive structures, such as those described in MPEG-7, incorporated by reference herein. Referring to FIG. 2, one particular type of potential description scheme is related to searching. Searching includes information related to the content of the media, such as for example, actors, title, genre, etc. The searching description scheme, as described in MPEG-7, corresponds to a single video as a whole. A different searching description scheme is included for each video. Referring to the entire video is consistent with the desire of the user to quickly search the available videos for particular content related to the videos as a whole. Another type of description scheme is related to navigation. The navigation description scheme includes information related to navigating or otherwise selecting content for viewing, such as for example, table of contents, highlights, key frames, summaries, segments, etc. The navigation description scheme, as described in MPEG-7, corresponds to segments of the video. Referring to segments of the video is consistent with the desire of the user to navigate a particular video in a particular manner. - FIG. 1 illustrates a system including preferences.
- FIG. 2 illustrates a searching description scheme and a navigation description scheme.
- FIG. 3 illustrates a combined searching and navigation description scheme.
- FIG. 4 illustrates a generic hierarchical relationship.
- FIG. 5 illustrates permitted grouping.
- FIG. 6 illustrates alternative groups.
- FIG. 7 illustrates a group and related segments.
- FIG. 8 illustrates a table of contents presentation.
- FIG. 9 illustrates a virtual program.
- FIG. 10 illustrates a temporal time base for video.
- FIG. 11 illustrates entity relationships.
- The present inventors came to the realization that the previously existing searching description scheme (segment description scheme in MPEG-7) and the navigation description scheme (summary description scheme in MPEG-7), as described in MPEG-7, are inconsistent with one another if it is desirable to navigate portions of a video and simultaneously obtain information regarding the content of those portions. In particular, MPEG-7 does not provide sufficient syntax structures to physically or logically link the segments identified by the navigation description scheme with the video identified by the searching description scheme. Referring to FIG. 3, a modified description scheme syntax incorporates both information related to the searching description scheme and the navigation description scheme (e.g., segmentation description scheme), both within a single description scheme. Moreover, the incorporation of both the searching description scheme and the navigation description scheme into a single description scheme eliminates some redundant information. Within an XML syntax structure both the searching and the navigational descriptions are associated with the same segment definition (e.g., specifies physical location of segment within the video).
- The description scheme structure within MPEG-7 permits a hierarchical nesting structure for segment descriptions of the video and descriptions for groups of segments of the video. The permitted hierarchical nesting structure is very flexible and permits nearly any desirable interrelationship to be defined. Referring to FIG. 4, a sample hierarchical nesting structure is illustrated. While such a hierarchical nesting structure is flexible, it turns out to be extremely difficult determining the order to present the segments of video within such a structure. Within a particular level it is difficult to determine which segments to present first and is further complicated by determining which segment to present within the different hierarchical levels. Moreover, the parsing of such a structure is complex which reduces the computational efficiency of the system.
- To overcome the non-deterministic nature of the hierarchical structure the preferred system imposes at least one or more of the following restrictions. A segment group may reference either other segments or other segment groups, but not both, as illustrated in FIG. 5. A segment group references other segments or other segment groups, but does not contain segments itself. In some cases a segment group may reference a single segment or otherwise contain a single segment, in which case it is considered a segment. In this manner, any particular segment group will either reference a set of segments which may be readily ordered, or one or more segment groups. Segments may not reference other segments or segment groups.
- With the set of permissible interconnections limited a set of rules is useful in order to permit the user to view the available content in an organized manner or otherwise select a set of segments for presentation in a particular order. In this manner the playback, navigation, and presentation order may be unambiguously defined. Therefore different systems will interpret the segmentation data the same. One type of organizational technique is to define segments type “alternativeGroups” , which may not contain segments and shall only contain subgroups. The user may select one of the groups from the set of groups at the same hierarchical level originating from the same parent group. Referring to FIG. 6, for example, the user may select
Group 1 orGroup 2. IfGroup 1 is selected, then the user may selectGroup 3 orGroup 4.Group 3 consists of one segment. IfGroup 4 is selected, then the set of segments referenced byGroup 4 are made available to the user. If the user selectsGroup 4 the segments defined withinGroup 4 may be presented, as illustrated in FIG. 7. The order of presentation of the segments defined by a Group may be presented to the user in an order defined by the order listed within the Group, such as the first in the list is first played or the last in the list is first played. - Another type of organizational technique is to define a set of segments of type “tableOfContents”, which presents the groups and segments defined therein in an ordered manner such that the hierarchical order may be observed. For example, a portion of the ordered groups shown in FIG. 6 may be organized as a tableOfContents, as shown in FIG. 8. The tableOfContents representation facilitates the user being able to select portions of video content that may be of particular interest to the user in a convenient manner.
- Portions of the hierarchical structure of segment groups may be designated as “alternativeGroups” and other portions of the hierarchical structure may be designated as “tableOfContents”. Preferably, the two different designations of the hierarchical structure are non-overlapping, but may be overlapping, if desired. These designations are preferably not directly associated with segments.
- Existing video summarization systems provide segmentation data for each video and permit the selective viewing of each video according to the segmentation data. While beneficial, the present inventors determined that facilitating the grouping of segments from a plurality of different programs to be viewed within a single presentation defined by a single description scheme is beneficial and not previously possible. A “virtual program” consisting of segments from a plurality of different programs may be dynamically constructed and presented, without the need for physically creating the program on a persistent storage medium. Thus the description scheme syntax may facilitate the identification of the “virtual program” where the relevant segments may be located with multiple different segments of multiple different programs being identified within a single description scheme syntax, as illustrated in FIG. 9. Thus for example, it is possible to view various news reports from different news sources in a sequence without having to individually manually select each news report from each news source.
- Principally, existing description schemes for audiovisual content permit linking to external content, such as a web site of a news article on a relevant topic or other material of related interest to the content. However, it was determined that more focused external content may be selected for the user if the content was associated with segments of the video, as opposed to the entire video. In this manner, a single video may include multiple links to external content, each link being associated with a different portion of the video.
- Another issue that arises with respect to selecting segments within multiple different video streams is the different techniques that may be used to indicate “time”. For example, the frame rate is not always the same, with movie film typically being 24 frames per second and television being 30 frames per second (each frame consisting of two fields). In addition, the time base for MPEG-1, DVD's, MPEG-2, VCR, Movies, Internet based streaming media, etc., are not the same. Accordingly, the modified description scheme includes a time base indicator of the time base associated with the particular segment, as illustrated in FIG. 10. With the time base defined, either explicitly or implicitly, the beginning of the segment is defined together with an offset indicating the duration of the segment. The offset is in time units, such as seconds, minutes, frames, fields, etc., and may have a default or implicit definition.
- The following may be used to describe the descriptive properties of segments:
<complexType name=“BasicSegmentDescriptionType”> <sequence> <element name=“Title” type=“mpeg7:TitleType” minOccurs=“0” maxOccurs=“unbounded”/> <element name=“Synopsis” type=“tva:SynopsisType” minOccurs=“0” maxOccurs=“unbounded”/> <element name=“Keywords” = “mpeg7:KeywordAnnotationType” minOccurs=“0” maxOccurs=“1”/> <element name=“RelatedMaterial” type=“tva:RelatedMaterialType” minOccurs=“0” maxOccurs=“unbounded”/> </sequence> </complexType> - The terms and definitions may be as follows:
BasicSegmentDescriptionType Defines basic segment description. Tittle A title of the segment (optional). A segment can have several titles when necessary, e.g. in different languages. Synopsis A synopsis of textual description of the segment (optional). A segment can have several synopses when necessary, e.g. in different languages or lengths. Keywords A keyword associated with the segment (optional). A segment can have several keywords when necessary, e.g. in different languages. RelatedMaterial A link to external material related to the segment (optional). A segment can have multiple links. - The following element and complex type may be used to define a segment.
<element name=“Segment Information” type=“tva:SegmentInformationType”/> <complexType name=“SegmentInformationType”> <sequence> <element name=“ProgramRef type=“tva:CRIDRefType” minOccurs=”0”/> <element name=“Description” type=“tva:BasicSegmentDescriptionType” minOccurs=“0”/> <element name=“SegmentLocator” type=“mpeg7:MediaTimeType”/> <element name=“KeyFrameLocator” type=“mpeg7:MediaTimeType” minOccurs=“0” maxOccurs=“unbounded”/> </sequence> <attribute name=“segmentId” type=“xsd:ID” use=“required”/> <attribute name=“version” type=“xsd:integer” use=“optional”/> </complexType> - The terms and definitions may be as follows:
SegmentInformation An element that instantiates the SegmentInformationType. SegmentInformationType Defines an individual segment. ProgramRef A reference to the program this segment belongs to. When the ProgramRef element is not instantiated within a segment, the program that the segment belongs to is specified by the ProgramRef element of its parent segment group(s). Description A description of the content of the segment. SegmentLocator Locates the segment within a program (instance) in terms of start time and duration (optional). Defined as an MPEG-7 datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a detailed description). If the duration is not specified, the segment ends at the end of the program. If the timeBase and/or timeUnit attributes for the SegmentLocator element are instantiated, they override the default or global time base and time unit definitions provided with the SegmentInformationTable description. KeyFrameLocator Locates a key frame of the segment within a program in terms of a time point (optional). Defined as an MPEG-7 datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a detailed description). MediaDuration and MediaIncrDuration elements of a KeyFrameLocator element should not be used. Multiple key frames may be associated with a single segment. If the timeBase and/or timeUnit attributes for the KeyFrameLocator element are instantiated, they override the default or global time base and time unit definitions provided with the SegmentInformationTable description. segmentId The unique identifier of the segment. version The version number of the segment information (optional). - The following element and complex types may be used to define segment grouping.
<element name=“SegmentGroupInformation” type=“tva:SegmentGroupInformationType”/> <complexType> name=“SegmentGroupInformationType”> <sequence> <element name=“ProgramRef” type=”tva:CRIDRefType”/> <element name=“Description”type=“tva:BasicSegmentDescriptionType” minOccurs=“0”/> <element name=“GroupInterval” minOccurs=“0”> <complexType> <attribute name=“ref” type=xsd:IDREF”/> </complexType> </element> <choice minOccurs=“0” maxOccurs=“1”> <element name=“Segments”> <complexType> <attribute name=“refList” type=xsd:IDREFS=“use“required”/> </complexType> </element> <element name=“Groups” <complexType> <attribute name=“refList” type=xsd:IDREFS” use=“required”/> </complexType> </element> <choice> </sequence> <element name=“KeyFrameLocator” type=“mpeg7:MediaTimeType” minOccurs=“0”maxOccurs=“unbounded”/> <attribute name=“groupId” type=“xsd:ID” use=“required”/> <attribute name=“groupType” type=“tva:SegmentGroupTypeType” use=“required”/> <attribute name=“ordered” type=“xsd:boolean” use=“optional”/> <attribute name=“numberOfSegments” type=“xsd:positiveInteger” use=“optional”/> <attribute name=“numberOfKeyFrames” type=“xds:positiveInteger” use=“optional”/> <attribute name=“numberOfKeyFrames” type=“xsd:positiveInteger” use=“optional”/> <attribute name=“duration” type=“mpeg7:mediaDurationType” use=“optional”/> <attribute name=“topLevel” type=“xsd:boolean” use=“optional”/> <attribute name=“version”type=“xsd:integer” use=“optional”/> </complexType> <simpleType name=“SegmentGroupTypeType”> <list> <simpleType> <restriction base=“xsd:string”> <enumeration value=“highlights”/> <enumeration value=“highlights/objects”/> <enumeration value=“highlights/events”/> <enumeration value=“bookmarks”/> <enumeration value=“bookmards/objects”/> <enumeration value=“bookmarks/events”/> <enumeration value=“themeGroup”/> <enumeration value=“preview”/> <enumeration value=“preview/title”/> <enumeration value=“preview/slideshow”/> <enumeration value=“tableOfContents”/> <enumeration value=“synopsis”/> <enumeration value=“shots”/> <enumeration value=“alternativeGroups”/> <enumeration value=“other”/> </restrlction> </simpleType> </list> </simpleType> - The names and definitions may be as follows:
SegmentGroupInformation An element that instantiates the SegmentGroupInformationType. SegmentGroupInformationType Defines an individual segment group. ProgramRef A reference to the program this segment belongs to. When the member segments/groups are collected from different programs (e.g. to create a “virtual program”) the ProgramRef element references a group CRID that is resolved into the individual programs CRIDs. Description A description of the content of the segment group. GroupInterval References a single segment that defines the temporal range of the segment group. Segments Defines the segments that are part of this group by providing a list of references to the identifiers of elements of type SegmentInformationType (optional). The order of the references to segments in this list determines the ordering of segments within this group. Groups Defines the segment groups that are subgroups of this group by providing a list of references to the identifiers of elements of type SegmentGroupInformationType (optional). The order of the references to segment groups in this list determines their ordering within this group. KeyFrameLocator Locates a key frame of the segment group within a program in terms of a time point (optional). Defined as an MPEG-7 datatype, MediaTimeType (See Sec. 6.3.9 of MPEG-7 for a detailed description). MediaDuration and MediaIncrDuration elements of a KeyFrameLocator element should not be used. Multiple key frames may be associated with a single segment group. groupID The unique identifier of the segment group. groupType The type of the segment group. A list of the valid segment group types is defined by SegmentGroupTypeType. ordered Specifies whether the given segment group presents an ordered list (i.e. whether order of the segment or segment groups within the given segment group is significant) (optional). numberOfSegments The number of segments in the segment group (optional). The value of this attribute specifies only the segments that are direct members of the segment group. numberOfKeyFrames The number of key frames in the segment group (optional). The value of this attribute specifies only the key frames of the segments that are direct members of the segment group. duration The sum of the durations of the segments contained within this group (optional). This duration corresponds to the sum of the durations of the segments that are direct members of the segment group. topLevel Specifies whether the given segment group is a top-level group (optional). version The version number of the segment group (optional). SegmentGroupTypeType A simple type that specifies the valid types of segment groups. - The allowed types may be defined as follows:
- highlights—The group of segments represents selected highlights from one or more programs. The segments that constitute a highlight group are presented seamlessly in sequence, without any temporal interruptions.
- highlights/objects—The group of segments represents selected highlights from a program (or programs) that share a common object or objects (e.g. Seinfeld highlights with Kramer).
- highlights/events—The group of segments represents selected highlights from a program (or programs) that share a common event or events (e.g. touchdowns in the Super Bowl).
- bookmarks—The segment group defines a set of access points to a program. If the member segments of a segment group of type bookmarks contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended”.
- bookmarks/objects—The segment group defines a set of access points to a program, where the selected access points share a common object or objects. If the member segments of a segment group of type bookmarks/objects contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended.”
- bookmarks/events—The segment group defines a set of access points to a program, where the selected access points share a common event or events. If the member segments of a segment group of type bookmarks/events contain segment duration information, this duration information shall be ignored, and the segments shall be treated as “open-ended.”
- themeGroup—The segment group comprises segments that share a common topic or theme. The common theme can be specified in the segment group description. A theme group does not necessarily require direct continuous playback.
- preview—The segment group defines a preview of a program.
- preview/title—The segment group defines a preview of a program, where the preview serves as a promotional title or trailer for the program.
- preview/slideshow—The segment group defines a preview of a program, where the preview serves as a compact slideshow of the program content.
- tableOfContents—The segment group defines a navigable table of contents for the program.
- synopsis—The segment group provides a summary or synopsis of the program.
- shots—The segment group provides a list of the shots in the program.
- alternativeGroups—Each member of this type of segment group provides an alternative view of representation, with the same functionality but different durations or levels of detail.
- other—The functionality of the segment group does not fit into any of the other types defined.
- Various validity constraints may be imposed on the proposed description scheme to ensure that (i) it fits the data model of FIG. 11, and (ii) the sequence and relationships of the various segments and segment groups are unambiguously defined. These constraints, which are implicit in the description schemes, are outlined below for clarity:
- (a) A segment group may contain either segments, or subgroups, but not both.
- (b) A segment group of type “alternativeGroups” may not contain segments and shall only contain subgroups.
- (c) A segment group of any type other than “tableOfContents” and “alternativeGroups” may only contain segments. A group of type “tableOfContents” may contain other segment groups of type “tableOfContents”.
- These validity constraints reduce the complexity of the resulting descriptions by limiting the degree of nesting in the hierarchy. The navigation order of segments or segment groups is determined by the order of references to the segments in a segment group.
- The entities may be defined as follows:
Program The program entity represents an editorially coherent audiovisual content. Program Program Location provides a physical location where Location the program is available. A program may be available at multiple program locations; however, the time lines of the different instances of a program are preferably identical. Segment A segment is a continuous fragment of a program. A particular segment should belong to a single program, but it may be a member of multiple segment groups. Segment A segment group is a collection of segments that are grouped Group together, for a particular purpose or due to a shared property. A segment group may contain segments, or other segment groups. - The entity relationships may be defined, as follows.
Program-to-Segment A Segment is part of a single program. A Program may contain multiple segments. Segment-to-Segment Group A Segment may belong to zero or more Segment Groups. A Segment Group may contain zero or more Segments (possibly from multiple Programs). Segment Group-to-Segment Group A Segment Group may be a member of zero or more Segment Groups, and it may contain zero or more Segment Groups. A Segment Group may contain either segments, or subgroups, but not both. - The following element and complex type define a structure for holding segmentation-related metadata.
<element name=“SegmentInformationTable” type=“tva:SegmentInformationTableType”/> <complexType name=“SegmentInformationTableType”> <sequence> <element name=“SegmentList”> <complexType> <sequence> <element ref=“tva:SegmentInformation” minOccurs=“0”maxOccurs=“unbounded”/> </sequence> </complexType> </element> <element name=“SegmentGroupList” <complexType> <sequence> <element ref=“tva:SegmentGroupInformation” minOccurs=“0” maxOccurs=”unbounded”/> </sequence> </complexType> </element> <element name=“TimeBase Reference” minOccurs=“0” maxOccurs=“unbounded”/> <complexType> <choice> <element name=“RefMediaTime” type=“mpeg7:mediaTimePointType”/> <element name=“RefURI” type=“xsd:anyURI”/> </choice> </complexType> </element> </sequence> <attribute name=“timeUnit” type=“mpeg7:mediaDurationType” use=“default” value=“PT1N1000F”/> <attribute name=“version” type=“xsd:integer” use=“optional”/> </complexType> - The names and definitions may be as follows:
SegmentInformationTable An element that instantiates the SegmentInformationTableType. SegmentInformationTableType Defines a structure for holding segmentation-related metadata. SegmentList The list of the segments in the SegmentInformationTable SegmentGroupList The list of the segment groups in the SegmentInformationTable TimeBaseReference Defines the time base reference(s) for the current description. Multiple time base references can be specified for a single SegmentInformationTable. These references can be referred to by the timeBase attributes of the SegmentLocator and KeyFrameLocator elements of the description. If no TimeBaseReference is provided in the description, the time base is taken to be the start point of the program identified by the associated CRID. If a single TimeBaseReference element is specified, this element specifies the time base for all the segments in the description. RefMediaTime Specifies the time base reference using an element of MPEG-7 type mediaTimePointType (See Sec. 6.3.9 of MPEG-7 for a detailed description). RefURI Specifies the time base reference using an element of type any URI. timeUnit Specifies the duration of the time intervals used in the incremental specifications of relative time points and duration. Default time unit is milliseconds. version The version number of the segment information table (optional). - The terms and expressions employed in the foregoing specification are used therein as terms of description and not of limitation, and there is no intention in the use of such terms and expressions of excluding equivalents of the features shown and described or portions thereof, it being recognized that the scope of the invention is defined and limited only by the claims that follow.
Claims (1)
1. A single description scheme for audiovisual content that includes both navigational information and searching information.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/058,869 US20030038796A1 (en) | 2001-02-15 | 2002-01-28 | Segmentation metadata for audio-visual content |
US10/867,981 US8606782B2 (en) | 2001-02-15 | 2004-06-14 | Segmentation description scheme for audio-visual content |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US26978301P | 2001-02-15 | 2001-02-15 | |
US10/058,869 US20030038796A1 (en) | 2001-02-15 | 2002-01-28 | Segmentation metadata for audio-visual content |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/867,981 Continuation US8606782B2 (en) | 2001-02-15 | 2004-06-14 | Segmentation description scheme for audio-visual content |
Publications (1)
Publication Number | Publication Date |
---|---|
US20030038796A1 true US20030038796A1 (en) | 2003-02-27 |
Family
ID=26738114
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/058,869 Abandoned US20030038796A1 (en) | 2001-02-15 | 2002-01-28 | Segmentation metadata for audio-visual content |
US10/867,981 Expired - Fee Related US8606782B2 (en) | 2001-02-15 | 2004-06-14 | Segmentation description scheme for audio-visual content |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/867,981 Expired - Fee Related US8606782B2 (en) | 2001-02-15 | 2004-06-14 | Segmentation description scheme for audio-visual content |
Country Status (1)
Country | Link |
---|---|
US (2) | US20030038796A1 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030182627A1 (en) * | 2002-03-09 | 2003-09-25 | Samsung Electronics Co., Ltd. | Reproducing method and apparatus for interactive mode using markup documents |
US20050028199A1 (en) * | 2003-07-30 | 2005-02-03 | Borden George R. | Personal video recorder user interface |
US20080065693A1 (en) * | 2006-09-11 | 2008-03-13 | Bellsouth Intellectual Property Corporation | Presenting and linking segments of tagged media files in a media services network |
US20080189754A1 (en) * | 2005-03-10 | 2008-08-07 | Kyoung-Ro Yoon | Pod Identification Method in Digital Content Providing System |
US8151194B1 (en) * | 2008-03-26 | 2012-04-03 | Google Inc. | Visual presentation of video usage statistics |
US20140132836A1 (en) * | 2012-11-12 | 2014-05-15 | Electronics And Telecommunications Research Institute | Method and apparatus for generating summarized information, and server for the same |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9697229B2 (en) * | 2008-04-11 | 2017-07-04 | Adobe Systems Incorporated | Methods and systems for creating and storing metadata |
US9451335B2 (en) | 2014-04-29 | 2016-09-20 | At&T Intellectual Property I, Lp | Method and apparatus for augmenting media content |
Citations (95)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4183056A (en) * | 1977-05-23 | 1980-01-08 | Kewp Electronic Systems, Inc. | Apparatus and method for monitoring sports contests |
US4253108A (en) * | 1979-06-04 | 1981-02-24 | Zenith Radio Corporation | Control for color killer and automatic color limiter |
US4937685A (en) * | 1983-12-02 | 1990-06-26 | Lex Computer And Management Corporation | Method of display presentation for video editing |
US5027400A (en) * | 1988-08-19 | 1991-06-25 | Hitachi Ltd. | Multimedia bidirectional broadcast system |
US5109482A (en) * | 1989-01-11 | 1992-04-28 | David Bohrman | Interactive video control system for displaying user-selectable clips |
US5200825A (en) * | 1992-07-01 | 1993-04-06 | Beam Laser Systems, Inc. | Commercial insertion system remotely controlling multiple video switches |
US5223924A (en) * | 1992-05-27 | 1993-06-29 | North American Philips Corporation | System and method for automatically correlating user preferences with a T.V. program information database |
USD348251S (en) * | 1992-12-09 | 1994-06-28 | Discovery Communications, Inc. | Menu control panel for a universal remote control unit |
US5333091A (en) * | 1993-01-08 | 1994-07-26 | Arthur D. Little Enterprises, Inc. | Method and apparatus for controlling a videotape player to automatically scan past recorded commercial messages |
US5339393A (en) * | 1993-04-15 | 1994-08-16 | Sony Electronics, Inc. | Graphical user interface for displaying available source material for editing |
USD354059S (en) * | 1992-12-03 | 1995-01-03 | Discovery Communications, Inc. | Remote control unit |
US5424770A (en) * | 1993-04-16 | 1995-06-13 | Cable Service Technologies, Inc. | Method and apparatus for automatic insertion of a television signal from a remote source |
USD368263S (en) * | 1994-07-12 | 1996-03-26 | Discovery Communications, Inc. | Remote control unit |
US5521841A (en) * | 1994-03-31 | 1996-05-28 | Siemens Corporate Research, Inc. | Browsing contents of a given video sequence |
US5600364A (en) * | 1992-12-09 | 1997-02-04 | Discovery Communications, Inc. | Network controller for cable television delivery systems |
US5600573A (en) * | 1992-12-09 | 1997-02-04 | Discovery Communications, Inc. | Operations center with video storage for a television program packaging and delivery system |
US5635982A (en) * | 1994-06-27 | 1997-06-03 | Zhang; Hong J. | System for automatic video segmentation and key frame extraction for video sequences having both sharp and gradual transitions |
USD381991S (en) * | 1994-07-12 | 1997-08-05 | Discovery Communications, Inc. | Remote control unit |
US5654769A (en) * | 1992-03-11 | 1997-08-05 | Texas Instruments Incorporated | Digital color control and chroma killer device |
US5659350A (en) * | 1992-12-09 | 1997-08-19 | Discovery Communications, Inc. | Operations center for a television program packaging and delivery system |
US5717923A (en) * | 1994-11-03 | 1998-02-10 | Intel Corporation | Method and apparatus for dynamically customizing electronic information to individual end users |
US5732216A (en) * | 1996-10-02 | 1998-03-24 | Internet Angles, Inc. | Audio message exchange system |
US5734853A (en) * | 1992-12-09 | 1998-03-31 | Discovery Communications, Inc. | Set top terminal for cable television delivery systems |
US5751953A (en) * | 1995-08-31 | 1998-05-12 | U.S. Philips Corporation | Interactive entertainment personalisation |
US5758257A (en) * | 1994-11-29 | 1998-05-26 | Herz; Frederick | System and method for scheduling broadcast of and access to video programs and other data using customer profiles |
US5774357A (en) * | 1991-12-23 | 1998-06-30 | Hoffberg; Steven M. | Human factored interface incorporating adaptive pattern recognition based controller apparatus |
US5774666A (en) * | 1996-10-18 | 1998-06-30 | Silicon Graphics, Inc. | System and method for displaying uniform network resource locators embedded in time-based medium |
US5778108A (en) * | 1996-06-07 | 1998-07-07 | Electronic Data Systems Corporation | Method and system for detecting transitional markers such as uniform fields in a video signal |
US5798785A (en) * | 1992-12-09 | 1998-08-25 | Discovery Communications, Inc. | Terminal for suggesting programs offered on a television program delivery system |
US5857190A (en) * | 1996-06-27 | 1999-01-05 | Microsoft Corporation | Event logging system and method for logging events in a network system |
US5861881A (en) * | 1991-11-25 | 1999-01-19 | Actv, Inc. | Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers |
US5875107A (en) * | 1996-12-05 | 1999-02-23 | Mitsubishi Denki Kabushiki Kaisha | Inverter apparatus |
US5875108A (en) * | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5901246A (en) * | 1995-06-06 | 1999-05-04 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5920300A (en) * | 1994-10-27 | 1999-07-06 | Semiconductor Energy Laboratory Co., Ltd. | Active matrix liquid crystal display device |
US5923365A (en) * | 1993-10-12 | 1999-07-13 | Orad Hi-Tech Systems, Ltd | Sports event video manipulating system for highlighting movement |
US5933811A (en) * | 1996-08-20 | 1999-08-03 | Paul D. Angles | System and method for delivering customized advertisements within interactive communication systems |
US6014183A (en) * | 1997-08-06 | 2000-01-11 | Imagine Products, Inc. | Method and apparatus for detecting scene changes in a digital video stream |
US6055569A (en) * | 1998-01-27 | 2000-04-25 | Go Ahead Software Inc. | Accelerating web access by predicting user action |
US6055018A (en) * | 1997-11-04 | 2000-04-25 | Ati Technologies, Inc. | System and method for reconstructing noninterlaced captured content for display on a progressive screen |
US6064449A (en) * | 1997-10-31 | 2000-05-16 | Webtv Networks, Inc. | Automatic characterization of a television signal |
US6081750A (en) * | 1991-12-23 | 2000-06-27 | Hoffberg; Steven Mark | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US6100941A (en) * | 1998-07-28 | 2000-08-08 | U.S. Philips Corporation | Apparatus and method for locating a commercial disposed within a video data stream |
US6169542B1 (en) * | 1998-12-14 | 2001-01-02 | Gte Main Street Incorporated | Method of delivering advertising through an interactive video distribution system |
US6181335B1 (en) * | 1992-12-09 | 2001-01-30 | Discovery Communications, Inc. | Card for a set top terminal |
US6195497B1 (en) * | 1993-10-25 | 2001-02-27 | Hitachi, Ltd. | Associated image retrieving apparatus and method |
US6201536B1 (en) * | 1992-12-09 | 2001-03-13 | Discovery Communications, Inc. | Network manager for cable television system headends |
US6216129B1 (en) * | 1998-12-03 | 2001-04-10 | Expanse Networks, Inc. | Advertisement selection system supporting discretionary target market characteristics |
US6219837B1 (en) * | 1997-10-23 | 2001-04-17 | International Business Machines Corporation | Summary frames in video |
US6230501B1 (en) * | 1994-04-14 | 2001-05-15 | Promxd Technology, Inc. | Ergonomic systems and methods providing intelligent adaptive surfaces and temperature control |
US6233590B1 (en) * | 1996-12-13 | 2001-05-15 | Venson M. Shaw | Server apparatus for distributed communications supporting multiple user/application environment |
US6236395B1 (en) * | 1999-02-01 | 2001-05-22 | Sharp Laboratories Of America, Inc. | Audiovisual information management system |
US6252544B1 (en) * | 1998-01-27 | 2001-06-26 | Steven M. Hoffberg | Mobile communication device |
US6275268B1 (en) * | 1993-09-09 | 2001-08-14 | United Video Properties, Inc. | Electronic television program guide with remote product ordering |
US6342904B1 (en) * | 1998-12-17 | 2002-01-29 | Newstakes, Inc. | Creating a slide presentation from full motion video |
US20020013943A1 (en) * | 2000-04-07 | 2002-01-31 | Seth Haberman | System and method for simultaneous broadcast for personalized messages |
US20020018594A1 (en) * | 2000-07-06 | 2002-02-14 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for high-level structure analysis and event detection in domain specific videos |
US6353444B1 (en) * | 1998-03-05 | 2002-03-05 | Matsushita Electric Industrial Co., Ltd. | User interface apparatus and broadcast receiving apparatus |
US6363160B1 (en) * | 1999-01-22 | 2002-03-26 | Intel Corporation | Interface using pattern recognition and tracking |
US20020069218A1 (en) * | 2000-07-24 | 2002-06-06 | Sanghoon Sull | System and method for indexing, searching, identifying, and editing portions of electronic multimedia files |
US20020083473A1 (en) * | 2000-12-21 | 2002-06-27 | Philips Electronics North America Corporation | System and method for accessing a multimedia summary of a video program |
US20020080162A1 (en) * | 2000-11-02 | 2002-06-27 | Hao Pan | Method for automatic extraction of semantically significant events from video |
US20020087967A1 (en) * | 2000-01-13 | 2002-07-04 | G. Colby Conkwright | Privacy compliant multiple dataset correlation system |
US6418168B1 (en) * | 1999-03-24 | 2002-07-09 | Sony Corporation | Motion vector detection apparatus, method of the same, and image processing apparatus |
US20020093591A1 (en) * | 2000-12-12 | 2002-07-18 | Nec Usa, Inc. | Creating audio-centric, imagecentric, and integrated audio visual summaries |
US20020104087A1 (en) * | 2000-12-05 | 2002-08-01 | Philips Electronics North America Corp. | Method and apparatus for selective updating of a user profile |
US20020108112A1 (en) * | 2001-02-02 | 2002-08-08 | Ensequence, Inc. | System and method for thematically analyzing and annotating an audio-visual sequence |
US20030001880A1 (en) * | 2001-04-18 | 2003-01-02 | Parkervision, Inc. | Method, system, and computer program product for producing and distributing enhanced media |
US6549643B1 (en) * | 1999-11-30 | 2003-04-15 | Siemens Corporate Research, Inc. | System and method for selecting key-frames of video data |
US6556767B2 (en) * | 1995-12-15 | 2003-04-29 | Hitachi Ltd | Video capture device |
US20030084448A1 (en) * | 2001-10-26 | 2003-05-01 | Koninklijke Philips Electronics N.V. | Automatic viewing-history based television control system |
US20030081937A1 (en) * | 2001-07-03 | 2003-05-01 | Baoxin Li | Summarization of video content |
US20030084450A1 (en) * | 2001-10-25 | 2003-05-01 | Thurston Nathaniel J. | Method and system for presenting personalized television program recommendation to viewers |
US20030088872A1 (en) * | 1997-07-03 | 2003-05-08 | Nds Limited | Advanced television system |
US6594699B1 (en) * | 1997-10-10 | 2003-07-15 | Kasenna, Inc. | System for capability based multimedia streaming over a network |
US6597859B1 (en) * | 1999-12-16 | 2003-07-22 | Intel Corporation | Method and apparatus for abstracting video data |
US6675158B1 (en) * | 1999-11-30 | 2004-01-06 | Sony Corporation | Method and apparatus for organizing data pertaining to audiovisual content |
US6678635B2 (en) * | 2001-01-23 | 2004-01-13 | Intel Corporation | Method and system for detecting semantic events |
US20040017389A1 (en) * | 2002-07-25 | 2004-01-29 | Hao Pan | Summarization of soccer video content |
US6691126B1 (en) * | 2000-06-14 | 2004-02-10 | International Business Machines Corporation | Method and apparatus for locating multi-region objects in an image or video database |
US6724933B1 (en) * | 2000-07-28 | 2004-04-20 | Microsoft Corporation | Media segmentation system and related methods |
US20040088289A1 (en) * | 2001-03-29 | 2004-05-06 | Li-Qun Xu | Image processing |
US6741655B1 (en) * | 1997-05-05 | 2004-05-25 | The Trustees Of Columbia University In The City Of New York | Algorithms and system for object-oriented content-based video search |
US20040125124A1 (en) * | 2000-07-24 | 2004-07-01 | Hyeokman Kim | Techniques for constructing and browsing a hierarchical video structure |
US20050028194A1 (en) * | 1998-01-13 | 2005-02-03 | Elenbaas Jan Hermanus | Personalized news retrieval system |
US20050055713A1 (en) * | 2003-09-09 | 2005-03-10 | Samsung Electronics Co., Ltd. | Apparatus and method for sharing recommended programs using digital set-top boxes |
US20050131906A1 (en) * | 2003-12-13 | 2005-06-16 | Samsung Electronics Co., Ltd. | Method and apparatus for managing data written in markup language and computer-readable recording medium for recording a program |
US7003792B1 (en) * | 1998-11-30 | 2006-02-21 | Index Systems, Inc. | Smart agent based on habit, statistical inference and psycho-demographic profiling |
US7055168B1 (en) * | 2000-05-03 | 2006-05-30 | Sharp Laboratories Of America, Inc. | Method for interpreting and executing user preferences of audiovisual information |
US20060129544A1 (en) * | 1999-09-22 | 2006-06-15 | Lg Electronics, Inc. | User preference information structure having multiple hierarchical structure and method for providing multimedia information using the same |
US20070011148A1 (en) * | 1998-11-12 | 2007-01-11 | Accenture Llp | System, method and article of manufacture for advanced information gathering for targetted activities |
US7185355B1 (en) * | 1998-03-04 | 2007-02-27 | United Video Properties, Inc. | Program guide system with preference profiles |
US7199798B1 (en) * | 1999-01-26 | 2007-04-03 | International Business Machines Corp | Method and device for describing video contents |
US7249366B1 (en) * | 1998-05-15 | 2007-07-24 | International Business Machines Corporation | Control of a system for processing a stream of information based on information content |
US7380262B2 (en) * | 2001-06-12 | 2008-05-27 | Thomson Licensing | Method and apparatus for generating a list of suggested scheduled television programs |
Family Cites Families (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4321635A (en) | 1979-04-20 | 1982-03-23 | Teac Corporation | Apparatus for selective retrieval of information streams or items |
US4298884A (en) | 1980-03-31 | 1981-11-03 | Zenith Radio Corporation | Chroma amplifier and color killer |
US4520404A (en) | 1982-08-23 | 1985-05-28 | Kohorn H Von | System, apparatus and method for recording and editing broadcast transmissions |
US4729044A (en) | 1985-02-05 | 1988-03-01 | Lex Computing & Management Corporation | Method and apparatus for playing serially stored segments in an arbitrary sequence |
US5101364A (en) | 1990-02-09 | 1992-03-31 | Massachusetts Institute Of Technology | Method and facility for dynamic video composition and viewing |
US5148154A (en) | 1990-12-04 | 1992-09-15 | Sony Corporation Of America | Multi-dimensional user interface |
US5434678A (en) | 1993-01-11 | 1995-07-18 | Abecassis; Max | Seamless transmission of non-sequential video segments |
US5953485A (en) | 1992-02-07 | 1999-09-14 | Abecassis; Max | Method and system for maintaining audio during video control |
US5610653A (en) | 1992-02-07 | 1997-03-11 | Abecassis; Max | Method and system for automatically tracking a zoomed video image |
US6208805B1 (en) | 1992-02-07 | 2001-03-27 | Max Abecassis | Inhibiting a control function from interfering with a playing of a video |
US5684918A (en) | 1992-02-07 | 1997-11-04 | Abecassis; Max | System for integrating video and communications |
US5371551A (en) | 1992-10-29 | 1994-12-06 | Logan; James | Time delayed digital video system using concurrent recording and playback |
US5986690A (en) | 1992-12-09 | 1999-11-16 | Discovery Communications, Inc. | Electronic book selection and delivery system |
US5987211A (en) | 1993-01-11 | 1999-11-16 | Abecassis; Max | Seamless transmission of non-sequential video segments |
HU217720B (en) | 1994-09-14 | 2000-04-28 | Koninklijke Philips Electronics Nv. | Sintered moulding, transformer core and inductor core of li(ni)zn ferrite material, as wellgas induction lamp |
US5675752A (en) | 1994-09-15 | 1997-10-07 | Sony Corporation | Interactive applications generator for an interactive presentation environment |
US5664227A (en) | 1994-10-14 | 1997-09-02 | Carnegie Mellon University | System and method for skimming digital audio/video data |
USD402310S (en) | 1994-11-07 | 1998-12-08 | Discovery Communications, Inc. | Electronic book |
US5617565A (en) | 1994-11-29 | 1997-04-01 | Hitachi America, Ltd. | Broadcast interactive multimedia system |
US5805733A (en) | 1994-12-12 | 1998-09-08 | Apple Computer, Inc. | Method and system for detecting scenes and summarizing video sequences |
US5821945A (en) | 1995-02-03 | 1998-10-13 | The Trustees Of Princeton University | Method and apparatus for video browsing based on content and structure |
US5710884A (en) | 1995-03-29 | 1998-01-20 | Intel Corporation | System for automatically updating personal profile server with updates to additional user information gathered from monitoring user's electronic consuming habits generated on computer during use |
US5761881A (en) | 1995-05-10 | 1998-06-09 | Wall; Benjamin | Process and apparatus for wrapping paper rolls |
US5900867A (en) | 1995-07-17 | 1999-05-04 | Gateway 2000, Inc. | Self identifying remote control device having a television receiver for use in a computer |
US5958006A (en) | 1995-11-13 | 1999-09-28 | Motorola, Inc. | Method and apparatus for communicating summarized data |
KR0183149B1 (en) | 1995-12-30 | 1999-05-01 | 김광호 | Motion image detection method |
US5969755A (en) | 1996-02-05 | 1999-10-19 | Texas Instruments Incorporated | Motion based event detection system and method |
KR100274522B1 (en) * | 1996-03-14 | 2001-01-15 | 니시무로 타이죠 | Multi magnetic head and magnetic disk device having this |
US5959697A (en) | 1996-06-07 | 1999-09-28 | Electronic Data Systems Corporation | Method and system for detecting dissolve transitions in a video signal |
US5926624A (en) | 1996-09-12 | 1999-07-20 | Audible, Inc. | Digital information library and delivery system with logic for generating files targeted to the playback device |
US6088455A (en) | 1997-01-07 | 2000-07-11 | Logan; James D. | Methods and apparatus for selectively reproducing segments of broadcast programming |
US5892536A (en) | 1996-10-03 | 1999-04-06 | Personal Audio | Systems and methods for computer enhanced broadcast monitoring |
US5986692A (en) | 1996-10-03 | 1999-11-16 | Logan; James D. | Systems and methods for computer enhanced broadcast monitoring |
US5917553A (en) | 1996-10-22 | 1999-06-29 | Fox Sports Productions Inc. | Method and apparatus for enhancing the broadcast of a live event |
US5931901A (en) | 1996-12-09 | 1999-08-03 | Robert L. Wolfe | Programmed music on demand from the internet |
US5973683A (en) | 1997-11-24 | 1999-10-26 | International Business Machines Corporation | Dynamic regulation of television viewing content based on viewer profile and viewing history |
US5956026A (en) | 1997-12-19 | 1999-09-21 | Sharp Laboratories Of America, Inc. | Method for hierarchical summarization and browsing of digital video |
US5990980A (en) | 1997-12-23 | 1999-11-23 | Sarnoff Corporation | Detection of transitions in video sequences |
US6304665B1 (en) | 1998-04-03 | 2001-10-16 | Sportvision, Inc. | System for determining the end of a path for a moving object |
JP3907839B2 (en) | 1998-06-17 | 2007-04-18 | 松下電器産業株式会社 | Broadcast system |
US6141041A (en) | 1998-06-22 | 2000-10-31 | Lucent Technologies Inc. | Method and apparatus for determination and visualization of player field coverage in a sporting event |
US6233389B1 (en) | 1998-07-30 | 2001-05-15 | Tivo, Inc. | Multimedia time warping system |
US6144375A (en) | 1998-08-14 | 2000-11-07 | Praja Inc. | Multi-perspective viewer for content-based interactivity |
US6215526B1 (en) | 1998-11-06 | 2001-04-10 | Tivo, Inc. | Analog video tagging and encoding system |
US6408128B1 (en) | 1998-11-12 | 2002-06-18 | Max Abecassis | Replaying with supplementary information a segment of a video |
US6774917B1 (en) | 1999-03-11 | 2004-08-10 | Fuji Xerox Co., Ltd. | Methods and apparatuses for interactive similarity searching, retrieval, and browsing of video |
US6993245B1 (en) | 1999-11-18 | 2006-01-31 | Vulcan Patents Llc | Iterative, maximally probable, batch-mode commercial detection for audiovisual content |
US6665423B1 (en) | 2000-01-27 | 2003-12-16 | Eastman Kodak Company | Method and system for object-oriented motion-based video description |
US6490320B1 (en) * | 2000-02-02 | 2002-12-03 | Mitsubishi Electric Research Laboratories Inc. | Adaptable bitstream video delivery system |
US6970510B1 (en) | 2000-04-25 | 2005-11-29 | Wee Susie J | Method for downstream editing of compressed video |
US6829781B1 (en) | 2000-05-24 | 2004-12-07 | At&T Corp. | Network-based service to provide on-demand video summaries of television programs |
US20040125877A1 (en) | 2000-07-17 | 2004-07-01 | Shin-Fu Chang | Method and system for indexing and content-based adaptive streaming of digital video content |
US7548565B2 (en) * | 2000-07-24 | 2009-06-16 | Vmark, Inc. | Method and apparatus for fast metadata generation, delivery and access for live broadcast program |
US6774908B2 (en) | 2000-10-03 | 2004-08-10 | Creative Frontier Inc. | System and method for tracking an object in a video and linking information thereto |
US6981129B1 (en) | 2000-11-02 | 2005-12-27 | Intel Corporation | Breaking replay dependency loops in a processor using a rescheduled replay queue |
WO2002054762A1 (en) | 2000-12-28 | 2002-07-11 | Sony Corporation | Content creating device and method |
US20020120929A1 (en) | 2001-02-28 | 2002-08-29 | Schwalb Eddie M. | Method and system for mass customization of digital television broadcasts |
JP3663362B2 (en) | 2001-03-30 | 2005-06-22 | インターナショナル・ビジネス・マシーンズ・コーポレーション | Index generator |
US6813372B2 (en) | 2001-03-30 | 2004-11-02 | Logitech, Inc. | Motion and audio detection based webcamming and bandwidth control |
US20020194589A1 (en) | 2001-05-08 | 2002-12-19 | Cristofalo Michael | Technique for optimizing the delivery of advertisements and other programming segments by making bandwidth tradeoffs |
-
2002
- 2002-01-28 US US10/058,869 patent/US20030038796A1/en not_active Abandoned
-
2004
- 2004-06-14 US US10/867,981 patent/US8606782B2/en not_active Expired - Fee Related
Patent Citations (101)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4183056A (en) * | 1977-05-23 | 1980-01-08 | Kewp Electronic Systems, Inc. | Apparatus and method for monitoring sports contests |
US4253108A (en) * | 1979-06-04 | 1981-02-24 | Zenith Radio Corporation | Control for color killer and automatic color limiter |
US4937685A (en) * | 1983-12-02 | 1990-06-26 | Lex Computer And Management Corporation | Method of display presentation for video editing |
US5027400A (en) * | 1988-08-19 | 1991-06-25 | Hitachi Ltd. | Multimedia bidirectional broadcast system |
US5109482A (en) * | 1989-01-11 | 1992-04-28 | David Bohrman | Interactive video control system for displaying user-selectable clips |
US5861881A (en) * | 1991-11-25 | 1999-01-19 | Actv, Inc. | Interactive computer system for providing an interactive presentation with personalized video, audio and graphics responses for multiple viewers |
US5875108A (en) * | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5920477A (en) * | 1991-12-23 | 1999-07-06 | Hoffberg; Steven M. | Human factored interface incorporating adaptive pattern recognition based controller apparatus |
US5903454A (en) * | 1991-12-23 | 1999-05-11 | Hoffberg; Linda Irene | Human-factored interface corporating adaptive pattern recognition based controller apparatus |
US6081750A (en) * | 1991-12-23 | 2000-06-27 | Hoffberg; Steven Mark | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5867386A (en) * | 1991-12-23 | 1999-02-02 | Hoffberg; Steven M. | Morphological pattern recognition based controller system |
US5774357A (en) * | 1991-12-23 | 1998-06-30 | Hoffberg; Steven M. | Human factored interface incorporating adaptive pattern recognition based controller apparatus |
US5654769A (en) * | 1992-03-11 | 1997-08-05 | Texas Instruments Incorporated | Digital color control and chroma killer device |
US5223924A (en) * | 1992-05-27 | 1993-06-29 | North American Philips Corporation | System and method for automatically correlating user preferences with a T.V. program information database |
US5200825A (en) * | 1992-07-01 | 1993-04-06 | Beam Laser Systems, Inc. | Commercial insertion system remotely controlling multiple video switches |
USD354059S (en) * | 1992-12-03 | 1995-01-03 | Discovery Communications, Inc. | Remote control unit |
US5600364A (en) * | 1992-12-09 | 1997-02-04 | Discovery Communications, Inc. | Network controller for cable television delivery systems |
US5600573A (en) * | 1992-12-09 | 1997-02-04 | Discovery Communications, Inc. | Operations center with video storage for a television program packaging and delivery system |
USD348251S (en) * | 1992-12-09 | 1994-06-28 | Discovery Communications, Inc. | Menu control panel for a universal remote control unit |
US6181335B1 (en) * | 1992-12-09 | 2001-01-30 | Discovery Communications, Inc. | Card for a set top terminal |
US5798785A (en) * | 1992-12-09 | 1998-08-25 | Discovery Communications, Inc. | Terminal for suggesting programs offered on a television program delivery system |
US5659350A (en) * | 1992-12-09 | 1997-08-19 | Discovery Communications, Inc. | Operations center for a television program packaging and delivery system |
US6052554A (en) * | 1992-12-09 | 2000-04-18 | Discovery Communications, Inc. | Television program delivery system |
US6201536B1 (en) * | 1992-12-09 | 2001-03-13 | Discovery Communications, Inc. | Network manager for cable television system headends |
US5734853A (en) * | 1992-12-09 | 1998-03-31 | Discovery Communications, Inc. | Set top terminal for cable television delivery systems |
US5333091A (en) * | 1993-01-08 | 1994-07-26 | Arthur D. Little Enterprises, Inc. | Method and apparatus for controlling a videotape player to automatically scan past recorded commercial messages |
US5333091B1 (en) * | 1993-01-08 | 1996-05-07 | Arthur D Little Enterprises | Method and apparatus for controlling a videotape player to automatically scan past recorded commercial messages |
US5333091B2 (en) * | 1993-01-08 | 1996-12-17 | Arthur D Little Enterprises | Method and apparatus for controlling a videotape player to automatically scan past recorded commercial messages |
US5339393A (en) * | 1993-04-15 | 1994-08-16 | Sony Electronics, Inc. | Graphical user interface for displaying available source material for editing |
US5424770A (en) * | 1993-04-16 | 1995-06-13 | Cable Service Technologies, Inc. | Method and apparatus for automatic insertion of a television signal from a remote source |
US6275268B1 (en) * | 1993-09-09 | 2001-08-14 | United Video Properties, Inc. | Electronic television program guide with remote product ordering |
US5923365A (en) * | 1993-10-12 | 1999-07-13 | Orad Hi-Tech Systems, Ltd | Sports event video manipulating system for highlighting movement |
US6195497B1 (en) * | 1993-10-25 | 2001-02-27 | Hitachi, Ltd. | Associated image retrieving apparatus and method |
US5521841A (en) * | 1994-03-31 | 1996-05-28 | Siemens Corporate Research, Inc. | Browsing contents of a given video sequence |
US6230501B1 (en) * | 1994-04-14 | 2001-05-15 | Promxd Technology, Inc. | Ergonomic systems and methods providing intelligent adaptive surfaces and temperature control |
US5635982A (en) * | 1994-06-27 | 1997-06-03 | Zhang; Hong J. | System for automatic video segmentation and key frame extraction for video sequences having both sharp and gradual transitions |
USD368263S (en) * | 1994-07-12 | 1996-03-26 | Discovery Communications, Inc. | Remote control unit |
USD381991S (en) * | 1994-07-12 | 1997-08-05 | Discovery Communications, Inc. | Remote control unit |
US5920300A (en) * | 1994-10-27 | 1999-07-06 | Semiconductor Energy Laboratory Co., Ltd. | Active matrix liquid crystal display device |
US5717923A (en) * | 1994-11-03 | 1998-02-10 | Intel Corporation | Method and apparatus for dynamically customizing electronic information to individual end users |
US5758257A (en) * | 1994-11-29 | 1998-05-26 | Herz; Frederick | System and method for scheduling broadcast of and access to video programs and other data using customer profiles |
US5901246A (en) * | 1995-06-06 | 1999-05-04 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5751953A (en) * | 1995-08-31 | 1998-05-12 | U.S. Philips Corporation | Interactive entertainment personalisation |
US6556767B2 (en) * | 1995-12-15 | 2003-04-29 | Hitachi Ltd | Video capture device |
US5778108A (en) * | 1996-06-07 | 1998-07-07 | Electronic Data Systems Corporation | Method and system for detecting transitional markers such as uniform fields in a video signal |
US5857190A (en) * | 1996-06-27 | 1999-01-05 | Microsoft Corporation | Event logging system and method for logging events in a network system |
US5933811A (en) * | 1996-08-20 | 1999-08-03 | Paul D. Angles | System and method for delivering customized advertisements within interactive communication systems |
US5732216A (en) * | 1996-10-02 | 1998-03-24 | Internet Angles, Inc. | Audio message exchange system |
US5774666A (en) * | 1996-10-18 | 1998-06-30 | Silicon Graphics, Inc. | System and method for displaying uniform network resource locators embedded in time-based medium |
US5875107A (en) * | 1996-12-05 | 1999-02-23 | Mitsubishi Denki Kabushiki Kaisha | Inverter apparatus |
US6233590B1 (en) * | 1996-12-13 | 2001-05-15 | Venson M. Shaw | Server apparatus for distributed communications supporting multiple user/application environment |
US6741655B1 (en) * | 1997-05-05 | 2004-05-25 | The Trustees Of Columbia University In The City Of New York | Algorithms and system for object-oriented content-based video search |
US20030088872A1 (en) * | 1997-07-03 | 2003-05-08 | Nds Limited | Advanced television system |
US6014183A (en) * | 1997-08-06 | 2000-01-11 | Imagine Products, Inc. | Method and apparatus for detecting scene changes in a digital video stream |
US6594699B1 (en) * | 1997-10-10 | 2003-07-15 | Kasenna, Inc. | System for capability based multimedia streaming over a network |
US6219837B1 (en) * | 1997-10-23 | 2001-04-17 | International Business Machines Corporation | Summary frames in video |
US6064449A (en) * | 1997-10-31 | 2000-05-16 | Webtv Networks, Inc. | Automatic characterization of a television signal |
US6055018A (en) * | 1997-11-04 | 2000-04-25 | Ati Technologies, Inc. | System and method for reconstructing noninterlaced captured content for display on a progressive screen |
US20050028194A1 (en) * | 1998-01-13 | 2005-02-03 | Elenbaas Jan Hermanus | Personalized news retrieval system |
US6252544B1 (en) * | 1998-01-27 | 2001-06-26 | Steven M. Hoffberg | Mobile communication device |
US6055569A (en) * | 1998-01-27 | 2000-04-25 | Go Ahead Software Inc. | Accelerating web access by predicting user action |
US7185355B1 (en) * | 1998-03-04 | 2007-02-27 | United Video Properties, Inc. | Program guide system with preference profiles |
US6353444B1 (en) * | 1998-03-05 | 2002-03-05 | Matsushita Electric Industrial Co., Ltd. | User interface apparatus and broadcast receiving apparatus |
US7249366B1 (en) * | 1998-05-15 | 2007-07-24 | International Business Machines Corporation | Control of a system for processing a stream of information based on information content |
US6100941A (en) * | 1998-07-28 | 2000-08-08 | U.S. Philips Corporation | Apparatus and method for locating a commercial disposed within a video data stream |
US20070011148A1 (en) * | 1998-11-12 | 2007-01-11 | Accenture Llp | System, method and article of manufacture for advanced information gathering for targetted activities |
US7003792B1 (en) * | 1998-11-30 | 2006-02-21 | Index Systems, Inc. | Smart agent based on habit, statistical inference and psycho-demographic profiling |
US6216129B1 (en) * | 1998-12-03 | 2001-04-10 | Expanse Networks, Inc. | Advertisement selection system supporting discretionary target market characteristics |
US6169542B1 (en) * | 1998-12-14 | 2001-01-02 | Gte Main Street Incorporated | Method of delivering advertising through an interactive video distribution system |
US6342904B1 (en) * | 1998-12-17 | 2002-01-29 | Newstakes, Inc. | Creating a slide presentation from full motion video |
US6363160B1 (en) * | 1999-01-22 | 2002-03-26 | Intel Corporation | Interface using pattern recognition and tracking |
US7199798B1 (en) * | 1999-01-26 | 2007-04-03 | International Business Machines Corp | Method and device for describing video contents |
US6236395B1 (en) * | 1999-02-01 | 2001-05-22 | Sharp Laboratories Of America, Inc. | Audiovisual information management system |
US6418168B1 (en) * | 1999-03-24 | 2002-07-09 | Sony Corporation | Motion vector detection apparatus, method of the same, and image processing apparatus |
US20060129544A1 (en) * | 1999-09-22 | 2006-06-15 | Lg Electronics, Inc. | User preference information structure having multiple hierarchical structure and method for providing multimedia information using the same |
US6675158B1 (en) * | 1999-11-30 | 2004-01-06 | Sony Corporation | Method and apparatus for organizing data pertaining to audiovisual content |
US6549643B1 (en) * | 1999-11-30 | 2003-04-15 | Siemens Corporate Research, Inc. | System and method for selecting key-frames of video data |
US6597859B1 (en) * | 1999-12-16 | 2003-07-22 | Intel Corporation | Method and apparatus for abstracting video data |
US20020087967A1 (en) * | 2000-01-13 | 2002-07-04 | G. Colby Conkwright | Privacy compliant multiple dataset correlation system |
US20020013943A1 (en) * | 2000-04-07 | 2002-01-31 | Seth Haberman | System and method for simultaneous broadcast for personalized messages |
US7055168B1 (en) * | 2000-05-03 | 2006-05-30 | Sharp Laboratories Of America, Inc. | Method for interpreting and executing user preferences of audiovisual information |
US6691126B1 (en) * | 2000-06-14 | 2004-02-10 | International Business Machines Corporation | Method and apparatus for locating multi-region objects in an image or video database |
US20020018594A1 (en) * | 2000-07-06 | 2002-02-14 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for high-level structure analysis and event detection in domain specific videos |
US20040125124A1 (en) * | 2000-07-24 | 2004-07-01 | Hyeokman Kim | Techniques for constructing and browsing a hierarchical video structure |
US20020069218A1 (en) * | 2000-07-24 | 2002-06-06 | Sanghoon Sull | System and method for indexing, searching, identifying, and editing portions of electronic multimedia files |
US6724933B1 (en) * | 2000-07-28 | 2004-04-20 | Microsoft Corporation | Media segmentation system and related methods |
US20020080162A1 (en) * | 2000-11-02 | 2002-06-27 | Hao Pan | Method for automatic extraction of semantically significant events from video |
US20020104087A1 (en) * | 2000-12-05 | 2002-08-01 | Philips Electronics North America Corp. | Method and apparatus for selective updating of a user profile |
US20020093591A1 (en) * | 2000-12-12 | 2002-07-18 | Nec Usa, Inc. | Creating audio-centric, imagecentric, and integrated audio visual summaries |
US20020083473A1 (en) * | 2000-12-21 | 2002-06-27 | Philips Electronics North America Corporation | System and method for accessing a multimedia summary of a video program |
US6678635B2 (en) * | 2001-01-23 | 2004-01-13 | Intel Corporation | Method and system for detecting semantic events |
US20020108112A1 (en) * | 2001-02-02 | 2002-08-08 | Ensequence, Inc. | System and method for thematically analyzing and annotating an audio-visual sequence |
US20040088289A1 (en) * | 2001-03-29 | 2004-05-06 | Li-Qun Xu | Image processing |
US20030001880A1 (en) * | 2001-04-18 | 2003-01-02 | Parkervision, Inc. | Method, system, and computer program product for producing and distributing enhanced media |
US7380262B2 (en) * | 2001-06-12 | 2008-05-27 | Thomson Licensing | Method and apparatus for generating a list of suggested scheduled television programs |
US20030081937A1 (en) * | 2001-07-03 | 2003-05-01 | Baoxin Li | Summarization of video content |
US20030084450A1 (en) * | 2001-10-25 | 2003-05-01 | Thurston Nathaniel J. | Method and system for presenting personalized television program recommendation to viewers |
US20030084448A1 (en) * | 2001-10-26 | 2003-05-01 | Koninklijke Philips Electronics N.V. | Automatic viewing-history based television control system |
US20040017389A1 (en) * | 2002-07-25 | 2004-01-29 | Hao Pan | Summarization of soccer video content |
US20050055713A1 (en) * | 2003-09-09 | 2005-03-10 | Samsung Electronics Co., Ltd. | Apparatus and method for sharing recommended programs using digital set-top boxes |
US20050131906A1 (en) * | 2003-12-13 | 2005-06-16 | Samsung Electronics Co., Ltd. | Method and apparatus for managing data written in markup language and computer-readable recording medium for recording a program |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030182627A1 (en) * | 2002-03-09 | 2003-09-25 | Samsung Electronics Co., Ltd. | Reproducing method and apparatus for interactive mode using markup documents |
US20040243927A1 (en) * | 2002-03-09 | 2004-12-02 | Samsung Electronics Co. Ltd. | Reproducing method and apparatus for interactive mode using markup documents |
US20040247292A1 (en) * | 2002-03-09 | 2004-12-09 | Samsung Electronics Co. Ltd. | Reproducing method and apparatus for interactive mode using markup documents |
US20050028199A1 (en) * | 2003-07-30 | 2005-02-03 | Borden George R. | Personal video recorder user interface |
US20080189754A1 (en) * | 2005-03-10 | 2008-08-07 | Kyoung-Ro Yoon | Pod Identification Method in Digital Content Providing System |
US20080065693A1 (en) * | 2006-09-11 | 2008-03-13 | Bellsouth Intellectual Property Corporation | Presenting and linking segments of tagged media files in a media services network |
US8151194B1 (en) * | 2008-03-26 | 2012-04-03 | Google Inc. | Visual presentation of video usage statistics |
US9218051B1 (en) * | 2008-03-26 | 2015-12-22 | Google Inc. | Visual presentation of video usage statistics |
US20140132836A1 (en) * | 2012-11-12 | 2014-05-15 | Electronics And Telecommunications Research Institute | Method and apparatus for generating summarized information, and server for the same |
US9426411B2 (en) * | 2012-11-12 | 2016-08-23 | Electronics And Telecommunications Research Institute | Method and apparatus for generating summarized information, and server for the same |
Also Published As
Publication number | Publication date |
---|---|
US8606782B2 (en) | 2013-12-10 |
US20050154763A1 (en) | 2005-07-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9237203B2 (en) | Integrated media content server system and method for the customization of metadata that is associated therewith | |
US8020183B2 (en) | Audiovisual management system | |
JP3810268B2 (en) | Audio visual system | |
US7194688B2 (en) | Audiovisual information management system with seasons | |
EP1026887B1 (en) | Audiovisual information management system and method | |
JP4107811B2 (en) | How to use Audio Visual System | |
US20030206710A1 (en) | Audiovisual management system | |
US20010020981A1 (en) | Method of generating synthetic key frame and video browsing system using the same | |
WO2008053132A1 (en) | Program guide search | |
US7509581B1 (en) | Video browser based on character relation | |
GB2455331A (en) | Retrieving media content | |
US20030121040A1 (en) | Audiovisual management system | |
US8606782B2 (en) | Segmentation description scheme for audio-visual content | |
JP2008527836A (en) | Customized broadcast service providing apparatus, customized broadcast service providing method, user terminal apparatus, and computer-readable recording medium | |
Ceccarelli et al. | Home multimedia systems: on personal video libraries | |
US10587931B2 (en) | Apparatus and method for managing a personal channel | |
Barbieri et al. | A personal TV receiver with storage and retrieval capabilities | |
US20200404394A1 (en) | Application Programming Interface Combining Asset Listings | |
EP1085756A2 (en) | Description framework for audiovisual content | |
CA2536514C (en) | Application programming interface combining asset listings | |
Agius et al. | Achieving content-user synergy in MPEG-7 | |
Chadwick | TV Anytime and TV Anywhere | |
EP1580991A2 (en) | Audivisual information management system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SHARP LABORATORIES OF AMERICA, INC., WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:VAN BEEK, PETRUS J.L.;FERMAN, AHMET MUFIT;REEL/FRAME:012780/0169 Effective date: 20020204 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |