US20150205877A1 - Rules driven pan id metadata routing system and network - Google Patents

Rules driven pan id metadata routing system and network Download PDF

Info

Publication number
US20150205877A1
US20150205877A1 US14/577,280 US201414577280A US2015205877A1 US 20150205877 A1 US20150205877 A1 US 20150205877A1 US 201414577280 A US201414577280 A US 201414577280A US 2015205877 A1 US2015205877 A1 US 2015205877A1
Authority
US
United States
Prior art keywords
content
metadata
user
provider
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/577,280
Inventor
Geoffrey B. Rhoads
Tony F. Rodriguez
Kenneth L. Levy
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Digimarc Corp
Original Assignee
Digimarc Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digimarc Corp filed Critical Digimarc Corp
Priority to US14/577,280 priority Critical patent/US20150205877A1/en
Publication of US20150205877A1 publication Critical patent/US20150205877A1/en
Assigned to DIGIMARC CORPORATION reassignment DIGIMARC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: RODRIGUEZ, TONY F., RHOADS, GEOFFREY B., LEVY, KENNETH L.
Priority to US15/208,541 priority patent/US10191996B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/80Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/10Protecting distributed programs or content, e.g. vending or licensing of copyrighted material ; Digital rights management [DRM]
    • G06F17/30876
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/211Schema design and management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/41Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/432Query formulation
    • G06F16/433Query formulation using audio data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/432Query formulation
    • G06F16/434Query formulation using image data, e.g. images, photos, pictures taken by a user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/61Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/683Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/90335Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/9038Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9538Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F17/30026
    • G06F17/30047
    • G06F17/30864
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32267Methods relating to embedding, encoding, decoding, detection or retrieval operations combined with processing of the image
    • H04N1/32283Hashing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2355Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389Multiplex stream processing, e.g. multiplex stream encrypting
    • H04N21/23892Multiplex stream processing, e.g. multiplex stream encrypting involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/251Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/252Processing of multiple end-users' preferences to derive collaborative data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26258Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/535Tracking the activity of the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • H04L67/63Routing a service request depending on the request content or context

Definitions

  • the invention relates to methods and systems for associating content, including both physical and electronic objects, with metadata through networks.
  • Metadata generally refers to information associated with a content object.
  • metadata is often associated with multimedia content, like images, and video and audio programs, and is used to refer to information about the content, such as its source, owner, content title, etc.
  • One of the simpler forms of metadata might be bit-fields describing additional information about a content object such as an author's name or a category that the content object might naturally fall under.
  • More complicated forms of metadata might be ‘pointers’ or addresses (e.g. URLs) of related content objects which, by reference, enable a user or consumer to easily access that second content object.
  • a key concept from a content provider and/or content distributor's point of view is that metadata can form an instant electronic relationship between a consumer experiencing one of their distributed content objects and themselves.
  • Metadata refers to a broad class of information relating to a content object, and it applies to a broad class of content objects, including both physical and electronic objects.
  • Metadata also includes an instruction or set of instructions (possibly distributed over one or more devices) that is executed by machine or machines to perform a behavior associated with an object (e.g., perform an on-line transaction, transmit or transfer content, authenticate/verify a user, content, access token, update/patch a program etc.).
  • Metadata can be formatted and stored in a variety of formats. One format is XML, but there are others.
  • the metadata for a particular content object may be distributed over different storage devices. In such a distributed storage approach, the metadata in one location includes references to metadata in other locations (such an index, pointer, address, URL, etc.).
  • One aspect of the invention relates to the technical infrastructure, including metadata routing and associated network services that ensure this electronic relationship can happen in the first place, and that this relationship can lead toward secondary revenue generation opportunities that may some day rival and eclipse primary media distribution revenue generation.
  • the business of selling packaged media or otherwise delivering specific media to a targeted audience has a long history of monetizing the primary delivery of that media.
  • Selling records or selling 30 seconds of advertising on a television show or selling tickets to a movie each fit into the primary distribution monetization business model.
  • the growth in the Internet and the flowering of various digital distribution channels certainly has complicated the description of primary media distribution itself, but the general notion of “packaging up” a creative work and delivering it for some explicit compensation strategy remains intact.
  • DRM Digital Rights Management
  • the first force is the ease with which creative works can be copied and re-distributed in an unauthorized fashion.
  • the second force is the advent of highly distributed media distribution channels and the equally highly distributed end-devices used to experience a creative work, most certainly including mobile devices. Though these two forces are rather different from each other and though each has been partially transformed into “opportunity” by ever-entrepreneurial efforts and companies, the fact remains that both forces are unstoppably disrupting traditional approaches to the monetization of primary media distribution.
  • content objects are distributed for free or reduced cost and provide a vehicle for advertising revenue.
  • These models provide an opportunity for content owners to monetize content by conveying advertising within the content.
  • One aspect of this invention refers to this notion as the title of this section indicates: managing the fountain of metadata that a consumer wants and will eventually expect.
  • the other side of this coin is classic business principle behind satisfying customers: delivering the highest quality “rewards” in managing this fountain will ensure repeat business.
  • a routing system includes two primary processing engines that are used to link a media object held by a consumer to a source of metadata.
  • the first engine including the ID resolver and registry components, can be described as the lingua franca of identification systems, methods, technologies, etc. It can also be effectively described as a virtual “DNS for Content Objects,” as this identification engine respects any and all native or monolithic approaches to content identification. Hence the qualifier “virtual” in front of DNS. Its function is to resolve a content ID based on identifying information originating from disparate content identification systems.
  • the second engine determines where to re-direct the consumer based on the resolved content ID.
  • This rules engine facilitates secondary revenue generation opportunities because it further enables the system to tailor the metadata response to provide related content, products and services.
  • the content provider universe is complex and often has a wide variety of business interests at play. Such interests are most often encapsulated in contracts between various entities, including the artists which create works in the first place, and such contracts can be extended to the detailed rules of metadata response to normal and/or pro-active metadata requests during media consumption sessions.
  • the quality of the response to the consumer, and the opportunity to direct consumer's to additional revenue generating activities including classic eyeballs/advertising pathways, can be enabled by this rules engine.
  • FIG. 9 shows the first and second engines as being part of a router system, these engines can be partitioned and distributed over devices and controlled by different participants.
  • the rules processor and database may be partitioned from the router system and implemented in separate instantiations, each controlled by a different participant.
  • the resolver re-directs a consumer to a rules engine under the control of a participant linked to the object via the ID registry, and this rules engine, in turn, executes a rule that determines the metadata response for the consumer (e.g., a URL or set of URLs to particular metadata).
  • the rules processor may also be executed, at least in part on a device under the client's control. In this case, for example, a set of URLs linked to the content object via the ID registry are returned to the client, which in turn, executes rules to determine the metadata response tailored to the consumer.
  • Some significant examples include the use of metadata in digital distribution of content, electronic commerce, and on-line searching and organization of vast stores of data (e.g., the Internet).
  • vast stores of data e.g., the Internet.
  • a significant aspect of managing metadata of disparate content objects is providing effective technologies and schemes for content identification. This is important in the digital realm, where there are many potentially conflicting content identification technologies and architectures. It is also important for managing metadata for physical objects in the digital realm, where identifiers extracted or derived from physical objects provide a form of digital identity of the physical object in the digital world.
  • the metadata systems and methods in this document are designed to work with identification systems that operate in the digital realm only, as well as ones that span the digital and physical realms.
  • the latter category includes identification methods that derive content identifiers from an electromagnetic signal captured from an analog representation of audio or images (e.g., a digital watermark, content fingerprint, visual symbology, pattern recognition, voice recognition, OCR, etc.) as well content identifiers read via electromagnetic readers of physical data carrier devices like magnetic stripes (and other magnetic data carriers), RF ID tags, smart cards, etc.
  • content identifiers read via electromagnetic readers of physical data carrier devices like magnetic stripes (and other magnetic data carriers), RF ID tags, smart cards, etc.
  • physical object can be identified via RFID tags, as described at www.epcglobalinc.org and in the overview document (www.epcglobalinc.org/news/FPCglobal_Network_Overview — 10072004.pdf), which is incorporated by reference.
  • Such content identification technology provides a means to identify content objects, but the variety of content identification schemes and formats poses compatibility and interoperability challenges. Moreover, such systems cannot provide useful information without an effective system and method to associate various identifiers with the appropriate metadata.
  • Metadata loss is central to issues surrounding digital content management, piracy and e-commerce. Manual population of multiple distribution channels' metadata repositories gives rise to human error and inaccurate metadata.
  • Channels of distribution e.g., online music retailers, podcasts, social networking sites, user-generated content sites, and P2P networks
  • digital derivatives ring tones, mobile videos, etc.
  • Content is embedded with many identifiers that do not interoperate.
  • a few proprietary systems are linking content to metadata without input of the content owners, thus increasing the number of value chain participants.
  • This document describes systems and methods for associating metadata with content objects. It describes embodiments of novel routing methods and systems referred to as content metadata directory services.
  • One novel method of associating a content object with metadata uses a combination of a content identifier and a bounding identifier to enable handling of disparate sets of content identifiers for content objects with potentially conflicting content identifiers.
  • the method receives a content identifier for a content object from among a set of content identifiers. It provides a unique bounding identifier for the set of content identifiers. This unique bounding identifier is used in combination with the content identifier to form a globally unique identifier for the content object.
  • This globally unique identifier is associated with a metadata source, which enables routing of a user to the metadata source.
  • This approach effectively manages cases where an ID provider pre-assigns a set of content identifiers to objects, and then later registers them in our novel directory system. It also manages cases where the directory system assigns the content identifier prior to insertion of the content identifier in the content object by an ID provider.
  • the unique bounding identifier may comprise an ID provider identifier.
  • ID provider identifier For example, RFID, EPC, digital watermarking and fingerprinting technology providers can serve as ID providers in the system with overlapping content ID numbers, but unique ID provider IDs. Each ID provider may also use an ID version to distinguish different versions of its technology or content ID spaces.
  • the directory system is used to route users to a metadata source.
  • the user e.g., the reader executing on the user's device
  • the directory system routes the user to the metadata source associated with the globally unique identifier for the content object.
  • Metadata Directory Supporting Content Objects with Multiple Content Identifiers
  • Another novel method addresses content objects with two or more content identifiers, potentially referencing different metadata sources.
  • This method registers different globally unique identifiers for a content object. These globally unique identifiers each comprise a content identifier provided with the content object and a bounding identifier identifying a set of content identifiers of which the content identifier is a member. For each of the globally unique identifiers, information is maintained about a metadata source.
  • the method receives a first content identifier for the content object, and uses a bounding identifier associated with the set of the first content identifier to determine the globally unique identifier for the first content identifier.
  • the user is routed to the metadata source associated with globally unique identifier.
  • the metadata directory system supports and manages both the registration of and routing to different metadata sources corresponding to different content identifiers of the content object. These cases include:
  • Content identifiers are embedded or calculated by different ID providers and are later derived from the content object using different readers associated with those technologies. For example, the readers are different because they derive the content identifier using different content identification methods (e.g., through the file header/footer, digital watermark, fingerprint, Vertical Blanking Interval data in video programming, etc).
  • the different readers may, for example, derive the content identifiers using different attributes of the content object. These different attributes may comprise different types of embedded auxiliary data (different watermark embedders/readers, watermark vs. embedded header/footer data). These different attributes may comprise attributes from which different digital watermarks or robust hashes are derived. The different attributes may correspond to in band and out of band attributes of the content object. “In band” refers to an identifier derived from content in the content object that is rendered for perception by a human. “Out of band” refers to auxiliary data carried in the content object but not forming part of the content that is rendered for perception by a human.
  • Certain types of content objects include multiple content programs rendered for perception by a human, like video and audio tracks and close captioned text.
  • band identifiers may be derived from one or more of these content signals within the content object.
  • one content program may be embedded in another content program within a single content object, such as where close captioned text is embedded in the audio or video program of an audiovisual work.
  • the different content identifiers for a content object may be derived from the content object using different parts of the content object, including different in band and out of band parts as well as different parts within the in band portion of the object and different parts within the out of band portion. These parts may be in discrete locations in one domain of the content signal, yet at overlapping locations in others. Examples of domains include spatial, temporal and transform domains (e.g., frequency domain, compressed domain, etc.) of the content signal in a content object).
  • the system owner serving as a registration authority (RA)
  • RA registration authority
  • the ID Provider registers with a metadata directory system, receives a unique bounding identifier, and uses this bounding ID (e.g., an ID provider ID) with subsequent interactions with the metadata directory system.
  • metadata source providers register metadata sources with the metadata directory system. This enables many different participants to associate content objects with metadata sources using one or more identify providers. Examples of metadata source providers include content providers, like content owners or retailers that have the flexibility of working with different ID providers to associate content objects with metadata. Both content providers and ID providers can register and use the system.
  • the metadata source is the system or device that provides the metadata, like a web site.
  • the directory system uses an identifier for the metadata source, which enables it to maintain an association between a content object and its corresponding metadata source. For example, in some embodiments, a URL serves to identify the location of the source.
  • CMDS One embodiment of the directory system is referred to as CMDS.
  • CMDS enables content providers to utilize the CMDS to knit together metadata sources that are associated with content using disparate and previously incompatible ID provider technologies.
  • CMDS enables content providers to manage their proprietary information (i.e. they do not have to turn over control of proprietary metadata to a RA for storing and distributing the metadata), enables eCommerce for all value chain participants (e.g., both content owners and retailers can embed CIDs), facilitates interoperability with all content identity provider technology (even pre-existing ID systems, such as EPC), allows for compatibility with both PC and mobile devices, facilitates interoperability for multiple ID providers who license a common identification algorithm, and enables usage reporting and vital marketing statistics.
  • FIG. 1 is a flow diagram illustrating a method of associating a content object with a metadata source.
  • FIG. 2 is a flow diagram illustrating interaction between a reader and a directory system to link a content object with a metadata source.
  • FIG. 3 is a system diagram illustrating a metadata directory system and its interaction with ID providers for registration of content IDs and readers for resolution of content IDs.
  • FIG. 4 is a system diagram illustrating an overview of a content identification and routing system.
  • FIG. 5 is a diagram demonstrating a usage model of using the routing system to direct a user to content providers based on content identifiers extracted from the user's content object.
  • FIG. 6 is a diagram illustrating an implementation of a router in more detail.
  • FIG. 7 is a diagram illustrating a distributed router system in one implementation of a directory system.
  • FIG. 8 is a diagram illustrating an example of a directory system architecture along with different content owner participants using the system to associate content identifiers with metadata sources they control.
  • FIG. 9 is a diagram illustrating a routing system including a rules processor and traffic monitor.
  • FIG. 1 is a flow diagram illustrating a method of associating a content object with a metadata source. This diagram is intended to show how a content metadata directory system performs registration of content IDs, which achieves two objectives:
  • the directory system receives content IDs. These content IDs either originate from pre-existing sets (e.g., pre-assigned by an ID provider), or directory system itself issues content IDs for an ID provider upon request.
  • the ID provider refers to an entity that provides content identification for content objects. Typically, this is a content identification technology provider, such as a provider technology for computing in band (e.g., watermarking or fingerprinting) or out of band identifiers (DRM container technologies, VBI inserters, etc.) for content objects.
  • a content identification technology provider such as a provider technology for computing in band (e.g., watermarking or fingerprinting) or out of band identifiers (DRM container technologies, VBI inserters, etc.) for content objects.
  • the directory system provides a unique bounding identifier (BI) as shown in block 102 for each unique set of content IDs registered in the directory. It ensures that BI's for different sets of content IDs do not collide. Thus, while it is possible to register pre-existing BI's that do not collide, it is preferable for the directory system to issue the BI's or at least issue guidelines for their use to prevent collisions.
  • BI unique bounding identifier
  • the directory system forms globally unique identifier (GUI) for all content objects that it manages by combining the content ID for an object with the BI for the set of content IDs of which the content ID in question is a member (block 104 ).
  • GUI globally unique identifier
  • the directory system associates the GUI for a content object with a metadata source as shown in block 106 .
  • this metadata source provides metadata in response to a request from an entity that supplies the content ID for a content object.
  • the directory system stores the association between the GUI of a content object and the metadata source in a manner that enables fast, efficient routing of the requesting entity to the metadata source.
  • the directory system stores a location of the metadata source on a network, such as a URL. This enables the requesting entity to connect to the metadata source and retrieve metadata associated with the content object.
  • Several metadata sources may be associated with a GUI and returned to a requesting entity.
  • FIG. 2 is a flow diagram illustrating interaction between a reader and a directory system to link a content object with a source of metadata.
  • the reader extracts a content identifier from a content object. It then forwards the content ID to the directory system and either implicitly or explicitly identifies the BI for the set of content IDs in which the extracted content ID is a member ( 112 ).
  • An example of explicitly identifying the BI is where the reader supplies a unique provider identifier assigned to it, along with a version identifier.
  • the version identifier may be used to enable the provider of the identification technology to create different content ID sets, which enables flexibility with different versions and upgrades of the ID provider's technology.
  • Some examples include different versions of a particular RFID, bar code, digital watermarking, fingerprinting or DRM technology for different customers, applications or content object groupings.
  • An example of implicitly identifying the BI is where the directory system determines the identity of the provider based on some inherent attribute of the data provided by the reader, such as its format, data type, etc.
  • the directory system forms the GUI using the received content ID from the reader and the BI ( 114 ).
  • the precise manner of formation may vary.
  • One approach is to concatenate the content ID and BI in some fashion (e.g., appending them together to create one GUI).
  • Another approach is to hash one or more parts of the content ID and BI and combine these parts to create one GUI.
  • one or more third parties may be involved in the process of supplying the content ID and BI parts of the GUI.
  • a fingerprinting database may supply the content ID and the BI associated with it.
  • each ID is located in a separate field in the database, and only entries that match all ID fields are used to register or resolve the GUI.
  • the directory system maps the content ID and BI into a naming, numbering or address space which provides a GUI for each content object.
  • the directory system looks up the metadata source or sources associated with GUI ( 116 ) and returns some identification of the source to the reader.
  • One form of source identification is its URL, but other forms of identification are possible as well. Examples include a pointer, address, index to a database of metadata, machine instruction for accessing the source.
  • the approach of returning an identification or location of the source to the reader enables the reader to establish a direct connection with the source to get the metadata.
  • the directory system can instruct the source to establish a connection with the reader by providing the reader's address.
  • the directory system may also act as an intermediary between the reader (or location specified by the user of the reader), on the one hand, and the metadata source on the other. This approach can be used where the directory, or some other intermediary in communication with it, is used to provide additional processing of the metadata before supplying it to the requesting entity at a location of the requesting entity's choosing.
  • FIG. 3 is a system diagram illustrating a metadata directory system and its interaction with ID providers for registration of content IDs and readers for resolution of content IDs.
  • different ID provider systems 200 , 202 establish sets of content IDs corresponding to content objects.
  • the ID provider systems may pre-assign sets of content IDs to objects and then register with the directory system 204 them via the directory system's registration interface 206 . Or, they may request the directory system 204 issue content IDs via the registration interface 206 .
  • the directory system includes and/or communicates with a database 208 that stores the association of the GUI 210 for each content object and its corresponding metadata source ID 212 .
  • FIG. 3 shows a generalization of the association of a GUI to a corresponding metadata source.
  • This database can be structured with one or more layers of indirection in which aspects of the GUI are used to index into different handlers and/or databases segmented by provider, version, location, etc.
  • FIG. 3 illustrates the point that different ID providers (e.g., providers A and B) or different versions of a single provider's technology (Versions A and B) can register multiple sets of content IDs with the directory system. Moreover, multiple content IDs from different sets may be associated with the same content object 214 .
  • ID provider A and ID provider B distribute readers A and B ( 216 , 218 ), respectively. These readers may be programs, devices, or a combination thereof (including components of a device or distributed over different devices, such as in a web services type implementation).
  • content object 214 includes CID 1 of set A ( 220 ) and CID 1 of set B ( 222 ).
  • a single program or device such as a media player program or device may include both readers A and B and present a common graphical user interface to the user. Alternatively, the readers may be separate components or programs executing within the user's device or network domain.
  • the readers 216 , 218 When the readers 216 , 218 encounter the object, such as upon file open/copy/transfer/edit command, entry into a device, network gateway or filter, they extract the content ID and forward it (along with the implicit or explicit BI data) to the directory system's resolution interface 224 .
  • the resolution interface looks up the metadata source ID or IDs if there are multiple sources (e.g., a URL or set of URLs) and returns them to the respective readers (or some program or device designated by the readers or pre-registered with the directory system).
  • the readers 216 , 218 then use the metadata source IDs to establish connections with the respective metadata source provider systems 230 , 232 and get the metadata associated with the content object 214 from these different sources.
  • these sources may be web content files on web servers located at the location returned by the directory system. These sources may be maintained or controlled by different participants in the content distribution value chain, such as content owners, retailers, catalog companies, product manufactures, service providers, etc.
  • One source of metadata may be the content owner, which provides web content affiliated with the content owner, and another source of metadata may be the content retailer, which provides web content affiliated with the retailer (e.g., such as eCommerce opportunities to buy related entertainment content or merchandise).
  • FIGS. 4-8 are briefly summarized here, are further illustrated with examples in connection with a system called CMDS.
  • FIG. 4 is a system diagram illustrating an overview of a content identification and routing system.
  • FIG. 5 is a diagram demonstrating a usage model of using the routing system to direct a user to content providers based on content identifiers extracted from the user's content object.
  • FIG. 6 is a diagram illustrating an implementation of a router in more detail.
  • FIG. 7 is a diagram illustrating a distributed router system in one implementation of a directory system.
  • FIG. 8 is a diagram illustrating an example of a directory system architecture along with different content owner participants using the system to associate content identifiers with metadata sources they control.
  • out of band content identification for content objects
  • examples of out of band content identification for content objects include identification based on auxiliary data in file headers and footers, Vertical Blanking Interval (VBI) inserted data, DRM container schemes for identifying content signals in the container, etc.
  • VBI Vertical Blanking Interval
  • One method for in-band content identification is to carry a content identifier in a digital watermark embedded in the perceptual portion of a content object that is rendered for display or playback to a human.
  • the digital watermark is hidden or “steganographically embedded” in the content by modifying the content to include an auxiliary signal that conveys auxiliary data (e.g., a message “payload”), such as the content identifier.
  • Digital watermarking is a process for modifying physical or electronic media to embed a hidden machine-readable code into the media.
  • the media may be modified such that the embedded code is imperceptible or nearly imperceptible to the user, yet may be detected through an automated detection process.
  • digital watermarking is applied to media signals such as images, audio signals, and video signals.
  • media signals such as images, audio signals, and video signals.
  • it may also be applied to other types of media objects, including documents (e.g., through line, word or character shifting), software, multi-dimensional graphics models, and surface textures of objects.
  • Digital watermarking systems typically have two primary components: an encoder that embeds the watermark in a host media signal, and a decoder that detects and reads the embedded watermark from a signal suspected of containing a watermark (a suspect signal).
  • the encoder embeds a watermark by subtly altering the host media signal.
  • the reading component analyzes a suspect signal to detect whether a watermark is present. In applications where the watermark encodes information, the reader extracts this information from the detected watermark.
  • Another method of in-band content identification is a hash of the content data, which is sometimes referred to as a content “fingerprint.”
  • a hash is sometimes used in which the hash is derived from features of the content that are expected to survive in tact through distortion in the delivery channel, like clipping, time or geometric changes, compression, transmission, etc.
  • these features include a vector of frequency domain values (e.g., e.g., robust low and mid frequencies), perceptually important features (including temporal, spatial or frequency domain features), content statistics, feature values quantized into discrete bins, all of which are not necessarily mutually exclusive, and which are generally characterized in that they are not degraded by expected distortion in the channel (e.g., compression, transmission, D to A, and A to D conversion).
  • robust fingerprinting methods allow some change in the content signal, yet the fingerprint computed from that distorted signal still maps to the same identifier. In other words, expected degradation does not change the signal so substantially that it maps to a different fingerprint in the database or no fingerprint at all. For consistency, we refer to these methods as fingerprinting, which generate content fingerprints.
  • This fingerprinting approach to content identification has the advantage that the auxiliary data embedding process is unnecessary. Instead, the reader process can generate the identifier from the content object without prior explicit modification of the content object to include auxiliary identifying data.
  • a potential disadvantage is that copies of the same content program (e.g., the same musical track, song, movie) have the same fingerprint, which requires use of additional means to differentiate different copies of the same content program.
  • the advantage of not requiring auxiliary embedding is also mitigated by the fact that the fingerprint needs to be registered and kept in a fingerprint database to enable matching of a computed fingerprint with registered fingerprints. Once a match is found, the database provides the content identifier for the matching fingerprint. This potentially adds additional processing and network communication to produce the content identifier.
  • fingerprint methods as including three components, a calculator, a reader and a fingerprint database.
  • the calculator does the following: (1) creates the fingerprint using the same (or similar, where changes are based upon known or estimated distortion) algorithm as the reader, (2) registers the fingerprint in the fingerprint database, and (3) links the fingerprint to a content identifier.
  • the fingerprint may be one value or a set of sub-fingerprints taken from portions of content throughout some or all of the content. When sub-fingerprints are used, each sub-fingerprint or set of sub-fingerprints links to the same content identifier.
  • the reader computes a fingerprint (e.g., set of sub-fingerprints), sends them to a fingerprint database, and receives the content identifier.
  • the fingerprint algorithm utilizes the perceptual content signal.
  • the fingerprint is a numerical construct (e.g., an array of values) derived from a content signal that serves as a statistically unique identifier of that signal, meaning that there is a high probability that the fingerprint was derived from the content signal in question rather than a different one that sounds or looks similar.
  • One component of fingerprint algorithm is a form of hash algorithm.
  • the hash algorithm may be applied to a selected portion of a content signal (e.g., the first 10 seconds) to create a fingerprint, or may be applied repeatedly to generate a sequence of robust hashes, where a specified sub-set of this sequence can identify content. For example, the sequence may use sub-fingerprints from every 1/16 second of a song, and require 32 sub-fingerprints (i.e. any 2 seconds of audio) to identify the audio. In addition, 3 seconds can be used to improve accuracy.
  • the directory system and method are applicable to both electronic and physical content objects (as well as objects that pass to and from analog and digital domains).
  • the network methods for communicating and routing a device (such as computer or wireless phone handset) having a content object to another having metadata relating to the content object apply to different types of networks, including computer networks like the Internet, and wireless telephone networks. Examples of mobile device applications, such as linking from an object to its metadata via a cell phone handset, are described below.
  • the router can be implemented in the cell phone network, the Internet, or spanning both the cell phone and Internet, such as when mirror routers reside in the cell phone network, the Internet or both the cell phone and Internet network. Different types of URLs such as WAP, WMI and “full” may be used as metadata source identifiers maintained in the directory system.
  • a content metadata directory system enables those having control over a content object to associate a metadata response with the content.
  • One example of a rule in the directory system is data or instructions specifying the URL or list of URLs to return in response to a metadata request specifying a particular content ID.
  • more complex rules are needed to support metadata responses tailored to a particular context, such as user attributes (e.g., user preferences, security, account information and status, location, etc.) or transaction attributes.
  • FIG. 9 is a block diagram illustrating a router system and its relationship with a consumer and content distribution participants.
  • the consumer there are at least three entities represented: the consumer, the router service provider(s) and content distribution participants.
  • FIG. 9 shows a configuration in which the components of the router system are distributed across these participants.
  • the components comprise devices and/or software modules and examples of these are provided throughout this document.
  • One set of components are referred to as part of the consumer domain 900 .
  • These are components that the consumer control's such as his or her devices and embedded software in these devices (such as wireless phone, home network, PC, home entertainment system devices, etc.).
  • router system 902 Another set are referred to as the router system 902 . These are components involved in routing from content identification and related context to a metadata response, as well as related network services, such as metadata traffic monitoring and response aggregators.
  • a final set are referred to as the content distribution participants 904 . These are the participants that provide content objects, manage their distribution, and supply and/or control metadata content distribution.
  • the content distribution participants 904 include, but are not limited to, content owners 906 and content distributors 908 . These owners include not only traditional providers of entertainment content, but also those that provide content, including advertising, used to market other products and services. These participants register their content objects 910 with the router system 902 and distribute them to consumers 912 . Through a registration component 914 , the participants 904 register their content objects in the routing system as described in the various embodiments in this document. In particular, they provide content identifiers and associated rules for providing responses to metadata requests for these identifiers. These content identifiers and rules are stored in an ID registry database 914 and rule database 918 , respectively. These databases may be integrated in one database or implemented in separate databases with a key or like identifier (e.g., unique identifier) that associates a content object with a corresponding rule governing the metadata response.
  • a key or like identifier e.g., unique identifier
  • the router system enables consumers to request a metadata response wherever the content object travels in its distribution chain as long as the consumer has a reader to extract a content identifier and associated modules for packaging and sending a metadata request to the router system.
  • FIG. 9 illustrates the metadata request as an “ID labeled request” from the consumer domain.
  • the “consumer domain” in this context is not intended to be limited to only retail users of content. Rather, it includes virtually any user of the router system whether they represent content owners or distributors seeking to access metadata for their content, purchasers/licensees of the content, or customers that receive and consumer content for entertainment, information or commerce. In fact, rules help facilitate different levels of access among the various types of consumers of the router system.
  • the router system includes an ID resolver 920 , which receives the ID labeled request and determines an ID for the content object based on the content ID and associated identification system information supplied by the requesting device.
  • the discussion for mapping content identifiers and provider identifiers into a unique identifier for a content object is one example of such a process. This approach of unifying content identification schemes enables the routing system to serve as a form of lingua franca for content identification, stitching together disparate content naming schemes.
  • the content ID may have one or more metadata responses registered for it.
  • a rules processor 922 executes rules associated with the content object (e.g., via the content ID) to determine the metadata response based on information supplied in the request, information about the requesting user (including the user's device capabilities, connectivity, etc.), and/or information retained in the routing system, such as transaction data for the content object or the class from which it the content object originates (class defined by content genre, by affinity group of consumers for the content genre, etc.).
  • the routing system may also provide additional services.
  • the router system of FIG. 9 includes a traffic monitor 924 , which logs usage statistics and generates usage reports. An embodiment of this usage monitoring and reporting is described with reference to CMDS implementations below.
  • the rules processor can also execute rules based on a content object's dynamic metadata.
  • Dynamic metadata refers to metadata that change over time.
  • One example of such dynamic metadata is a content object's usage data.
  • a rule governing the metadata response can be made dependent on the usage data. For example, if the number of requests for metadata exceed a threshold, the metadata response is adapted accordingly. For example, more metadata data including information about related content and commerce opportunities are provided as the interest level in a particular object increases over time.
  • the response can be tailored based on user information derived from metadata requesters so that the response is tailored to the common attributes of the class of users requesting metadata for the object. Patterns of common attributes of users, content or the content metadata emerge as usage data is tracked over time.
  • the routing system adds additional links to related content objects and products and services to an affinity group for a content object or class of object.
  • the affinity group can be defined, for example, as a group with common preferences or interests in content objects.
  • the routing system can also act as a metadata repository and aggregator of metadata responses.
  • FIG. 9 includes a response aggregator 926 , which provides metadata responses and stores metadata for content objects in support of this function.
  • the routing system simply re-directs the metadata request to the content owner/distributor, which in turn, provides metadata to the requesting consumer.
  • CMDS complementary metal-oxide-semiconductor
  • Another approach is to act as a proxy server for the content owner's metadata repository.
  • the routing system determines the metadata source's URL based on ID resolution and rule execution (if rules exist) and issues a metadata request to the metadata repository at this URL. If multiple URLs are involved, it makes a query to each one.
  • the routing services aggregate the metadata responses from the metadata repositories and returns the aggregated metadata to the requesting consumer.
  • Another approach is where the routing system forwards the metadata request from a consumer to the URL of a metadata repository, which in turn, responds with metadata directly to the requesting consumer.
  • the content owner/distributor controls the metadata response in some cases as shown in block 930 , where as the routing system controls the response in the other case.
  • the routing service acts as a metadata repository.
  • the routing system identifies the URL of the metadata repository within its control, packages the metadata response with the response aggregator and returns the metadata to the requesting consumer.
  • the capability of serving as a metadata repository enables the routing system to provide additional network services.
  • One such service is to enable users the ability to collaborate in the creation of metadata for content objects by posting recommendations, preferences, and other related information about content objects in the metadata repository. This adds an added dimension to affinity groups identified and managed by the routing system. In particular, it enables members of these groups to be active contributors to the metadata for the content objects that they are most interested in.
  • One approach to supporting multiple different rules for a content object is to enable one or more participants that control the object to register different content IDs associated with that object in the ID registry, each having an associated URL or set of URLs in the registry database.
  • each content ID references a URL for the respective participant (e.g., content owner, distributor, retailer, each providing different metadata sources at the corresponding URLs in the database).
  • This approach may lead to further rules being implemented in the router system and/or client program executing in the consumer's device.
  • the process begins with a client reader program or programs on the consumer's device extracting multiple CIDs from the content object and forwarding them to the router system.
  • the router system looks up the corresponding URL or URL list for each CID.
  • the router executes a rule governing which CID or CIDs have priority and returns a subset of the URLs associated with the CIDs with priority.
  • the router refrains from prioritizing the requests and returns all URLs associated with each content ID to a client reader program in the consumer's device.
  • the client program either displays a web page with hyperlinks to each URL, or it executes rules to select which URL or set of URLs has priority, and then re-directs (e.g., sends a metadata request) to the URL with the highest priority.
  • a single CID may be associated with metadata responses from several different participants (search engine provider, metadata aggregator, distributor like iTunes, Record Label, advertiser, etc.).
  • the registrant of the CID specifies the URL or URL list corresponding to each of the metadata responses for that CID.
  • the registrant specifies a rule governing the conditions in which the different metadata responses are triggered.
  • the registration process is facilitated by a graphical user interface accessible via a network, such as a web interface enabling the registrant to list for each metadata response:
  • the conditions are a function of the attributes of the routing transaction. These attributes fall into two categories: user attributes and non-user attributes.
  • the user attributes are obtained by the router through the user registration process, in data provided in the metadata request, and/or in data derived by the router based on history of requests from the user.
  • the user can specify metadata preferences through registration or in the metadata request. Preferences can include likes/dislikes about content genres, likes/dislikes for product/service advertising, preferences in content format, preferences for types of media players and media player settings, device capabilities, etc.
  • Non-user attributes include attributes about the transaction derived by the system, such as the time, geographic territory, history of transactions relating to the content object or content objects in the same genre as the content object, type of object, etc.
  • the router's usage data provides information about the popularity of the content object, correlation to the preferences of others who have requested metadata for the object, etc.
  • the reader packages information about the object along with the extracted content ID, such as the object type and format. This enables the metadata response to be tailored to the object type and format that the user has the capability to render on his or her device.
  • Rule processors can be implemented within and executed within one or more different locations along the metadata request and response paths. Before enumerating these locations, let's review a summary of the locations in a CMDS embodiment.
  • the first location is the requesting client, which is within the consumer domain shown in FIG. 9 .
  • the next is the router system, which itself, has different components that can contribute to rule processing.
  • FIG. 9 shows the rule processor as a single block, yet the rules processing function may be distributed.
  • the next location along the path is either back to the requesting client, or to metadata source to which the request has been re-directed by the router.
  • the rules processor executes a rule or rules to control:
  • a client program used to consume or manage content is equipped with a reader for one or a few types of content IDs. This client controls what IDs get sent to the router and thus, controls which entities are linked to.
  • the router sends all URLs for metadata sources associated with corresponding CIDs back to the client and the client decides which one to use.
  • the client may also determine what type of context data it provides to the metadata source, such as GPS information, depending on whether the user wants to get or has paid for location based services.
  • user preferences can be maintained solely at the client.
  • the client maintains control over whether and when the user preferences and attributes are forwarded to the router and/or metadata source/repository. In some cases, they are not provided at all, and the client aggregates and then tailors the metadata response from multiple URLs based on user preferences. In other cases, the client forwards the preferences to the metadata source directly after receiving its URL to the router. In this case, the router does not get access to the user preferences.
  • the router determines based on context or other information from the client how to re-direct the client to a metadata source located at a URL.
  • the metadata source at the URL sends different types of metadata or links to a requesting client, which enables the client to pick or the user to pick from among metadata/links presented in a user interface of the client.
  • the metadata responses may be prioritized based on user preferences.
  • the client is programmed to get or learn user preferences and prioritizes links to metadata returned by the system accordingly.
  • the router system provides additional services for managing users, including, for example, authenticating users and managing user accounts. This can be explicit management of information supplied by the user, or management of user transactions based on consent provided by the user. In either case, the router derives a user classification based on information it has gathered about the user's preferences for consuming content. In one embodiment, the router system classifies routing transactions based on the user's willingness to pay for products and services. Those willing to pay for premium content get a metadata response with opportunities to access this premium content, while those not willing to pay get no fee metadata responses that are subsidized by advertising, for example.
  • the router re-directs the user to URLs that are secure electronic commerce sites, initialized based on the user's identity. This enables the routing system to link the user directly to electronic transactions without requiring the metadata source to handle the authentication processing.
  • One particular example of the authentication service in the router is to enable direct linking into a Digital Rights Management (DRM) server or other e-commerce server, in a state where the client is pre-authenticated.
  • DRM Digital Rights Management
  • the client and router provide authentication information needed to complete an electronic purchase through private and/or encrypted data fields, or a combination of public and private fields, where private only readable by certain entities.
  • Another service of the router is track the flow of content object sharing over networks.
  • Digital certificates, or other identifying information of users is used to detect different users that request metadata for a particular content object, which is uniquely identified via content identifier.
  • This tracking of content object flow by content ID and user certificates provides data to the content owner regarding how content objects flow through networks of users.
  • This provides another means to identify an affinity group for content and tailor content and metadata distribution to the preferences of the affinity group.
  • This tracing method traces content objects as they are processed by new and different users.
  • the router logs the request and also records user identification for the request, if available. The router analyzes this log to identify the path of the content object through new users.
  • the router enables metadata responses to be governed by a hierarchy of rules distributed across the system, including macro rules implemented in the router that specify URLs to return, and micro rules implemented in the client that further control how the client presents and links to these URLs.
  • micro rules include: rules governing how authentication of a user occurs to enable access to different type of metadata sources, (e.g., use of identity triangle—what user knows—password, has—access token, ID card, and is: biometric login and user verification).
  • the level of authentication dictates the nature of the metadata provided (what links, metadata, etc. are provided).
  • the level of authentication also dictates purchase limits and usage rights (rights for redistribution or sharing with other users).
  • An additional service of the router system is the support for handling private and public fields in the data packets sent as metadata requests to the router.
  • the client device in the consumer domain sends public and private fields (public field is generally readable, private field is packaged by client and likely encrypted, intended to be read only by authorized service, such as secure transaction server that the router links to).
  • the router uses the public field, for example, as data input for rules determining the URLs for the metadata responses.
  • the metadata sources decrypt and use the data in the private fields to provide tailored information to the user, while keeping the user's information private and secure.
  • the rules in some systems also govern the amount of network resources allocated for a metadata transaction.
  • the size of the socket, data pipe or channel opened between the metadata source and the client is a function of client's authentication level and user account status (e.g., indicating willingness and ability to pay).
  • rules are pushed to client through content auxiliary channels in the content objects (such as file header/footer, encryption container, digital watermark, etc.)
  • rules are distributed with media consumption programs, such as media players, like Windows Media from Microsoft Corporation and iTunes from Apple Computer, etc.
  • Each component executes its own set of rules established based on what it has learned about the user.
  • the input to the rules includes user and non-user attributes, including, but not limited to user demographics, device platform, age, geography (GPS), time, search engine metrics that prioritize results for content searches based on the user's search history, which indicates preferences for types of content.
  • user demographics including, but not limited to user demographics, device platform, age, geography (GPS), time, search engine metrics that prioritize results for content searches based on the user's search history, which indicates preferences for types of content.
  • GPS geography
  • search engine metrics that prioritize results for content searches based on the user's search history, which indicates preferences for types of content.
  • the input to the rules includes preferences derived from user behavior, content consumption history, most frequently accessed content, etc.
  • Another input includes content type, which enables the content to be targeted at content type preferences of the user or the user's rendering equipment.
  • the rules specify different metadata responses based on whether the client device is operating in on line or off line mode. Offline mode instructs the client to re-direct a metadata request to a metadata source in its cache of metadata, which serves as a local metadata repository.
  • the router system provides a number of opportunities for revenue generating data services.
  • One such service is revenue sharing model in which fees collected for distributing metadata are shared with content owners as a function of usage data.
  • the router tracks usage data corresponding to metadata requests for content objects and the usage data for these content objects is used to determine revenue sharing among content owners and distributors.
  • the router tracks usage data and this usage data is used to determine how artists that created the content get a share of fee collected under a license in which collected fees distributed to the artists based on metrics dependent on the distribution of metadata requests for the content objects.
  • Additional models of revenue sharing are fee based, where a portion of the fees paid by consumers for metadata responses are distributed to the content owners.
  • Another service of the router is an auditing function.
  • One such audit is checking the validity of URLs supplied to it during registration.
  • the router periodically checks URLs in its database to make sure they are current, valid, responsive, etc.
  • the router also provides metadata request trend analysis that enables the metadata sources to anticipate metadata request work load and allocate more resources to serve metadata based on the anticipated workload.
  • the router itself is distributed and has instances of itself that are mirrored across the network.
  • the router specifies to the clients which among several URLs to use for subsequent request for routing services.
  • Another service of the router is to track the form of content identification used to identify the content object for each transaction. This enables the router to flag content for subsequent content labeling, including layers of different content IDs. For example, a content object identified using a fingerprint is flagged for embedding a digital watermark. The digital watermark provides a finer grain identification than the fingerprint by differentiating among copies of the same content. The content ID in the watermark is then registered and associated with metadata responses that are tailored to a particular copy of the content object.
  • the routing system has the flexibility to incorporate its own metadata repository for user created metadata, to link to user generated metadata repositories maintained by others, and to integrate a combination of both types of metadata sources.
  • the routing system has the flexibility to integrate different metadata sources into one unified metadata service. For example, the routing system maintains links between the identifier (or identifiers) for a piece of content (e.g., song, TV or radio program, movie, Podcast, advertisement, etc.) and sources of metadata, including user generated metadata within or outside the routing system's domain.
  • the database stores the unique identifier of the piece of content and associated URLs of the user generated metadata for that piece of content.
  • the routing system can specifically link to the user generated metadata maintained in different user generated metadata sites on the Internet. Examples of web sites that have implemented systems for user generated metadata include Flickr and Del.icio.us, which provide web services operated by Yahoo. These systems enable users to apply metadata, called “tags,” to pieces of content.
  • Flickr allows users to upload images and add tags to images within the context of the Fickr system.
  • the tags are not persistently linked to content, and therefore, as content moves outside the bounds of the Flickr system (e.g., the Flickr servers or connected client device), the tags are easily lost.
  • the routing system provides a means for persistently maintaining links between a content object and its metadata, even as the object is distributed across different domains, devices and networks. Further, it allows a content object to be persistently linked to several different user generated metadata sites.
  • the system fulfills a more sophisticated array of metadata requests across a broad array of metadata sources.
  • Each piece of content becomes its own node or portal interconnected with disparate sources of metadata across heterogeneous distribution methods, networks, content formats, and devices.
  • rules processing in the system filters metadata according to user preferences.
  • ⁇ олователи will prefer user-community generated metadata over the original metadata from the content owner or distributor.
  • An example is user generated metadata that assigns content ratings to content for parental control.
  • a user may trust the content rating applied by the trusted community of which he or she is a member over the rating applied by an industry group.
  • the user can take advantage of the metadata associated with the content in that domain.
  • the routing system supports this re-association and enforcement of user preferences by allowing the user to request metadata with the user's rules that specify that, in certain contexts, the content rating in the metadata from the user group is to be used instead of the industry content rating.
  • a typical usage scenario of the system to apply ratings is as follows: user encounters an content (in any of a myriad of ways: e.g., receives from a friend, downloads from a social networking site, records from a live broadcast, searches an archive); the user's device includes an application that incorporates the reader, which extracts a content ID from the content (or alternatively, the user selects the content, which triggers transmission of it to a remote reader that does the same); the reader forwards the content ID along with user preferences to the routing system, the routing system extracts the related metadata from linked sites specified by the associated URLs, the routing system applies the rules applicable to the content, including those based on user preferences, and sends back a metadata response to the user that informs the user of the rating and/or the reader automatically enforces the rating by controlling play out of the content.
  • Metadata sources can be dynamic metadata sources based on dynamically generated metadata from searches, RSS feeds, and mash-ups.
  • the URLs identify more than just IP addresses of physical devices, and extend to dynamic metadata sources in virtual environments such as Second Life (URL in protocol for Second Life adheres to SLTP protocol).
  • federated identity is an identity management framework that enables the user to access disparate data services, each with their unique secure log in procedures, with a single log in.
  • embodiments of the routing system leverage federated identify technologies, such as SAML and WS-Trust, to establish and enforce user identity for users of the routing system, including both providers and consumers of metadata.
  • the disparity of content identification and metadata protocols creates a similar demand for a scheme of federated content identity.
  • the routing system satisfies demand by creating a framework that unifies disparate content identification technologies (such as digital watermarking, content fingerprinting, headers in files whether un-encrypted or part of an encryption container) as well as incompatible protocols for content identifiers. Further, it unifies disparate sources of metadata, as well as different metadata formats. In short, it provides cross-platform content identity and metadata services.
  • the routing system establishes an interoperable system for associating content with metadata across disparate content identification and metadata systems. In so doing, it also provides a mechanism for monitoring consumption of content and metadata across disparate domains of content origin and consumption.
  • the support for user generated metadata further enables new sources of metadata which users will likely value as much or more than the content itself. This is particularly true for a system that analyzes metadata usage and content usage and makes information available as additional metadata linked to the content because it facilitates the user's ability to search for content that is of particular interest to him.
  • One of the must compelling types of metadata is the metadata that identifies content by its popularity within certain groups (e.g., popularity as defined by tastemakers, affinity groups, niche genres for content, etc.).
  • an interface that efficiently unlocks this value by establishing programmatic access to the metadata and metadata statistics.
  • programmatic interfaces are provided for that particular system.
  • an embodiment of the routing system described in this document provides a programmatic interface across heterogeneous content identification technologies and metadata sources, and further, provides a programmatic interface to the metadata usage data that is collected across these heterogeneous metadata sources and linked back to individual content items through a variety of content identification technologies.
  • Examples of programmable interface technology that the routing system leverages include mash-ups built on Web 2.0, Programmable web, and semantic web programming constructs and Application Programming Interfaces (APIs).
  • the implementer can use these technologies to build the metadata response aggregator, traffic monitor, and rule processor detailed above, as well as to build their own versions of these modules on top of the routing system.
  • the system can be embodied in a hierarchy of mash-ups, each providing additional functionality on top of the APIs of other mash-ups of metadata services provided by the system.
  • the routing system by providing a mechanism of linking metadata sources to content identifiers, creates a Content Object Name Service (think of it as a Domain Name Service for content items).
  • the response aggregator, rule process or and traffic monitor build on top of this service can each be implemented as mash-ups of the routing system.
  • the routing system provides a form of DNS for content metadata mash-ups.
  • the tracking of content and metadata consumption in the system and subsequent publishing of this data to the user community enables user's to more effectively identify metadata that matches there preferences. It also provides an opportunity for content owners to analyze these preferences and re-package content with popular user generated metadata. Content owners can also identify unique affinity groups and tailor new releases to the preferences of these groups.
  • the system tracks several forms of usage data. These types of usage data include monitoring traffic of content objects (e.g., tracking object distribution), traffic of metadata requests (e.g., number of requests for particular metadata, or metadata from a particular source), and user preferences and rules processing (e.g., user preferences derived from metadata analysis, such as the affinity group analysis).
  • the system identifies high value metadata which provides an opportunity for content object owners and advertisers to package this popular metadata and monetize it (sell it or sell advertising presented with its consumption by users).
  • the system also is able to capture a historical archive of metadata generation and consumption data, which further allows content and metadata distribution to be analyzed to identify transient metadata captured from points in time to be packaged and monetized in a similar fashion.
  • dynamic metadata can be packaged with the content objects that caused its generation and distributed. Examples in include content packaged by tastes of an affinity group of users, a period of time, a geographic market, etc.
  • CMDS Content Metadata Directory Services
  • the CMDS system provides all existing value chain participants an environment to agree upon metadata usage and manage their proprietary metadata, as opposed to being another proprietary metadata repository. It also provides cross-sell/up-sell e-commerce opportunities.
  • the CMDS system is interoperable with all content identifiers, PC and mobile devices, and enables usage reporting with vital marketing statistics.
  • CMDS standardizes three components (1) Registration Interface, (2) Resolution Interface and (3) Router Requirements.
  • the interfaces are specified in terms of XML-based Web Services, an existing industry standard, for simplicity and interoperability.
  • the router requirements guarantee that the system functions properly and maximizes value to vendors and users.
  • These minimal specs create a system that is simple for vendors and users to interact with, while providing extremely flexible workflow and architecture.
  • CMDS can either (1) create unique content identifiers (CIDs) that can be embedded with any technology, such as digital watermarks (DWM) or signed headers, or (2) utilize CIDs created by pre-existing systems such as content fingerprints (a.k.a. robust hashes), Electronic Product Codes (EPC), IFPI's Grid, and URI.
  • DWM digital watermarks
  • EPC Electronic Product Codes
  • IFPI's Grid IFPI's Grid
  • URI Resource identifiers
  • the CMDS system provides users with valuable information and simple purchase options, and helps content owners and retailers increase ROI by expanding their knowledge of content usage and making it easier for consumers to buy content and related items.
  • Central Database A global, master Database (where Database defined below).
  • Central Handler A global, master Handler (where Handler is defined below).
  • Central Router A global, master Router (where Router is defined below).
  • Content ID A unique content identifier. It is different for different pieces of content, and can be unique for different copies of the same content. The combination of the CID with ID Provider ID and ID Version is globally unique.
  • Content Metadata A system for Content Providers to register Content IDs and URLs, and Users to Directory Services resolve Content IDs into URLs to obtain more information about the content (CMDS) where the Content Providers manage their proprietary metadata.
  • Content Provider The provider of the content, such as the content owner and retailer, or any company with rights to distribute content and/or content metadata.
  • Database The second component of a Router which is used to store the Content Provider's links to their proprietary metadata, and store vendors' or users' contact information. Note: Often the term is used in the plural because it can refer to several linked databases.
  • Digital Watermark Data embedded within the content that does not degrade the content's quality (DWM) to end-users, but is reliably detectable by enabled hardware or software.
  • EPC Electronic Product Code as specified by EPCGlobal.
  • Fingerprint A fingerprint identifies content from features of the content. It is also known as a robust hash or content based identification (and should not be confused with a forensic DWM).
  • Handler The first component of a Router which handles the registration or resolution requests and responses. Note: Often the term is used in the plural because it can refer to several linked handlers.
  • ID Provider The company that provides the technology to identify the content and interface with a Router.
  • ID Provider ID The unique ID assigned to the ID Provider. An ID rather than name is used so that the combination of ID Provider ID, ID Version and CID is a globally unique number (when the CID is a number, such as when created by this system), and numbers are faster to lookup in a Database.
  • ID Version provides the version of the CID algorithm. It enables the ID Provider to re-use the same IDs in different version of their algorithms, such as for different content types, as well as to use various ID formats.
  • the ID Version is different for each algorithm that uses overlapping CIDs for an ID Provider.
  • Mirror Database An exact duplicate of the Central Database.
  • Mirror Handler An exact duplicate of the Central Handler.
  • Mirror Router An exact duplicate of the Central Router.
  • Resolution Request The interface defining the message sent to a Router to request URLs (or other Message information). Resolution The interface defining the message sent from a Router in response to a Response Message resolution request. Registration The manager of the CMDS system.
  • the Registration Authority is a trusted 3 rd party vendor. There is one public Registration Authority.
  • the Registration Authority is usually the private system provider. There may be numerous private Registration Authorities.
  • Registration The interface defining the message sent to a Router to request registration of Request Message CIDs, URLs, vendors or users.
  • Registration The interface defining the message sent from a Router in response to a Response Message registration request.
  • Request Code A key part of the registration or resolution request message that describes the desired action for the message.
  • Router The backend system that handles registration and resolution. It includes two main components, a Handler and Database. Note: Often the term is used in the plural because it can refer to several linked routers.
  • User The end user of the system. For example, it may be a consumer linking to more information via their PC Multimedia jukebox, or a movie critic linking to current marketing materials via a closed, private system.
  • CMDS Content Metadata Directory Services
  • CMDS provides a global trusted metadata directory service that connects consumers of identified content with authenticated “origin of source” databases and other content-provider authorized digital resources.
  • CMDS enables content owners to:
  • CMDS also provides consumers metadata and e-commerce opportunities
  • a content identification system has five main components: registration, embedding/calculating, reading, resolution, and a router, as shown in FIG. 4 . These components can be grouped into content identification and content routing (e.g., CMDS) categories.
  • the content identification components include embedding content identification (or calculating it for fingerprinting) and reading content identification (a.k.a. detection).
  • the content owner usually handles the embedding and the consumer product usually handles the reading.
  • the CMDS components include:
  • the example implementation is also optimized for both technologies, such as DWM, where the fewer bits in the identifier the better, and for technologies, such as URI, which have non-integer namespaces.
  • the example implementation has the flexibility to be optimized for a PC or mobile environment (or any future hybrid environment).
  • the content is labeled Protected and Identified Content since it is identified when distributed due to this process, and may also be protected by other means.
  • the identification may also be used for protecting the content and/or other technology may be used to protect the content.
  • the identification is used to both enhance and protect the content, there are mutual benefits, such as pirated content that doesn't have the identification does not provide the enhance features to the user. In other words, this implementation is not a replacement for content protection, but synergistic with it.
  • a Registration Authority handles these three content routing components.
  • the Registration Authority is a trusted 3 rd party vendor.
  • the Registration Authority is usually the private system provider (and usually the only ID Provider).
  • This system's design allows the Content Providers (including content owners, such as Record Labels, Movie Studio and Stock Photo Agencies, and retailers, such as Apple iTunes, Napster, WalMart, Hollywood Video, etc.) to interact directly with the user, such as a consumer, as shown in FIG. 5 .
  • This enables the Content Providers to manage their own proprietary data.
  • the usage model is the user interacts with a router, which redirects the user to the Content Provider for metadata and e-commerce opportunities.
  • the system routes requests for metadata to Content Providers, such as content owners and retailers.
  • the Router includes a Database that mainly contains CIDs and URLs that link to metadata and e-commerce opportunities, which are stored by the Content Provider, not at the Router.
  • the system has a distributed architecture, as shown in FIG. 7 .
  • the Central Router labeled Mirror Routers
  • These Routers can have separate Registration and Resolution Routers. There will most likely be more Resolution Routers since there will be more resolution requests. In the future, Cached Routers will interact with the Mirror Resolution Routers and only save recent resolution requests for efficient responses. Cached Routers are not applicable to registration requests since these requests occur neither often nor repetitively and are immediately forwarded to the Central Router.
  • the example implementation requires the reader to periodically request the address of the Router that it should be utilizing for registration and resolution; thus, the system can dynamically change configuration. It is unnecessary for the Central Router and Mirror Routers to request addresses, as they are all run by the Registration Authority and, thus, know each other's addresses.
  • a Router consists of a Handler and Database.
  • a Handler accepts the registration and resolution requests, quickly obtains the required information and sends the registration and resolution responses. It may be a single software thread running on the same machine as the database, such as for a local low-quantity implementation, or it may quickly hand-off requests by request code or ID Provider (as both fields are in the XML message header) to various request handlers that are linked to a local request Databases across multiple CPUs, as shown in FIG. 6 .
  • Table 1 An exemplar workflow demonstrating content owners and retailer registering contact information and content, and consumers linking to metadata and purchasing content is shown in Table 1.
  • the example assumes that the ID Provider and two Content Providers, a content owner and retailer, have received their respective identification and passwords from the Registration Authority. It also assumes that ID Providers have registered contact information (via UpdateIDProvider request code), and distributed embedder and reader software. The request codes are shown in italics between the arrows for messages sent to the router.
  • Consumer A listens to his PC Jukebox and clicks on the “more info” button based upon the URI in the audio content ⁇ ResURLs ⁇ 16.
  • Router provides consumer with URLs from content owner and retailer, some of which create dynamic web pages ⁇ 16(a). Consumer A learns more about the content and later purchases a CD by the same artist at the store. 17. Consumer B decides to register to win a hybrid car ⁇ RegUser ⁇ 18. Consumer B is notified of success ⁇ 19.
  • Consumer B uses cell phone to learn more about a film via taking a picture of an ad and reading a DWM ⁇ ResURLs ⁇ 20. Router forwards URLs to consumer B's cell phone. Since the user is registered, the URLs includes lists of local theatres playing the movie and favorite local stores selling the DVD ⁇ 20(a). The consumer buys the DVD from a local store!
  • the architecture is flexible since the specification defines an extensible messaging interface and router design.
  • FIG. 8 An example architecture which enables both content owners and retailers to use the system is shown in FIG. 8 . Many other architectures or expansion of this architecture are possible, but this architecture is expected to be the most used architecture. This architecture enables the workflow discussed in the previous section, as well as many other workflows.
  • the architecture includes:
  • This usage scenario includes most aspects of registrations for ID Providers, Content Providers, e.g. content owners and retailers, and Users, as well as Users, e.g. consumers, linking to metadata and eCommerce. It demonstrates several key aspects of the system, and is most similar to the workflow example in Table 1.
  • the first step is registration of at least one ID provider.
  • the ID provider receives an ID and password from the Registration Authority via a secured process, such as a mailed letter or telephone call and company and contact person security check.
  • the ID provider securely registers their contact information with the registration authority, either through the Registration Authority's software (via UpdateIDProvider) or through an interactive secure web page.
  • the ID Provider is notified of success or any errors.
  • the ID Provider embedder and detector software contains the ID Provider ID, and submits it, along with an ID Version of the embedding or detection algorithm, with every request.
  • the second step is registration of a content owner.
  • the content owner receives a Content Provider name and password from the Registration Authority via a secured process, such as a mailed letter or telephone call and company and contact person security check.
  • the content owner uses their embedder or related software received from the ID Provider to securely register contact information (via UpdateContentProvider).
  • the embedder software verifies the response, and notifies the content owner of success or any errors.
  • the content provider could have used the Registration authorities secure web site to interactively register their contact information.
  • the Content Owner Once the Content Owner has registered, they securely register their content. First, they use the embedder or related software to obtain a unique Content ID (via Create CID). Afterwards, the Content Provider registers two primary URLs, one for PCs and one for mobile devices (via URLType XML tag with Full or WAP data entry), as well as four additional URLs, two for PC and two for mobile, (via six calls with RegURL request code). For example, for both PCs and mobile devices, the primary URL provide static information about the movie Fantasia from Disney, one additional URL provides information about songs in Fantasia, and the other additional URL provides items for sale regarding Fantasia from Amazon.com, using a dynamic web page via a URL including search terms based upon the CID. The software application verifies the response for success and let the content owner know about the success (or any errors).
  • the content owner could enter multiple URLs in the software's GUI with checkboxes for fully functional or WAP.
  • the software uses the request grouping method to obtain the CID (via CreateCID), register the primary URLs (via two calls with RegURL), and additional URLs (via two calls with RegURLs).
  • the Routers handle the timing such that the CID is registered before the URLs.
  • the content owner can use the Registration authorities secure web site, and interactively register the URLs, one-by-one.
  • Retailer Registers as Content Provider and Registers Content
  • a retailer assuming they have worked out rights with the content owner, can also securely register as a Content Provider with the Registration Authority, obtain a Content Provider name and password, and register contact information (via UpdateContentProvider).
  • the retailer could be Apple iTunes store. Then, when the retailer prepares to sell content, they request a CID (via CreateCID) and add two URLs, one primary URL to sell songs by the same artist (via RegURL), and one additional URL to sell similar songs (via RegURLs).
  • the multimedia player includes a reader plug-in that always scans for CIDs, checks that URLs are registered for this CID, and displays a symbol or “more info by ⁇ company name>” icon to let the user know that the content is enhanced. This scanning process also makes the response time immediate since CID detection has already been performed.
  • the user When the user selects to receive more information, the user receives five web links with brief descriptions. There are three links from the content owner: one with the film history, one with related song information, one with items for sale regarding Fantasia from Amazon.com. There are two links from the retailer whom sold them the movie: one where they can buy songs by the same artist, and one where they can purchase similar content. The user can click on the links to visit the displayed web sites.
  • the reader software requests the URLs (via ResURLs) with a group containing two requests, one for the content owner's CID and one for the retailer's CID.
  • the reader software parsed the returned URLs and displayed them to the user.
  • the user will see two different “more info” buttons, e.g. one “more info from Disney” and one “more info from Apple iTunes Store” and the depending upon the user's selection, the corresponding request is sent and response is displayed.
  • a cell phone user When a cell phone user identifies content, he/she links to the WAP or WMI version of the registered URLs, assuming the Content Provider registered such URL types (via XML Tag URLType with WAP or WMI data during registration or resolution). Information, formatted for their small screen, is displayed.
  • the user can select the display of only a primary link (for content owner or retailer) so that the Content Provider's information is displayed immediately after selecting to receive more information (without the user having to select again from a list of URLs and descriptions since they may be driving).
  • the cell phone user when they hears a song that they like on the radio, they can identify the song (via a DWM or fingerprint) and link to more information. Similarly, the mobile user can identify songs they are listening to on their PDA phone and link to more information.
  • Another user decides to register personal information to obtain a chance to win a new hybrid car. They register from the reader plug-in for their multimedia player (via RegUser). The software application verifies the response for success and lets the user know about the success (or any errors). The user can update their information at any time (via Update User), or decide to opt-out for one specific link or all future links.
  • the same five links as displayed for the anonymous user are displayed, as well as links to additional theatres in the user's zip code that are playing Fantasia or similar movies, as well as stores in the user's zip code that carry the related merchandise.
  • the Content Provider e.g. content owner or retailer
  • the Content Provider e.g. content owner or retailer logs onto the Registration authorities web page and securely views usage data for each of their registered CIDs. They see that their new movie is hot in the northeast part of the USA and Canada, especially by 8-to-10 year olds around 7 PM EST. They also see that its usage has been starting to decline, and represents 20% of their current resolution usage for this age group, indicating that it is time to release a new movie with this target audience. Finally, they can see their costs and billing options, such as automatic withdrawal at fixed amounts or monthly billing.
  • the ID Provider can also log onto the same web site and view aggregate usage data for all of the CIDs registered using their technology. However, they cannot view stats by individual CIDs since that is owned by the Content Provider.
  • each Router is saving log files for each hit, and, preferably, daily processing the log files to aggregate usage data to provide real-time interaction with these stats, as well as automatic capabilities to email reports to the Content Provider and ID Provider.
  • the fingerprint is calculated from the content and entered into a database. Then, when trying to identify content, the fingerprint is calculated, and matched to the closest fingerprint in the database that also falls within a certain threshold of certainty.
  • the fingerprint is usually a collection of sub-fingerprints, especially when content is streaming. As such, the fingerprint is not a unique content ID, but the fingerprint database links the fingerprint (i.e. collection of sub-fingerprints) to a unique content ID.
  • the Content Provider can either (i) utilize the fingerprint provider's proprietary content ID system and register pre-existing CIDs with a Router (via RegCID), or (ii) request a unique CID (via CreateCID) and use it in the fingerprint database. Then, the Content Provider can register URLs to link to the CID (via RegURL and RegURLs).
  • CID uniqueness is guaranteed since the fingerprint database guarantees the CID is unique in that database, and the combination of the CID with ID Provider ID and ID Version guarantee global uniqueness.
  • the CID is guaranteed to be unique by the Central Router, and the same combination is globally unique.
  • the ID Version is uniquely defined for each fingerprint algorithm and related database for each ID Provider.
  • the user selects to receive more information as with any CID and receives URLs and short descriptions (via ResURLs). The user then clicks on the URL with the information that he/she wants to receive.
  • the fingerprint reader calculates the fingerprint, sends it to the fingerprint server (either running on the fingerprint provider's server or on the Central Router), the fingerprint server determines the CID from the fingerprint database, returns the CID to the reader, and the reader uses the CID to request the URLs (via ResURLs) from the Router.
  • the Router having access to the IDProviderID, ID Version and CID data in the resolution request message, uses this globally unique combination to lookup the correct URLs.
  • the proper ID Version is known by the reader since it used that version of the algorithm to determine the CID.
  • a different Registration Authority will have previously provided a unique identity, possibly for other purposes, and it is optimal to be able to use this unique content ID in this system.
  • EPC Electronic Product Code
  • RFIDs radiofrequency identifiers
  • IFPI's GRid provides unique content IDs.
  • 4C provides unique IDs with Verance's DWM.
  • an ID Provider could generate their own unique ID, such as using the “album:artist:song” combination from ID3 tags.
  • EPC format also known as general identifier (GID-96) is:
  • CMDS As the goal of CMDS is to link users' to information managed by content owners and identified by multiple ID technology providers, whereas the goal of EPCNet involves tracking items through the distribution process for each participant, the backend structures are different. Thus, these two networks can work synergistically, such as with the EPCNet IS having an interface to a CMDS Router.
  • EPC such as a film poster ad containing an RFID with EPC GID-96 format, is described below.
  • the first step is that the Content Provider registers the pre-existing CID (via RegCID). Then, the Content Provider registers a primary Full URL (viaRegURL), and, if desired, they can register additional URLs (via RegURL or RegURLs) or URLs for mobile formats.
  • the Content Provider registers the pre-existing CID (via RegCID). Then, the Content Provider registers a primary Full URL (viaRegURL), and, if desired, they can register additional URLs (via RegURL or RegURLs) or URLs for mobile formats.
  • the CID namespace is guaranteed to be unique for each ID Provider and their current ID Version (e.g. algorithm version), and the CID format is decimal.
  • the ID Version via IDVersion XML tag is used to determine the proper CID namespace.
  • a CID representing a GID-96 EPC code has the hex format of HH.MMMMMMM.PPPPPP.SSSSSSSSS where H is header (8 bits), M is Manufacture (28 bits or 268 million unique IDs), P is Product SKU (24 bits or 16 million unique IDs) and S is Serial Number (36 bits or 68 billion unique IDs).
  • the ID Provider has an ID Version for the EPC GID-96 format, and different ID Versions for other EPC formats or other CID formats (e.g. DWM).
  • the embedder registers an EPC GID-96 format CID, it sends the corresponding ID Version.
  • the reader software detects the pre-existing CID, sends it to the router (via ResURL), receives URLs and displays them to the user.
  • the router having access to the IDProviderID, ID Version and CID data, uses this globally unique combination to lookup the correct URLs.
  • the proper ID Version is known by the reader since it needs to use that version of the algorithm to detect the CID.
  • Each ID Provider's embedder embeds their ID Provider ID along with the CID that is requested and embedded by the Content Provider (via CreateCID).
  • the reader software When the reader software reads a CID, it also reads the embedding ID Provider ID. If the embedding ID Provider ID is different than that stored in the reader, it is included in the URL resolution request message (via the EmbIDProviderID XML field). The Router logs the embedding ID Provider's ID for any further action, such as being properly compensated for the embedding process.
  • the companion specification provides valuable information to consumers, and enables a distributed routing architecture such that Content Providers manage their proprietary data and interaction with the consumer.
  • Content Providers can include content owners, such as Record Labels, Movie Studio, stock photo agencies, etc., and retailers, such as Apple iTunes, Walmart (clicks-and-mortar), catalog companies, advertisers, Netflicks, etc.
  • the specification enables Content Providers to use any identity provider technology to link users to the proper information.
  • every router can seamlessly interoperate and track usage for proper payments.
  • the system enables multiple CIDs to exist in content such that the complete value chain (e.g. content owners and retailers) can participate, or create business rules for participation.
  • the specification is optimized for all identification technologies and existing systems, including digital watermarks (DWM), fingerprints (a.k.a. robust hashes), Electronic Product Codes (EPC), IFPI's Grid, and URI.
  • DWM digital watermarks
  • EPC Electronic Product Codes
  • IFPI's Grid IFPI's Grid
  • URI Identities in Resource Identities
  • the specification includes logging, not only for security tracing, but also for usage report that help ID Providers understand router demands and Content Providers understand content usage.
  • the specification can easily be expanded to handle usage cases around seeding multiple ID systems and providing “buy now” functionality for non-legitimate content.
  • the specification should help content owners and retailers (thus distributors) increase sales (t ROI) by expanding the knowledge of content usage and making it easier for consumers to buy content and related items.
  • the following example implementation uses industry standard XML-based Web Service to provide an open interface to the Routers.
  • CMDS implementation The main components of the specification of this example CMDS implementation include:
  • the registration and resolution request messages use XML and include:
  • the response messages are simpler.
  • the registration response message is simple, requiring no header or body sub-sections, and the resolution response message only includes primary and secondary information sub-sections.
  • Content Providers Providers of the content, such as the content owner and retailer, or any company with rights to distribute content and/or content metadata.
  • content owners can include Record Labels, Movie Studio, and Stock Photo Agencies.
  • Retailers can include Apple iTunes, Wal-Mart (click-and-mortar), advertisers, catalog companies, and Napster.
  • the end users of the system may be a consumer linking to more information via their PC Multimedia jukebox, or a movie critic linking to current marketing materials via a closed, private system.
  • this example implementation is based upon a unique content identifier, labeled a CID. It is critical that CIDs are unique for each ID Provider ID and ID Version. CIDs can overlap for different ID Provider IDs or different ID Versions. ID Provider IDs are different for each ID Provider, and an ID Provider could register multiple ID Provider IDs, if determined as needed by the Registration Authority.
  • the ID Version is the version of the technology/algorithm that embeds and reads the CID.
  • the ID Version is always known by the embedder and reader since they determine which algorithm to embed or read the CID.
  • the ID Provider can have CIDs that overlap when they have different ID Versions, and uses different ID Version when CIDs can overlap.
  • a video may have the same CID as a song, or one song embedded by ID Provider 1 may have the same CID as a different song embedded by ID Provider 2 (or by ID Provider 1 using a new ID Version).
  • CIDs are not globally unique unless combined with these other variables.
  • the combination created by appending IDProviderID, IDVersion and CID together e.g. appending ⁇ IDProviderID> ⁇ IDVersion> ⁇ CID>
  • appending ⁇ IDProviderID> ⁇ IDVersion> ⁇ CID> is a globally unique ID, usually a number.
  • the globally unique combination can be represented as a URI, formatted as “CMDS:// ⁇ IDProviderID>. ⁇ IDVersion>. ⁇ CID>”.
  • the CID is an integer, and it is most efficient for transport and backend/router processing to use an integer field.
  • a text field is required, and the router can process the text into a unique content identifier.
  • the CID format is determined by ID Version data, and properly handled by a Router.
  • two XML schemas will be present for these requests, one for an integer CID and one for a text CID. If possible, it is optimal to use the integer format.
  • databases can be indexed by all three identifiers (IDProviderID, IDVersion and CID) as separate variables or databases, or one database can use this triplet ID as a globally unique index when the CID is integer format.
  • the registration process enables the content provider to obtain unique CIDs and link the CID to URLs. It also enables the ID Provider, Content Provider, and User to register contact information.
  • the registration works from both (i) an interactive human-readable web interface and (ii) a web services interface that interacts directly with registration software, such as a CID embedder (or multimedia plug-in for user registration) that runs on the vendor's or user's computer.
  • registration software such as a CID embedder (or multimedia plug-in for user registration) that runs on the vendor's or user's computer.
  • the client web and software interface uses a secure authenticated channel with the Router. This protection is required so that no one but the proper vendor can change the registration data.
  • Content Providers and ID Providers initially register with the Registration Authority via a process that verifies them and the contact person to be a trusted provider. During this process, the Content Provider is assigned a unique vendor-name and password, and the ID Provider is assigned a unique numeric ID and password.
  • ID Providers are assigned a unique number rather than name for the following reasons: it is quicker for a Router to lookup a number, the ID Provider's software remembers the number (so the human readability is not important for remembering the unique identification), and the globally unique combination of IDProviderID, IDVersion, and CID is a number.
  • Content Providers and ID Providers can update their contact information via their embedder software or directly with Registration authorities interactive web site.
  • This particular system is an opt-in system, with capabilities to opt-out.
  • the Registration Request Message is the interface that defines the message sent to a Router for data registration.
  • the Registration Request Message interface includes an XML Header and Body. Examples are shown below, and the format is described below.
  • Registration request messages choose one root elements from several options, include: ⁇ RegistrationCIDRequest> for CreateCID and RegCID request codes; ⁇ RegistrationURLRequest> for RegURL, DelURL, RegURLs, and DelURLs request codes; and ⁇ RegistrationContactInfoRequest> for UpdateContentProvider, UpdateIDProvider, RegUser and UpdateUser request codes.
  • ⁇ RegistrationCIDRequest> for CreateCID and RegCID request codes
  • ⁇ RegistrationURLRequest> for RegURL, DelURL, RegURLs, and DelURLs request codes
  • ⁇ RegistrationContactInfoRequest> for UpdateContentProvider, UpdateIDProvider, RegUser and UpdateUser request codes.
  • There are sub-elements including: ⁇ Header> for message headers, ⁇ Body> for message body, and ⁇ PrimaryInfo> and ⁇ SecondaryInfo> when needed. Grouping of registration requests is allowed (and it is expected to be specified when the transmission method, e
  • the XML header is:
  • XML Tag Format Description Status Version Integer The version of this request message.
  • the current version Required is 1.
  • IDProviderID Integer Identity technology provider number as stored in the Required product (e.g. software) interacting with a Router.
  • IDs 0-511 are reserved (as described below).
  • RequestCode Text Requests a Router to take a specified action.
  • the allowable Request Codes for registration include:
  • the Resolution Message XML Body includes the following information.
  • the XML body has primary information, which includes CID related variables, for the registration request, and secondary information which includes optional descriptive data for the CID.
  • the primary request information is:
  • XML Tag Format Description Status ContentProviderName Text Content Provider Required name. Password Text Content Provider Required password.
  • IDVersion Integer The version of the CID Required algorithm.
  • CID Integer The unique content ID Required for or Text formatted as integer RegCID (preferable) or text, as determined by the ID Version.
  • CIDExpiration Date Expiration date for Optional CID so it can be reused. Use with caution (as described below) Private Binary Binary Binary data that can Optional be used by the ID Provider for any private reason.
  • the secondary request information is:
  • Optional Copyright Text Copyright dates.
  • Optional ContentType Text Content type choices include: audio—music, audio—speech, Optional video videotrack, video—audiotrack, image, and text.
  • Optional ArtistEmail Text Artists email address
  • Optional ArtistURL Text ID Provider Content Provider or User Artist web page.
  • the XML body information is:
  • XML Tag Format Description Status ContentProviderName Text Content provider name. Required Password Text Content provider password.
  • Required IDVersion Integer The ID version provides the version of the Required CID algorithm.
  • CID Integer The unique content ID formatted as Required or Text integer (preferable) or text, according to the IDVersion.
  • URLType Text The URL Type, such as for a WAP Required enabled cell phone or fully functional PC (more details below).
  • URL Text The URL that links the content to more Required information.
  • URLVariables Text A list of XML tags, separated by a colon Optional “:”, that define the XML fields which are appended at the end of the URL or the term ALL for all of the request tags (more details below).
  • URLActivation Date Date to activate the URL. If no date is set, Optional the URL is activated, and remains active unless it has expired.
  • URLExpiration Date Date to de-activate URL. If no date is Optional present, the URL has no expiration, and is active, unless it has not yet been activated.
  • Desc Text Brief description of URL, less than 128 Required, characters with spaces except for DelURL and DelURLs Private Binary Binary Binary data that can be used by the ID Optional Provider for any private reason.
  • URLs are categorized into Primary and Additional URLs, where there can be one Primary URL for each URL Type and as many additional URLs as desired. This categorization allows immediate redirection for the user, as well as choice of all associated URLs (i.e. additional actions) for the user.
  • Primary URLs enable the system to automatically display the primary web site for the user, thus not requiring the user to click on the desired URL after selecting to receive more information. There is a balance, since while reducing the number of required clicks, Primary URLs also reducing the choices and retail opportunities.
  • the XML body information is:
  • XML Tag Format Description Status RegName Text Content Provider Name, Username, or ID Required Provider ID.
  • the ID Provider ID is converted to an integer inside the router's handler.
  • Password Text ID Provider, Content Provider or User Required password BizName Text Company's full name Required, except for RegUser and UpdateUser BizEmail Text Company's email address Optional BizAddress1 Text Company's street address, first line Required, except for RegUser and UpdateUser BizAddress2 Text Company's street address, second line Optional BizCity Text Company's city Required, except with RegUser and UpdateUser BizState Text Company's state Required, except with RegUser and UpdateUser BizZip Text Company's zip Required, except with RegUser and UpdateUser BizCountry Text Company's country Required, except with RegUser and UpdateUser BizPhone Text Company's phone number Optional BizURL Text ID Provider, Content Provider or User Option
  • BizLogoURL Text ID Provider or Content Provider company Optional logo BizTemplateURL Text ID Provider or Content Provider company Optional template.
  • NameTitle Text Contact's name title e.g. Mr., Ms., etc.
  • Optional NameFirst Text Contact's first name Required NameMiddle Text Contact's middle name or initial Optional NameLast Text Contact's last name Required NameSuffix Text Contact's name suffix e.g.
  • the Registration Response Message is the interface that defines the message sent from a Router in response to data registration.
  • the Registration Response interface includes a success code, URL and brief description of the URL, or error code and associated URL and description, as well as private data. Examples are shown below, and the format is described below.
  • All registration response messages have one root element of ⁇ RegistrationResponse> (and ⁇ /RegistrationResponse>), and no sub-elements. Grouping of registration requests is allowed (and it is expected to be specified when the transmission method, e.g. SOAP, is finalized).
  • the registration response message XML format for all requests is:
  • XML Tag Format Description Status Version Integer The version of this request message. The current version Required is 1. RtnCode Integer Return code where “0” means success and any positive Required number as an error code. For this version, the only valid error code is “1”.
  • the message returns a “0” for success in the RtnCode field and the CID in the Desc field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • the message For the request for registering CIDs from other system ID (RegCID): the message returns a “0” for success in the RtnCode field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • the message For the request to register or delete a URL (RegURL, DelURL, RegURLs, and DelURLs): the message returns a “0” for success in the RtnCode field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • the message returns a “0” for success in the RtnCode field and RegName (e.g. ContentProviderName, IDProviderID, or UserName) in the Desc field for optional verification—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • RegName e.g. ContentProviderName, IDProviderID, or UserName
  • the Content Provider is notified of the success or error.
  • the error text and URL shall be displayed.
  • the resolution architecture connects the readers to a Router such that content identification can be used to provide users with interesting related data and purchasing opportunities.
  • the resolution interface employs a web services interface.
  • the web services interface uses a secure authenticated channel with the Router for ResRegAddress and ResResAddress. This protection is required to eliminate spoofing of the Router.
  • the Resolution Request Message is the interface that defines the message sent to a Router for data lookup.
  • the Resolution Request Message interface includes an XML Header and Body. Examples are shown and the format is described below.
  • Resolution request messages choose one of two root elements: ⁇ ResolutionURLRequest> for ResURL and ResURLs request codes; and ⁇ ResolutionAddressRequest> for ResRegAddress and ResResAddress request codes.
  • ⁇ ResolutionURLRequest> for ResURL and ResURLs request codes
  • ⁇ ResolutionAddressRequest> for ResRegAddress and ResResAddress request codes.
  • the XML header is the same as for a registration request. This header data can help the router quickly distribute the message to various request handlers for the detailed actions to be handled.
  • the allowable Request Codes for resolution include:
  • ResURLs Resolve the primary and additional URLs
  • Res2ndInfo Resolve the secondary information
  • ResRegAddress Resolve the address of the Registration Router for registration requests
  • ResResAddress Resolve the address of the Resolution Router for resolution requests
  • the Resolution Message XML Body includes the following information.
  • the message includes primary and secondary information.
  • the Primary Information portion contains the data required to properly service the request.
  • the Secondary Information contains user-specific data and is intended for user specific links and aggregate usage monitoring and reporting.
  • the user permits the secondary information to be sent.
  • the primary request information includes:
  • XML Tag Format Description Status Timestamp Time Time stamp of triggering event. Used to a Required id in management of “stale” requests that have timed out. Format is Coordinated Universal Time (e.g. 2005-04- 14T13:20:00Z) EmbIDProviderID Integer The ID Provider ID that embedded the Required if different CID, if different than that of the reader than IDProviderID, software ID Provider ID otherwise blank IDVersion Integer The ID version provides the version of the Required CID algorithm. CID Integer The unique content ID formatted as Required or Text integer (preferable) or text, as defined by the IDVersion. URLType Text The URL Type, such as for a WAP Required, except for enabled cell phone or fully functional PC.
  • Res2ndInfo Response2ndInfo Boolean TRUE if secondary response information Required, ignored is requested, and FALSE if not. (It is not for Res2ndInfo signaling that secondary request information is included in this request). Private Binary Binary data that can be used by the ID Optional Provider for any private reason.
  • the secondary request information includes:
  • XML Tag Format Description Status ReaderID Integer A unique ID that identifies the reader application per Optional purchase or installation. (More details below) Transaction ID Integer A unique ID that identifies the transaction for the reader.
  • OS Text Operating system including Windows, WinCE, Mac, Optional Symbian, J2ME, BREW, PALM OS, Microsoft Smartphone/Pocket PC OSVersion Text Request OS for version from OS and send in same format Optional GPS Text GPS coordinates of requesting device, if available Optional Username Text Identification of the user and links to data that the user has Optional registered sLanguage Text User's preferred spoken language.
  • Optional sSex Text User's Sex M or Male, or F or Female
  • Optional sZip Text User's postal code
  • Optional sCountry Text User's Country Optional
  • the message includes:
  • XML Tag Format Description Status Timestamp Time Time stamp of triggering event. Used to aid in management of Required “stale” requests that have timed out. Format is Coordinated Universal Time (e.g. 2005-04-14T13:20:00Z) ReaderIP Text IP address of the embedder or reader. Utilized to determine Required the correct registration and resolution Router addresses with which to interface.
  • the Resolution Response Message is the interface that defines the message from a Router in response to data lookup.
  • the Resolution Response interface has primary information, which includes a success code, URL and brief description of the URL, or error code and associated text, and has secondary information which provides content-specific metadata. Examples are shown below, and the format is described below.
  • All resolution response messages have one root element: ⁇ ResolutionResponse> (and ⁇ /ResolutionResponse>), and sub-elements of ⁇ PrimaryInfo> and ⁇ SecondaryInfo>.
  • Grouping of resolution requests is allowed (and it is expected to be specified when the transmission method, e.g. SOAP, is finalized). Grouping is useful when the ID Provider reader can read multiple CIDs embedded in the content (e.g. one CID from a content owner and one CID from a retailer).
  • the XML primary response information for all requests is:
  • XML Tag Format Description Status Version Integer The version of this request message. Required The current version is 1. RtnCode Integer Return code where “0” means Required success and any positive number as an error code. For this version, the only valid error code is “1”.
  • URL Text URL or list of URLs separated by Required for successful semicolons “;” resolution requests, Optional otherwise Desc Text Brief description of URL or error, or Required, except for list of descriptions of URLs, with Res2ndInfo and each description or error text having ResRegAddress and 128 characters or less including ResResAddress spaces, and separated by semicolons “;”. BizLogoURL Text Content Provider's URL for their Optional, except for company logo.
  • ResURL, ResURLs, and Res2ndInfo if registered by the Content Provider BizTemplateURL Text Content Provider's URL for their Optional, except for desired display template.
  • ResURL, ResURLs, and Res2ndInfo if registered by the Content Provider Private Binary Binary data that can be used by the Optional ID Provider for any private reason.
  • the XML secondary response information for all requests is required for Res2ndInfo request codes or when the Response2ndInfo flag is set:
  • Required for 2ndInfo request AdultFlag Boolean “1” for adult content, and “0” Required for for all other content 2ndInfo request ContentType Text Content type choices include: Required for audio—music, audio—speech, 2ndInfo request video—video track, video—audio track, image and text.
  • This secondary information comes from a combination of data included when registering a CID and when registering a Content Provider. Although the fields are required for Res2ndInfo or when the Response2ndInfo flag is set, many of the fields are optional when registering and, thus, may not be returned (or be returned blank) even when requested.
  • the secondary information enables the user to view basic artist information, such as may be desirable for photos from a stock agency, and content provider information, which is probably desirable for all content.
  • the message returns a “0” for success in the RtnCode field, the primary URL in the URL field, the brief description of the URL in the Desc field, and the secondary information if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • the Primary URL has been registered with the Primary flag set, and matches the requested ID Provider ID, ID Version, CID and URL Type.
  • the message returns a “0” for success in the RtnCode field, the list of all URLs with the primary URL listed first, separated by semicolons “;” in the URL field, the list of brief descriptions of the URLs, separated by semicolons “;” in the Desc field, and the secondary information if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • the URLs all match the requested ID Provider ID, ID Version, CID and URL Type. For each URL Type, there is only one primary URL and it is listed first.
  • the secondary information does not have multiple items in each field since it is linked to the CID and not to the URLs. In other words, the secondary info does not change with URLs, only CIDs.
  • Res2ndInfo For the request of secondary information (Res2ndInfo): the message returns a “0” for success in the RtnCode field, and the secondary information in the corresponding fields—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • the message For the request of the Router address (ResRegAddress and ResResAddress): the message returns a “0” for success in the RtnCode field, the local Routers' web or IP address in the URL field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • the reader software launches a web browser with the primary URL, such that the primary web page is “immediately” displayed for the user. This always happens with ResURL, and may happen with ResURLs.
  • the reader software When requesting multiple URLs, the reader software displays the links and descriptions with the Content Provider's logo and template, if BizLogoURL and BizTemplateURL fields have been registered by the Content Provider. If not, the reader can use its proprietary template.
  • the template defines which secondary CID information (e.g. title, copyright, adult flag content type, artist info and content provider company info) is displayed.
  • the template uses the corresponding XML tags (in between ⁇ >) for the secondary data as variables to display this data.
  • the reader should read the CID, request secondary information (potentially caching URLs), and then display to the user that more information is available from ⁇ BizName>.
  • This approach causes the response to be immediate upon the user's selection of more information and removes the chance that the user selects more information and no URLs have been registered.
  • the content includes multiple CIDs, e.g. one from the content owner and one from the retailer, it also enables the user to differentiate the information source.
  • the following requirements enable the Router system to function properly and provide value to vendors and users.
  • a Router guarantees that requested or registered CIDs are unique for the given ID Provider ID and ID Version. For requested CIDs, the generating algorithm should guarantee unique IDs. For registered CIDs, the system checks the databases to make sure the CID has not already been registered by that ID Provider with that ID Version. If it has been registered, the system should send back an appropriate error.
  • the system checks that a CID has been registered by the requesting Content Provider name, ID Provider ID and IDVersion. If not, the system should send back an appropriate error.
  • a Router guarantees that there is only one Primary URL registered for each URL Type given the ID Provider ID, ID Version and CID.
  • the Databases include:
  • Log file saves the request time, response delay (in milliseconds), request IP address and registration or resolution XML message, excluding private data, for every request. Log files at least span the previous 6 months.
  • the aggregate usage data should be visible to the registered ID Providers and Content Providers via an interactive, secure web site, with abilities to export to excel or delimited (tab or comma) text files for download or automatic emailing.
  • Daily, weekly and monthly reports shall be automatically generated for immediate viewing or export.
  • Monthly usage reports should be kept for the life of the system, daily and weekly reports for two years.
  • the reports allow Content Providers to access CID specific usage statistics.
  • the age groups are defined as:
  • the registered vendors shall also be able to create custom reports with any begin and end data in the last 2 years. These custom reports will take a little time to calculate since daily reports have to be analyzed.
  • the system may allow for custom reports with fields not included in the report list below for the last 6 months. These reports will take some time to calculate since they require log files to be analyzed.
  • the reader requests the web or IP address of registration and/or resolution router, which ever are applicable, every week.
  • the system architecture can be dynamically changed every week.
  • the number of Mirror Routers is set by the Registration Authority.
  • the Mirror Routers forward all registration requests immediately to the Central Router, and wait its response that the information is correct (or the CID is unique). They also send aggregate usage files to the Central Router and synchronize with the Central Database daily. The daily time is not sent so that they don't all hit the Central Router simultaneously. Finally, they forward resolution requests for CIDs that don't exist in their database and wait for the response before responding to the User, to make sure they were not registered during that recent day.
  • the XML schemas are specified, most likely, with grouped (e.g., within WSDL) as follows:
  • the XML packing and transmission methods need to be specified, and include http, https, WSDL, SOAP and secure Web Services, such as SAML, WS-License or WS-Security.
  • Public key architecture such as described in XKMS, X-KRSS, and X-KISS, is probably not required since this example implementation has Content Provider Name and password as part of the standard XML message interface, and the contact data is not mission critical.
  • the http or https link should be maintained from request to response, and only broken after the response is received, thus increasing efficiency and reducing risk of firewall interfering with the response (as well as not requiring the client embedder or reader software to act as a server).
  • Database management is desirable and includes:
  • the Primary Databases include the following information.
  • the structure does not need to be as implied by the tables.
  • the tables provide a nice outline and help to conceptually understand how the message interface is used.
  • ⁇ RegistrationCIDRequest> ⁇ Header> ⁇ Version>1 ⁇ /Version> ⁇ IDProviderID>321 ⁇ /IDProviderID> ⁇ RequestCode>RegCID ⁇ /RequestCode> ⁇ /Header> ⁇ Body> ⁇ PrimaryInfo> ⁇ ContentProviderName>Apple ⁇ /ContentProviderName> ⁇ Password>1984year ⁇ /Password> ⁇ IDVersion>2 ⁇ /IDVersion> ⁇ CID>111 ⁇ /CID> ⁇ /PrimaryInfo> ⁇ SecondaryInfo> ⁇ Title>Fantasia ⁇ /Title> ⁇ Copyright>1960 ⁇ /Copyright> ⁇ AdultFlag>0 ⁇ /AdultFlag> ⁇ ContentType>video-audiotrack ⁇ /ContentType> ⁇ /SecondaryInfo> ⁇ /Body> ⁇ /RegistrationCIDRequest>
  • Registering one URL with RegURL is extremely similar except there is only one data element in the Primary, URLType, URL, URLVariables, URLActivation, URLExpiration, and Desc fields.
  • multiple URLs can be registered by grouping multiple RegURL calls in the transmission. Deleting one or more URLs with DelURL or DelURLs is very similar except that URLVariables, URLActivation, URLExpiration, and Desc are optional, and ignored if included.
  • RegURL in DelURL, there is only one URL included in the URL XML field.
  • Updating a Content Provider, ID Provider or User is very similar to registering a User, except that the name and password have already been assigned as opposed to being checked for uniqueness. In addition, the User does not need to enter business information.
  • ⁇ RegistrationContactInfoRequest> ⁇ Header> ⁇ Version>1 ⁇ /Version> ⁇ IDProviderID>123 ⁇ /IDProviderID> ⁇ RequestCode>RegUser ⁇ /RequestCode> ⁇ /Header> ⁇ Body> ⁇ RegName>klevy ⁇ /RegName> ⁇ Password>ken1sgreat ⁇ /Password> ⁇ BizName>AIPL ⁇ /BizName> ⁇ BizEmail>levy@aipl.com ⁇ /BizEmail> ⁇ BizAddress1>110 NE Cedar Street ⁇ /BizAddress1> ⁇ BizCity>Stevenson ⁇ /BizCity> ⁇ BizState>WA ⁇ /BizState> ⁇ BizZip>98648 ⁇ /BizZip> ⁇ BizCountry>USA ⁇ /BizCountry> ⁇ BizPhone>509-427-5374 ⁇ /
  • Resolving one URL is very similar, where the only change is that one URL is returned in the response message.
  • Requesting the registration router address is very similar, where only the request code changes.
  • the system is very flexible and can enable multiple future possibilities.
  • the enhancements include: (1) seed and interoperate multiple ID systems, and (2) enabling “buy now” links for illegitimate content.
  • Another enhancement includes integrating multiple ID Provider technologies or cached Routers.
  • the receiving software needs to know how to register the other IDs with each proprietary system to enable seeding multiple systems from one piece of software.
  • XML Tag Format Description Status ContentProviderName Integer Content provider name. Required Password Text Content provider password. Required IDVersion Integer The ID version provides the version of the CID algorithm. Required CID Text The unique content ID formatted according to the Required IDVersion. Since these requests are few, speed is not critical and integer CIDs are carried as text.
  • IDF_DOI Text International DOI Foundation (IDF) Digital Object Identifier Optional (DOI). www.doi.org. Format is text.
  • OASIS_ERI Text OASIS's unique ID.
  • CISAC_CIS Integer International Confederation Of Societies Of Authors And Optional Composers CISAC
  • Common Information System http://www.CISAC.org. Format is 96 bits.
  • ISO_ISRC Text (12 The ISRC (International Standard Recording Code) was Optional chars) developed by ISO (International Organisation for Standardisation) to identify sound and audio-visual recordings. It is known as International Standard ISO 3901. http://www.iso.ch/cate/d9515.html. Format is 12 characters.
  • SMPTE_UMID Integer Society of Motion Picture Television Engineers SMPTE
  • UMID Optional Unique Material Identifier
  • IEC_MPEG21_DII Identification ISO/IEC 21000-3. Format is text. ISO_ISAN Integer ISO International Standard Audiovisual Number (ISAN). Optional http://www.nlc-bnc.ca/iso/tc46sc9/isan.htm. Format is 64 bits. ISO_V-ISAN Integer ISO Identifier for Versions of Audiovisual works. w4636 Optional Format is 96 bits. ISO_ISWC Text (9 ISO Information System Work Code (ISWC). Optional chars) http://www.iswc.org. Format is 9 digits.
  • cIDf Integer Content ID Forum (cIDf).www.cidf.org. Format is 96 bits.
  • Optional IFPI_Grid Text (18 IFPI Global Release Identifier (GRid). www.ifpi.org/grid. Optional chars) The format is 18 characters.
  • Ad-ID Text (12 Ad-ID LLC's advertising ID. www.aaa.org. Format is 12 Optional chars) characters.
  • TVAnyTime_CRID Text TV Anytime's unique identifier. http://www.tv-anytime.og. Optional Format is text.
  • CRF Text Content Reference Forum CRF. www.crforum.org.
  • Optional Format is text.
  • ISO_ISSN Integer ISO International Standard Serial Number (ISSN).
  • ISO_ISTC Text ISO International Standard Textual Work Code. Format is Optional text (since not sure of format).
  • ONIX Text ONline Information eXchange (ONIX) Optional http://www.editeur.org/onix.html. Format is text (since not sure of format).
  • UCC_UPC Integer Uniform Code Council UCC_UPC Integer Uniform Code Council (UCC) Universal Product Code Optional (12 (UPC) www.uc-council.org.
  • EPCGlobal Electronic Product Code www.EPCGlobal.com. Format is 96 bits.
  • Portable Document Format Optional (1.1 (PDF). Format is 1.1 kBytes. kBytes) Private Binary Binary data that can be used by the ID Provider for any Optional private reason.
  • the message For the request for registering other system ID (RegOtherIDs): the message returns a “0” for success in the RtnCode field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • This request uses the same format as used in ResURL, except the CID XML field contains the other ID data (and the CID is returned).
  • This request includes primary information, and uses the same data as for RegOtherIDs, except that the Content Provider ID and Password XML tags are optional.
  • the Timestamp XML tag from the ResURL Request Code above is included as required fields.
  • the message For requesting a CID given another unique ID (ResCIDGivenOtherID): the message returns a “0” for success in the RtnCode field, the CID in the Desc field, and the secondary information if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • ResCIDGivenOtherID another unique ID
  • the message For requesting other unique IDs (ResOtherIDs): the message returns a “0” for success in the RtnCode field, and a list of the registered other IDs with each entry separated by a semicolon “;” each entry in the format consisting of the other system XML tag as defined for RegOtherIDs request code and related ID separated by a colon “:” in the Desc field, and the secondary information in the corresponding fields if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • ResOtherIDs the message returns a “0” for success in the RtnCode field, and a list of the registered other IDs with each entry separated by a semicolon “;” each entry in the format consisting of the other system XML tag as defined for RegOtherIDs request code and related ID separated by a colon “:” in the Desc field, and the secondary information in the corresponding fields if requested—or
  • the corresponding database elements could be:
  • the multimedia player When the multimedia player goes to play or transfer raw content (i.e. neither encrypted nor digitally signed), it calls the reader plug-in to check for a CID and whether or not the content is copy protected. If this raw content is copy protected and contains a CID, an explanation and “buy now” link can be provided to the user.
  • CID Copy Control Information
  • one primary rights URL can be registered using existing registration requests, and the rights URL can be returned to the reader to offer a “buy now” link to purchase legitimate content.
  • the rights flag is an additional XML field in registration and resolution messages, and is included in the database elements with the URLs.
  • the Registration Authority could, in the future, provide a plug-in that provides a universal reader interface that integrates CIDs and URLs from different ID Provider detectors.
  • This example implementation could be expanded to include a standard reader-application interface, which is the interface between a generic reader plug-in and ID Provider detector.
  • all installed ID technology detectors could call (or be called from) the generic reader plug-in, and all CIDs sent to a Router from the generic reader plug-in.
  • the generic plug-in could have the ID provider plug-ins call it with their resolution request XML messages, then display one “more info” button for the user, and finally send requests for all detected CIDs to a Router. This approach would only require the ID Provider plug-ins to change their call from an IP address to an internal DLL, and remove their user display.
  • the architecture enables Mirror Routers to link to Cached Routers for resolution requests.
  • Cached Routers are not applicable to registration requests since these requests occur neither often nor repetitively, and are immediately forwarded to the Central Router.
  • These Cached Routers will temporarily maintain their Cached Database for recent resolution requests. It is expected that the data will have a time limit set by the Registration Authority.
  • the Cached Routers will also send usage information to their linked Mirror Router daily. This architecture becomes truly distributed and efficient.
  • auxiliary data encoding processes may be implemented in a programmable computer or a special purpose digital circuit.
  • auxiliary data decoding may be implemented in software, firmware, hardware, or combinations of software, firmware and hardware.
  • the methods and processes described above may be implemented in programs executed from a system's memory (a computer readable medium, such as an electronic, optical or magnetic storage device).

Abstract

Content objects are associated with metadata via content identifiers that are derived from sensed signals captured by requesting mobile devices. In response to a content based query from a mobile device, content fingerprints and extracted digital codes decoded from the sensed signals are issued to a network based router system. This system determines identification priority, metadata responses associated with different forms of identification, and priority of metadata responses to the query.

Description

    RELATED APPLICATION DATA
  • This application is a continuation of U.S. application Ser. No. 11/614,947, filed Dec. 21, 2006 (now U.S. Pat. No. 8,924,412) which claims the benefit of U.S. Provisional Applications 60/747,408, filed May 16, 2006, and 60/753,257 filed Dec. 21, 2005, which are hereby incorporated by reference.
  • TECHNICAL FIELD
  • The invention relates to methods and systems for associating content, including both physical and electronic objects, with metadata through networks.
  • BACKGROUND AND SUMMARY
  • This document uses the terms ‘content,’ media′ and ‘media content’ interchangeably to refer to pictures, music, movies and all of their sundry creative brethren which collectively might fall under the grand umbrella named ‘creative works’. In general, a given creative work can be thought of as an entity or ‘content object’, and either the creative work stands alone with the sole companion of a name or an identification number, or it is somehow duplicated and packaged for a very wide variety of distribution methods and channels.
  • In primarily the latter case, the concept of ‘metadata’ has gained popularity, referring to additional creative works which have some form of explicit or implicit relationship to a given singular content object. Metadata generally refers to information associated with a content object. Typically, metadata is often associated with multimedia content, like images, and video and audio programs, and is used to refer to information about the content, such as its source, owner, content title, etc. One of the simpler forms of metadata might be bit-fields describing additional information about a content object such as an author's name or a category that the content object might naturally fall under. More complicated forms of metadata might be ‘pointers’ or addresses (e.g. URLs) of related content objects which, by reference, enable a user or consumer to easily access that second content object. Most generally, a key concept from a content provider and/or content distributor's point of view is that metadata can form an instant electronic relationship between a consumer experiencing one of their distributed content objects and themselves.
  • In this document, metadata refers to a broad class of information relating to a content object, and it applies to a broad class of content objects, including both physical and electronic objects. Metadata also includes an instruction or set of instructions (possibly distributed over one or more devices) that is executed by machine or machines to perform a behavior associated with an object (e.g., perform an on-line transaction, transmit or transfer content, authenticate/verify a user, content, access token, update/patch a program etc.). Metadata can be formatted and stored in a variety of formats. One format is XML, but there are others. The metadata for a particular content object may be distributed over different storage devices. In such a distributed storage approach, the metadata in one location includes references to metadata in other locations (such an index, pointer, address, URL, etc.).
  • One aspect of the invention relates to the technical infrastructure, including metadata routing and associated network services that ensure this electronic relationship can happen in the first place, and that this relationship can lead toward secondary revenue generation opportunities that may some day rival and eclipse primary media distribution revenue generation.
  • The business of selling packaged media or otherwise delivering specific media to a targeted audience has a long history of monetizing the primary delivery of that media. Selling records or selling 30 seconds of advertising on a television show or selling tickets to a movie each fit into the primary distribution monetization business model. The growth in the Internet and the flowering of various digital distribution channels certainly has complicated the description of primary media distribution itself, but the general notion of “packaging up” a creative work and delivering it for some explicit compensation strategy remains intact.
  • In a kind of direct extrapolation of the primary distribution model, Digital Rights Management (DRM) inventions and approaches have at least a decade worth of effort, design, trial, partial successes and valuable lessons now under their collective belt. Not least in these lessons are the behind-the-scenes business community wrestling and clashes of Titans surrounding the question on what might be considered a core property of DRM approaches: “who owns the standard . . . who owns the channel . . . who ultimately owns the consumer relationship?” Phrased in this way, there can be little mystery why uniform global standards are possibly decades away still.
  • Two somewhat different forces have arisen in the past decade or two which have not been entirely harmful to classic primary media distribution monetization, but they have nevertheless put significant pressure on businesses which rely on primary distribution revenue to look for secondary methods of monetization. At the very least, these forces have led toward fundamental changes of strategy in how primary distribution methods are exploited.
  • The first force is the ease with which creative works can be copied and re-distributed in an unauthorized fashion. The second force is the advent of highly distributed media distribution channels and the equally highly distributed end-devices used to experience a creative work, most certainly including mobile devices. Though these two forces are rather different from each other and though each has been partially transformed into “opportunity” by ever-entrepreneurial efforts and companies, the fact remains that both forces are unstoppably disrupting traditional approaches to the monetization of primary media distribution.
  • The relative ease with which creative works can be copied has been a primary fuel in creating the now familiar notion of peer-to-peer networks where folks not only share pictures from family vacations but also the latest movie they enjoyed last night. Untold years of technological ponderings and industry standards initiatives have sought to re-establish the core role of primary packaged media distribution and its associated monetization, also not without some success, but the genie does seem to be rather out of the bottle for those seeking to re-create the good old days of creation-to-consumption monetization. Coordinated primary and second monetization strategies and cash-generating mechanisms are inevitably here to stay, most likely co-opting the second force of highly distributed distribution channels and consumption devices. Of particular note is the up and coming ‘mobile’ media consumption trend where ubiquitous connectivity meets ubiquitous delivery.
  • Still missing in this inevitable balancing of primary and secondary monetization methods are the critical details of the secondary monetization methods and systems, as well as the impact of their existence on primary distribution methods and strategies. In other words, how can secondary monetization work (beyond peddling primary distribution of ring tones), and how can primary distribution production processes be seamlessly modified to put the overall media industry profit and revenue lines back onto positive and strongly growing paths? This document describes a routing system and method, along with detailed hardware and software descriptions of the system and network components which can make it work in a tremendously complicated media distribution and consumption universe.
  • Managing the Fountain of Metadata
  • Once a distributor has accomplished primary delivery of a media object to a consumer, the next best thing to “manage” is the metadata services that add value to that delivered object. This is not the slippery slope named “control” which is a word written on many a tombstone of the last decade's worth of packaging and monolithic DRM-system approaches to media consumption behaviors, it is fundamentally about managing the highest quality relationship to the individuals or groups who are naturally attracted to the media content in the first place. The initial packaging up of “good stuff” metadata into the primary delivery of the original media content was one of the main reasons a consumer will pay a modest amount for the officially sanctioned media, but it will be the ongoing access to high quality metadata, group affinities and seamless access to related media which will compel honest consumers to be honest . . . they will simply get more value for their time and money that way.
  • Clearly, combining a media object with static metadata or even “static links” to inherently dynamic web-based content is a developed art at this point and somewhat accounts for the ongoing vitality of primary distribution channels over some P2P network channels. In other words, packing in “good extra stuff” still sells records and movies and pictures. P2P copies can try to keep up, but the rightful distributor has a leg up on the availability of legitimately compelling content, precisely because they are the legitimate owners or distribution rights-holder.
  • In some advertising-based business models, content objects are distributed for free or reduced cost and provide a vehicle for advertising revenue. These models provide an opportunity for content owners to monetize content by conveying advertising within the content. Yet, to capitalize on this opportunity in distribution networks like wireless networks and the Internet, there is a need for mechanisms to tie the content consumption to revenue opportunities, such as linking the content to electronic transactions to buy related content or products and services advertised within the content.
  • Fortunately, there are a few common denominators of all media distribution and media consumption that will never go away and which get to the heart of ensuring a stable relationship between content providers and content consumers. One common denominator is simply identity of the content itself. Another common denominator is the existence of basic business rules and legal frameworks which collectively define the common sense notion of “legitimate distribution and consumption” and its associated notion of return on investment to the content providers. A third common denominator is the near-universal desire of consumers to have access to the best information related to the content being consumed. And finally, there is a fourth common denominator that a content provider wants to own the “rules of relationship” associated with the content they distribute: Business rules and contracts should define how legitimate and consumer-friendly metadata relationships are carried out.
  • One aspect of this invention refers to this notion as the title of this section indicates: managing the fountain of metadata that a consumer wants and will eventually expect. The other side of this coin is classic business principle behind satisfying customers: delivering the highest quality “rewards” in managing this fountain will ensure repeat business.
  • The raw mechanics of how this management can happen in the global cacophony of media flow provides the technical foundation for these emerging content distribution and monetization models. The careful reader will see that the described system and network mechanisms are fully complementary to DRM-based approaches in the “digitally contained” world of the Internet and classic dedicated media channel delivery networks on the one hand, and fully able to deal with complexities and steep growth of mobile device consumption on the other hand.
  • In one embodiment illustrated in FIG. 9, a routing system includes two primary processing engines that are used to link a media object held by a consumer to a source of metadata. The first engine, including the ID resolver and registry components, can be described as the lingua franca of identification systems, methods, technologies, etc. It can also be effectively described as a virtual “DNS for Content Objects,” as this identification engine respects any and all native or monolithic approaches to content identification. Hence the qualifier “virtual” in front of DNS. Its function is to resolve a content ID based on identifying information originating from disparate content identification systems.
  • The second engine, the rules database and processor, determines where to re-direct the consumer based on the resolved content ID. This rules engine facilitates secondary revenue generation opportunities because it further enables the system to tailor the metadata response to provide related content, products and services. The content provider universe is complex and often has a wide variety of business interests at play. Such interests are most often encapsulated in contracts between various entities, including the artists which create works in the first place, and such contracts can be extended to the detailed rules of metadata response to normal and/or pro-active metadata requests during media consumption sessions. The quality of the response to the consumer, and the opportunity to direct consumer's to additional revenue generating activities including classic eyeballs/advertising pathways, can be enabled by this rules engine.
  • FIG. 9 shows the first and second engines as being part of a router system, these engines can be partitioned and distributed over devices and controlled by different participants. The rules processor and database may be partitioned from the router system and implemented in separate instantiations, each controlled by a different participant. In this case, for example, the resolver re-directs a consumer to a rules engine under the control of a participant linked to the object via the ID registry, and this rules engine, in turn, executes a rule that determines the metadata response for the consumer (e.g., a URL or set of URLs to particular metadata). The rules processor may also be executed, at least in part on a device under the client's control. In this case, for example, a set of URLs linked to the content object via the ID registry are returned to the client, which in turn, executes rules to determine the metadata response tailored to the consumer.
  • The good old days of selling packaged media is still with us. The content being sold is now the seed for an ongoing relationship in ways that classic “branding” could barely fathom. This disclosure details how these two core engines can be built and operated for the good of content providers and content consumer's alike.
  • Managing the Relationship Between Metadata and Content Objects
  • As noted, metadata plays an important role in managing and facilitating transactions in content objects. Some significant examples include the use of metadata in digital distribution of content, electronic commerce, and on-line searching and organization of vast stores of data (e.g., the Internet). As the digital world proliferates and there are numerous transactions in content objects, there is a compelling need to manage the association of metadata and content objects.
  • This need is not confined to the digital realm. Because humans live in the physical and analog realm, there will always be a need for efficient schemes for crossing back and forth between the digital and analog realms. In particular, physical objects have corresponding metadata just as electronic objects do. For example, products have corresponding metadata in the form of product information, manuals, catalogs of related products, etc. Printed objects have metadata in the form of electronic versions of the object, ownership, source, time and location of creation, etc. Physical objects link to their metadata via an identifier on or derived from the product or related documentation (e.g., packaging, labels, etc.). Metadata management technologies, thus, need to be able to support this physical/electronic interface. Emerging applications include linking physical objects to Internet related information and electronic transactions as described in U.S. Pat. Nos. 6,947,571 and 6,505,160 and International Patent Application WO 97/43736, which are incorporated by reference.
  • A significant aspect of managing metadata of disparate content objects is providing effective technologies and schemes for content identification. This is important in the digital realm, where there are many potentially conflicting content identification technologies and architectures. It is also important for managing metadata for physical objects in the digital realm, where identifiers extracted or derived from physical objects provide a form of digital identity of the physical object in the digital world. The metadata systems and methods in this document are designed to work with identification systems that operate in the digital realm only, as well as ones that span the digital and physical realms. The latter category includes identification methods that derive content identifiers from an electromagnetic signal captured from an analog representation of audio or images (e.g., a digital watermark, content fingerprint, visual symbology, pattern recognition, voice recognition, OCR, etc.) as well content identifiers read via electromagnetic readers of physical data carrier devices like magnetic stripes (and other magnetic data carriers), RF ID tags, smart cards, etc. For example, physical object can be identified via RFID tags, as described at www.epcglobalinc.org and in the overview document (www.epcglobalinc.org/news/FPCglobal_Network_Overview10072004.pdf), which is incorporated by reference.
  • Such content identification technology provides a means to identify content objects, but the variety of content identification schemes and formats poses compatibility and interoperability challenges. Moreover, such systems cannot provide useful information without an effective system and method to associate various identifiers with the appropriate metadata.
  • The problems are multifold and created by the fact that digital distribution separates content from packaging, new 1-1 marketing opportunities are minimally being utilized, and digital distribution is moving forward with proprietary channels that make the value chain more complex rather than simpler.
  • For instance, once content is digitized information typically carried on physical packaging is lost from the content. Digital downloads are partial products, “files without packaging and related metadata”. Metadata loss is central to issues surrounding digital content management, piracy and e-commerce. Manual population of multiple distribution channels' metadata repositories gives rise to human error and inaccurate metadata.
  • Marketing opportunities are being lost once content is distributed since content owners and retailers lose contact with the consumer. Loss of 1-1 marketing capabilities, especially with digital distribution gaining traction, leads to loss of potential revenue.
  • Channels of distribution (e.g., online music retailers, podcasts, social networking sites, user-generated content sites, and P2P networks) and the number of digital derivatives (ring tones, mobile videos, etc.) stemming from a single digital product are increasing. Accurate and effective content identification is an absolute requirement to manage content effectively. Content owners are currently evaluating their metadata repositories trying to understand how to streamline in a manner that is cost-effective.
  • Proprietary content identification and metadata systems complicate, rather than simplify, the value chain. Content is embedded with many identifiers that do not interoperate. A few proprietary systems are linking content to metadata without input of the content owners, thus increasing the number of value chain participants.
  • Previous initiatives to create a central content metadata repository have failed due to proprietary, political and technical issues of creating a repository rather than directory service. Content owners and retailers want to manage their proprietary metadata and participate in building the relationship with the consumer. Third party metadata companies, and related companies, such as those that organize, classify, search and provide search results based on metadata (such as search engine providers), stand to profit from potential unauthorized use of content owners' metadata.
  • This document describes systems and methods for associating metadata with content objects. It describes embodiments of novel routing methods and systems referred to as content metadata directory services.
  • Globally Unique Identifier Scheme
  • One novel method of associating a content object with metadata uses a combination of a content identifier and a bounding identifier to enable handling of disparate sets of content identifiers for content objects with potentially conflicting content identifiers. The method receives a content identifier for a content object from among a set of content identifiers. It provides a unique bounding identifier for the set of content identifiers. This unique bounding identifier is used in combination with the content identifier to form a globally unique identifier for the content object. This globally unique identifier is associated with a metadata source, which enables routing of a user to the metadata source.
  • This approach effectively manages cases where an ID provider pre-assigns a set of content identifiers to objects, and then later registers them in our novel directory system. It also manages cases where the directory system assigns the content identifier prior to insertion of the content identifier in the content object by an ID provider.
  • As set forth in the CMDS embodiments, the unique bounding identifier may comprise an ID provider identifier. For example, RFID, EPC, digital watermarking and fingerprinting technology providers can serve as ID providers in the system with overlapping content ID numbers, but unique ID provider IDs. Each ID provider may also use an ID version to distinguish different versions of its technology or content ID spaces.
  • After appropriate registration, the directory system is used to route users to a metadata source. For example, the user (e.g., the reader executing on the user's device) provides the content ID from the content object and the bounding identifier. The directory system, in turn, routes the user to the metadata source associated with the globally unique identifier for the content object.
  • Metadata Directory Supporting Content Objects with Multiple Content Identifiers
  • Another novel method addresses content objects with two or more content identifiers, potentially referencing different metadata sources. This method registers different globally unique identifiers for a content object. These globally unique identifiers each comprise a content identifier provided with the content object and a bounding identifier identifying a set of content identifiers of which the content identifier is a member. For each of the globally unique identifiers, information is maintained about a metadata source. The method receives a first content identifier for the content object, and uses a bounding identifier associated with the set of the first content identifier to determine the globally unique identifier for the first content identifier. The user is routed to the metadata source associated with globally unique identifier.
  • This approach handles a variety cases in which two or more content identifiers are provided for a content object for the purpose of registration or resolution. The metadata directory system supports and manages both the registration of and routing to different metadata sources corresponding to different content identifiers of the content object. These cases include:
  • 1. Content identifiers are embedded or calculated by different ID providers and are later derived from the content object using different readers associated with those technologies. For example, the readers are different because they derive the content identifier using different content identification methods (e.g., through the file header/footer, digital watermark, fingerprint, Vertical Blanking Interval data in video programming, etc).
  • 2. The different readers may, for example, derive the content identifiers using different attributes of the content object. These different attributes may comprise different types of embedded auxiliary data (different watermark embedders/readers, watermark vs. embedded header/footer data). These different attributes may comprise attributes from which different digital watermarks or robust hashes are derived. The different attributes may correspond to in band and out of band attributes of the content object. “In band” refers to an identifier derived from content in the content object that is rendered for perception by a human. “Out of band” refers to auxiliary data carried in the content object but not forming part of the content that is rendered for perception by a human. Certain types of content objects include multiple content programs rendered for perception by a human, like video and audio tracks and close captioned text. In band identifiers may be derived from one or more of these content signals within the content object. In some cases, one content program may be embedded in another content program within a single content object, such as where close captioned text is embedded in the audio or video program of an audiovisual work.
  • 3. The different content identifiers for a content object may be derived from the content object using different parts of the content object, including different in band and out of band parts as well as different parts within the in band portion of the object and different parts within the out of band portion. These parts may be in discrete locations in one domain of the content signal, yet at overlapping locations in others. Examples of domains include spatial, temporal and transform domains (e.g., frequency domain, compressed domain, etc.) of the content signal in a content object).
  • Enabling Different ID Provider and Content Provider Participants
  • In some metadata systems, the system owner, serving as a registration authority (RA), provides the identification technology and content owners use the technology to register themselves as a content provider, register content and link the content to metadata.
  • This document describes a novel system that enables multiple identity providers (ID Providers) to register and use the system. The ID Provider registers with a metadata directory system, receives a unique bounding identifier, and uses this bounding ID (e.g., an ID provider ID) with subsequent interactions with the metadata directory system. Separately, metadata source providers register metadata sources with the metadata directory system. This enables many different participants to associate content objects with metadata sources using one or more identify providers. Examples of metadata source providers include content providers, like content owners or retailers that have the flexibility of working with different ID providers to associate content objects with metadata. Both content providers and ID providers can register and use the system. The metadata source is the system or device that provides the metadata, like a web site. The directory system uses an identifier for the metadata source, which enables it to maintain an association between a content object and its corresponding metadata source. For example, in some embodiments, a URL serves to identify the location of the source.
  • One embodiment of the directory system is referred to as CMDS. CMDS enables content providers to utilize the CMDS to knit together metadata sources that are associated with content using disparate and previously incompatible ID provider technologies. CMDS enables content providers to manage their proprietary information (i.e. they do not have to turn over control of proprietary metadata to a RA for storing and distributing the metadata), enables eCommerce for all value chain participants (e.g., both content owners and retailers can embed CIDs), facilitates interoperability with all content identity provider technology (even pre-existing ID systems, such as EPC), allows for compatibility with both PC and mobile devices, facilitates interoperability for multiple ID providers who license a common identification algorithm, and enables usage reporting and vital marketing statistics.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a flow diagram illustrating a method of associating a content object with a metadata source.
  • FIG. 2 is a flow diagram illustrating interaction between a reader and a directory system to link a content object with a metadata source.
  • FIG. 3 is a system diagram illustrating a metadata directory system and its interaction with ID providers for registration of content IDs and readers for resolution of content IDs.
  • FIG. 4 is a system diagram illustrating an overview of a content identification and routing system.
  • FIG. 5 is a diagram demonstrating a usage model of using the routing system to direct a user to content providers based on content identifiers extracted from the user's content object.
  • FIG. 6 is a diagram illustrating an implementation of a router in more detail.
  • FIG. 7 is a diagram illustrating a distributed router system in one implementation of a directory system.
  • FIG. 8 is a diagram illustrating an example of a directory system architecture along with different content owner participants using the system to associate content identifiers with metadata sources they control.
  • FIG. 9 is a diagram illustrating a routing system including a rules processor and traffic monitor.
  • DETAILED DESCRIPTION
  • FIG. 1 is a flow diagram illustrating a method of associating a content object with a metadata source. This diagram is intended to show how a content metadata directory system performs registration of content IDs, which achieves two objectives:
  • 1. it enables integration of different content identification schemes with potentially overlapping content ID schema; and
  • 2. associates the each content ID with one or more metadata sources.
  • As shown in block 100, the directory system receives content IDs. These content IDs either originate from pre-existing sets (e.g., pre-assigned by an ID provider), or directory system itself issues content IDs for an ID provider upon request. The ID provider refers to an entity that provides content identification for content objects. Typically, this is a content identification technology provider, such as a provider technology for computing in band (e.g., watermarking or fingerprinting) or out of band identifiers (DRM container technologies, VBI inserters, etc.) for content objects.
  • To differentiate among different sets of content IDs, the directory system provides a unique bounding identifier (BI) as shown in block 102 for each unique set of content IDs registered in the directory. It ensures that BI's for different sets of content IDs do not collide. Thus, while it is possible to register pre-existing BI's that do not collide, it is preferable for the directory system to issue the BI's or at least issue guidelines for their use to prevent collisions.
  • The directory system forms globally unique identifier (GUI) for all content objects that it manages by combining the content ID for an object with the BI for the set of content IDs of which the content ID in question is a member (block 104).
  • The directory system associates the GUI for a content object with a metadata source as shown in block 106. As explained below, this metadata source provides metadata in response to a request from an entity that supplies the content ID for a content object. The directory system stores the association between the GUI of a content object and the metadata source in a manner that enables fast, efficient routing of the requesting entity to the metadata source. In one implementation, the directory system stores a location of the metadata source on a network, such as a URL. This enables the requesting entity to connect to the metadata source and retrieve metadata associated with the content object. Several metadata sources may be associated with a GUI and returned to a requesting entity.
  • FIG. 2 is a flow diagram illustrating interaction between a reader and a directory system to link a content object with a source of metadata. As shown in block 110 the reader extracts a content identifier from a content object. It then forwards the content ID to the directory system and either implicitly or explicitly identifies the BI for the set of content IDs in which the extracted content ID is a member (112). An example of explicitly identifying the BI is where the reader supplies a unique provider identifier assigned to it, along with a version identifier. The version identifier may be used to enable the provider of the identification technology to create different content ID sets, which enables flexibility with different versions and upgrades of the ID provider's technology. Some examples include different versions of a particular RFID, bar code, digital watermarking, fingerprinting or DRM technology for different customers, applications or content object groupings.
  • An example of implicitly identifying the BI is where the directory system determines the identity of the provider based on some inherent attribute of the data provided by the reader, such as its format, data type, etc.
  • The directory system forms the GUI using the received content ID from the reader and the BI (114). The precise manner of formation may vary. One approach is to concatenate the content ID and BI in some fashion (e.g., appending them together to create one GUI). Another approach is to hash one or more parts of the content ID and BI and combine these parts to create one GUI. It is possible that one or more third parties may be involved in the process of supplying the content ID and BI parts of the GUI. For example, a fingerprinting database may supply the content ID and the BI associated with it. Yet another approach is that each ID is located in a separate field in the database, and only entries that match all ID fields are used to register or resolve the GUI. The directory system maps the content ID and BI into a naming, numbering or address space which provides a GUI for each content object.
  • The directory system then looks up the metadata source or sources associated with GUI (116) and returns some identification of the source to the reader. One form of source identification is its URL, but other forms of identification are possible as well. Examples include a pointer, address, index to a database of metadata, machine instruction for accessing the source. The approach of returning an identification or location of the source to the reader enables the reader to establish a direct connection with the source to get the metadata. In alternative approaches, the directory system can instruct the source to establish a connection with the reader by providing the reader's address. The directory system may also act as an intermediary between the reader (or location specified by the user of the reader), on the one hand, and the metadata source on the other. This approach can be used where the directory, or some other intermediary in communication with it, is used to provide additional processing of the metadata before supplying it to the requesting entity at a location of the requesting entity's choosing.
  • FIG. 3 is a system diagram illustrating a metadata directory system and its interaction with ID providers for registration of content IDs and readers for resolution of content IDs. As shown, different ID provider systems 200, 202 establish sets of content IDs corresponding to content objects. The ID provider systems may pre-assign sets of content IDs to objects and then register with the directory system 204 them via the directory system's registration interface 206. Or, they may request the directory system 204 issue content IDs via the registration interface 206.
  • The directory system includes and/or communicates with a database 208 that stores the association of the GUI 210 for each content object and its corresponding metadata source ID 212. FIG. 3 shows a generalization of the association of a GUI to a corresponding metadata source. This database can be structured with one or more layers of indirection in which aspects of the GUI are used to index into different handlers and/or databases segmented by provider, version, location, etc.
  • FIG. 3 illustrates the point that different ID providers (e.g., providers A and B) or different versions of a single provider's technology (Versions A and B) can register multiple sets of content IDs with the directory system. Moreover, multiple content IDs from different sets may be associated with the same content object 214. For example, ID provider A and ID provider B distribute readers A and B (216, 218), respectively. These readers may be programs, devices, or a combination thereof (including components of a device or distributed over different devices, such as in a web services type implementation). In this depiction, content object 214 includes CID 1 of set A (220) and CID 1 of set B (222). A single program or device such as a media player program or device may include both readers A and B and present a common graphical user interface to the user. Alternatively, the readers may be separate components or programs executing within the user's device or network domain.
  • When the readers 216, 218 encounter the object, such as upon file open/copy/transfer/edit command, entry into a device, network gateway or filter, they extract the content ID and forward it (along with the implicit or explicit BI data) to the directory system's resolution interface 224. The resolution interface, in response, looks up the metadata source ID or IDs if there are multiple sources (e.g., a URL or set of URLs) and returns them to the respective readers (or some program or device designated by the readers or pre-registered with the directory system).
  • The readers 216, 218 then use the metadata source IDs to establish connections with the respective metadata source provider systems 230, 232 and get the metadata associated with the content object 214 from these different sources. For example, these sources may be web content files on web servers located at the location returned by the directory system. These sources may be maintained or controlled by different participants in the content distribution value chain, such as content owners, retailers, catalog companies, product manufactures, service providers, etc. One source of metadata may be the content owner, which provides web content affiliated with the content owner, and another source of metadata may be the content retailer, which provides web content affiliated with the retailer (e.g., such as eCommerce opportunities to buy related entertainment content or merchandise).
  • The specification provides detailed embodiments of technology summarized above as well as additional inventive systems and methods. FIGS. 4-8 are briefly summarized here, are further illustrated with examples in connection with a system called CMDS.
  • FIG. 4 is a system diagram illustrating an overview of a content identification and routing system.
  • FIG. 5 is a diagram demonstrating a usage model of using the routing system to direct a user to content providers based on content identifiers extracted from the user's content object.
  • FIG. 6 is a diagram illustrating an implementation of a router in more detail.
  • FIG. 7 is a diagram illustrating a distributed router system in one implementation of a directory system.
  • FIG. 8 is a diagram illustrating an example of a directory system architecture along with different content owner participants using the system to associate content identifiers with metadata sources they control.
  • As summarized above, the system works with many different content identification technologies for both electronic and physical objects. It also applies for both out of band and in band content identification. Examples of out of band content identification for content objects include identification based on auxiliary data in file headers and footers, Vertical Blanking Interval (VBI) inserted data, DRM container schemes for identifying content signals in the container, etc.
  • The following describes some examples of in band content identification in more detail.
  • Digital Watermarking
  • One method for in-band content identification is to carry a content identifier in a digital watermark embedded in the perceptual portion of a content object that is rendered for display or playback to a human. The digital watermark is hidden or “steganographically embedded” in the content by modifying the content to include an auxiliary signal that conveys auxiliary data (e.g., a message “payload”), such as the content identifier.
  • Digital watermarking is a process for modifying physical or electronic media to embed a hidden machine-readable code into the media. The media may be modified such that the embedded code is imperceptible or nearly imperceptible to the user, yet may be detected through an automated detection process. Most commonly, digital watermarking is applied to media signals such as images, audio signals, and video signals. However, it may also be applied to other types of media objects, including documents (e.g., through line, word or character shifting), software, multi-dimensional graphics models, and surface textures of objects.
  • Digital watermarking systems typically have two primary components: an encoder that embeds the watermark in a host media signal, and a decoder that detects and reads the embedded watermark from a signal suspected of containing a watermark (a suspect signal). The encoder embeds a watermark by subtly altering the host media signal. The reading component analyzes a suspect signal to detect whether a watermark is present. In applications where the watermark encodes information, the reader extracts this information from the detected watermark.
  • Several particular watermarking techniques have been developed. The reader is presumed to be familiar with the literature in this field. Particular techniques for embedding and detecting imperceptible watermarks in media signals are detailed in the assignee's U.S. Pat. Nos. 6,122,403 and 6,614,914, which are hereby incorporated by reference.
  • Robust Content Hashes and Fingerprinting
  • Another method of in-band content identification is a hash of the content data, which is sometimes referred to as a content “fingerprint.” In order to remain unchanged through distortion of the content, a robust form of hash is sometimes used in which the hash is derived from features of the content that are expected to survive in tact through distortion in the delivery channel, like clipping, time or geometric changes, compression, transmission, etc. Examples of these features include a vector of frequency domain values (e.g., e.g., robust low and mid frequencies), perceptually important features (including temporal, spatial or frequency domain features), content statistics, feature values quantized into discrete bins, all of which are not necessarily mutually exclusive, and which are generally characterized in that they are not degraded by expected distortion in the channel (e.g., compression, transmission, D to A, and A to D conversion). To be clear, robust fingerprinting methods allow some change in the content signal, yet the fingerprint computed from that distorted signal still maps to the same identifier. In other words, expected degradation does not change the signal so substantially that it maps to a different fingerprint in the database or no fingerprint at all. For consistency, we refer to these methods as fingerprinting, which generate content fingerprints.
  • This fingerprinting approach to content identification has the advantage that the auxiliary data embedding process is unnecessary. Instead, the reader process can generate the identifier from the content object without prior explicit modification of the content object to include auxiliary identifying data. A potential disadvantage is that copies of the same content program (e.g., the same musical track, song, movie) have the same fingerprint, which requires use of additional means to differentiate different copies of the same content program. The advantage of not requiring auxiliary embedding is also mitigated by the fact that the fingerprint needs to be registered and kept in a fingerprint database to enable matching of a computed fingerprint with registered fingerprints. Once a match is found, the database provides the content identifier for the matching fingerprint. This potentially adds additional processing and network communication to produce the content identifier.
  • For ease of understanding in the context of our architectures, we describe fingerprint methods as including three components, a calculator, a reader and a fingerprint database. The calculator does the following: (1) creates the fingerprint using the same (or similar, where changes are based upon known or estimated distortion) algorithm as the reader, (2) registers the fingerprint in the fingerprint database, and (3) links the fingerprint to a content identifier. The fingerprint may be one value or a set of sub-fingerprints taken from portions of content throughout some or all of the content. When sub-fingerprints are used, each sub-fingerprint or set of sub-fingerprints links to the same content identifier. The reader computes a fingerprint (e.g., set of sub-fingerprints), sends them to a fingerprint database, and receives the content identifier.
  • The fingerprint algorithm, as used in the calculator and reader, utilizes the perceptual content signal. The fingerprint is a numerical construct (e.g., an array of values) derived from a content signal that serves as a statistically unique identifier of that signal, meaning that there is a high probability that the fingerprint was derived from the content signal in question rather than a different one that sounds or looks similar. One component of fingerprint algorithm is a form of hash algorithm. The hash algorithm may be applied to a selected portion of a content signal (e.g., the first 10 seconds) to create a fingerprint, or may be applied repeatedly to generate a sequence of robust hashes, where a specified sub-set of this sequence can identify content. For example, the sequence may use sub-fingerprints from every 1/16 second of a song, and require 32 sub-fingerprints (i.e. any 2 seconds of audio) to identify the audio. In addition, 3 seconds can be used to improve accuracy.
  • Directory System Applications
  • As noted, the directory system and method are applicable to both electronic and physical content objects (as well as objects that pass to and from analog and digital domains). The network methods for communicating and routing a device (such as computer or wireless phone handset) having a content object to another having metadata relating to the content object apply to different types of networks, including computer networks like the Internet, and wireless telephone networks. Examples of mobile device applications, such as linking from an object to its metadata via a cell phone handset, are described below. The router can be implemented in the cell phone network, the Internet, or spanning both the cell phone and Internet, such as when mirror routers reside in the cell phone network, the Internet or both the cell phone and Internet network. Different types of URLs such as WAP, WMI and “full” may be used as metadata source identifiers maintained in the directory system.
  • Metadata Routing and Rules
  • A content metadata directory system enables those having control over a content object to associate a metadata response with the content. In many applications, it is advantageous to allow different metadata responses for a particular content object. We refer to the instructions and/or data within the system that control the metadata response as “rules.” One example of a rule in the directory system is data or instructions specifying the URL or list of URLs to return in response to a metadata request specifying a particular content ID. In some cases, more complex rules are needed to support metadata responses tailored to a particular context, such as user attributes (e.g., user preferences, security, account information and status, location, etc.) or transaction attributes.
  • To illustrate an implementation of these rules, it is instructive to begin with a diagram showing the components of a router system in which these rules operate. FIG. 9 is a block diagram illustrating a router system and its relationship with a consumer and content distribution participants. In this diagram, there are at least three entities represented: the consumer, the router service provider(s) and content distribution participants. FIG. 9 shows a configuration in which the components of the router system are distributed across these participants. The components comprise devices and/or software modules and examples of these are provided throughout this document. One set of components are referred to as part of the consumer domain 900. These are components that the consumer control's such as his or her devices and embedded software in these devices (such as wireless phone, home network, PC, home entertainment system devices, etc.). Another set are referred to as the router system 902. These are components involved in routing from content identification and related context to a metadata response, as well as related network services, such as metadata traffic monitoring and response aggregators. A final set are referred to as the content distribution participants 904. These are the participants that provide content objects, manage their distribution, and supply and/or control metadata content distribution.
  • The content distribution participants 904 include, but are not limited to, content owners 906 and content distributors 908. These owners include not only traditional providers of entertainment content, but also those that provide content, including advertising, used to market other products and services. These participants register their content objects 910 with the router system 902 and distribute them to consumers 912. Through a registration component 914, the participants 904 register their content objects in the routing system as described in the various embodiments in this document. In particular, they provide content identifiers and associated rules for providing responses to metadata requests for these identifiers. These content identifiers and rules are stored in an ID registry database 914 and rule database 918, respectively. These databases may be integrated in one database or implemented in separate databases with a key or like identifier (e.g., unique identifier) that associates a content object with a corresponding rule governing the metadata response.
  • The router system enables consumers to request a metadata response wherever the content object travels in its distribution chain as long as the consumer has a reader to extract a content identifier and associated modules for packaging and sending a metadata request to the router system. FIG. 9 illustrates the metadata request as an “ID labeled request” from the consumer domain. The “consumer domain” in this context is not intended to be limited to only retail users of content. Rather, it includes virtually any user of the router system whether they represent content owners or distributors seeking to access metadata for their content, purchasers/licensees of the content, or customers that receive and consumer content for entertainment, information or commerce. In fact, rules help facilitate different levels of access among the various types of consumers of the router system.
  • The router system includes an ID resolver 920, which receives the ID labeled request and determines an ID for the content object based on the content ID and associated identification system information supplied by the requesting device. The discussion for mapping content identifiers and provider identifiers into a unique identifier for a content object is one example of such a process. This approach of unifying content identification schemes enables the routing system to serve as a form of lingua franca for content identification, stitching together disparate content naming schemes.
  • The content ID may have one or more metadata responses registered for it. A rules processor 922 executes rules associated with the content object (e.g., via the content ID) to determine the metadata response based on information supplied in the request, information about the requesting user (including the user's device capabilities, connectivity, etc.), and/or information retained in the routing system, such as transaction data for the content object or the class from which it the content object originates (class defined by content genre, by affinity group of consumers for the content genre, etc.).
  • In addition to resolving IDs and executing rules for content objects, the routing system may also provide additional services. The router system of FIG. 9 includes a traffic monitor 924, which logs usage statistics and generates usage reports. An embodiment of this usage monitoring and reporting is described with reference to CMDS implementations below.
  • The rules processor can also execute rules based on a content object's dynamic metadata. Dynamic metadata refers to metadata that change over time. One example of such dynamic metadata is a content object's usage data. A rule governing the metadata response can be made dependent on the usage data. For example, if the number of requests for metadata exceed a threshold, the metadata response is adapted accordingly. For example, more metadata data including information about related content and commerce opportunities are provided as the interest level in a particular object increases over time. The response can be tailored based on user information derived from metadata requesters so that the response is tailored to the common attributes of the class of users requesting metadata for the object. Patterns of common attributes of users, content or the content metadata emerge as usage data is tracked over time. This enables the system to identify and dynamically add metadata responses for a content object. For example, as interest in the content object grows, the routing system adds additional links to related content objects and products and services to an affinity group for a content object or class of object. The affinity group can be defined, for example, as a group with common preferences or interests in content objects.
  • As a further service, the routing system can also act as a metadata repository and aggregator of metadata responses. FIG. 9 includes a response aggregator 926, which provides metadata responses and stores metadata for content objects in support of this function. In some embodiments, the routing system simply re-directs the metadata request to the content owner/distributor, which in turn, provides metadata to the requesting consumer. There are alternative ways to implement this approach. One, as documented in CMDS embodiments, is to return to the consumer a URL or set of URLs for a metadata sources controlled by others. The consumer's device (e.g., via a web browser or like application program) then sends a request for metadata to the metadata repository at this URL. Another approach is to act as a proxy server for the content owner's metadata repository. In this case, the routing system determines the metadata source's URL based on ID resolution and rule execution (if rules exist) and issues a metadata request to the metadata repository at this URL. If multiple URLs are involved, it makes a query to each one. The routing services aggregate the metadata responses from the metadata repositories and returns the aggregated metadata to the requesting consumer. Another approach is where the routing system forwards the metadata request from a consumer to the URL of a metadata repository, which in turn, responds with metadata directly to the requesting consumer. In sum, the content owner/distributor controls the metadata response in some cases as shown in block 930, where as the routing system controls the response in the other case.
  • As an added function, the routing service acts as a metadata repository. In cases where a rule dictates it, a user requests it or other metadata sources are not available, the routing system identifies the URL of the metadata repository within its control, packages the metadata response with the response aggregator and returns the metadata to the requesting consumer.
  • The capability of serving as a metadata repository enables the routing system to provide additional network services. One such service is to enable users the ability to collaborate in the creation of metadata for content objects by posting recommendations, preferences, and other related information about content objects in the metadata repository. This adds an added dimension to affinity groups identified and managed by the routing system. In particular, it enables members of these groups to be active contributors to the metadata for the content objects that they are most interested in.
  • Having described the routing system, we now describe rules implementations in more detail. One approach to supporting multiple different rules for a content object is to enable one or more participants that control the object to register different content IDs associated with that object in the ID registry, each having an associated URL or set of URLs in the registry database. For example, each content ID references a URL for the respective participant (e.g., content owner, distributor, retailer, each providing different metadata sources at the corresponding URLs in the database).
  • This approach may lead to further rules being implemented in the router system and/or client program executing in the consumer's device. For example, the process begins with a client reader program or programs on the consumer's device extracting multiple CIDs from the content object and forwarding them to the router system. The router system, in turn, looks up the corresponding URL or URL list for each CID. Then, the router executes a rule governing which CID or CIDs have priority and returns a subset of the URLs associated with the CIDs with priority. Alternatively, the router refrains from prioritizing the requests and returns all URLs associated with each content ID to a client reader program in the consumer's device. The client program either displays a web page with hyperlinks to each URL, or it executes rules to select which URL or set of URLs has priority, and then re-directs (e.g., sends a metadata request) to the URL with the highest priority.
  • A single CID may be associated with metadata responses from several different participants (search engine provider, metadata aggregator, distributor like iTunes, Record Label, advertiser, etc.). In this case, the registrant of the CID specifies the URL or URL list corresponding to each of the metadata responses for that CID. In addition, the registrant specifies a rule governing the conditions in which the different metadata responses are triggered. The registration process is facilitated by a graphical user interface accessible via a network, such as a web interface enabling the registrant to list for each metadata response:
  • 1. the URL or set of URLs for the desired metadata response;
  • 2. the conditions that cause the routing system to select the metadata response.
  • The conditions are a function of the attributes of the routing transaction. These attributes fall into two categories: user attributes and non-user attributes. The user attributes are obtained by the router through the user registration process, in data provided in the metadata request, and/or in data derived by the router based on history of requests from the user. The user can specify metadata preferences through registration or in the metadata request. Preferences can include likes/dislikes about content genres, likes/dislikes for product/service advertising, preferences in content format, preferences for types of media players and media player settings, device capabilities, etc. Non-user attributes include attributes about the transaction derived by the system, such as the time, geographic territory, history of transactions relating to the content object or content objects in the same genre as the content object, type of object, etc. For example, the router's usage data provides information about the popularity of the content object, correlation to the preferences of others who have requested metadata for the object, etc. In some applications, the reader packages information about the object along with the extracted content ID, such as the object type and format. This enables the metadata response to be tailored to the object type and format that the user has the capability to render on his or her device.
  • A typical rule registration interface enables the registrant to select different URLs depending on the attributes of the routing transaction. For example, rule 1 dictates: use URL 1 when artist preference=TRUE; Account status=active subscriber; and Advertising Tolerance=LOW.
  • Rule processors can be implemented within and executed within one or more different locations along the metadata request and response paths. Before enumerating these locations, let's review a summary of the locations in a CMDS embodiment. The first location is the requesting client, which is within the consumer domain shown in FIG. 9. The next is the router system, which itself, has different components that can contribute to rule processing. For simplicity, FIG. 9 shows the rule processor as a single block, yet the rules processing function may be distributed. The next location along the path is either back to the requesting client, or to metadata source to which the request has been re-directed by the router.
  • At content identification and metadata request, rules are executed to control:
  • 1. what type of CID the client extracts (is client going to trigger fingerprint based CID retrieval, DWM CID retrieval or header/footer CID retrieval?)
  • 2. what client sends to the router (one or multiple CIDs)
  • At the router, the rules processor executes a rule or rules to control:
  • 1. Which CIDs, if multiple CIDs for one content object are provided, has priority?
  • 2. Which URLs the router returns to client (e.g., single/multiple URL per each CID, or does one CID dominate?)
  • 3. Whether the registrant of a content object has requested that the request be re-directed to a URL of a device it controls, which in turn, provides a metadata response to the client.
  • At the client, upon response from the router or other device per above, the rules are executed to control:
  • 1. what client displays (are URLs prioritized or not?)
  • 2. what client sends to web server in response to packet returned by router.
  • At the client, a client program used to consume or manage content is equipped with a reader for one or a few types of content IDs. This client controls what IDs get sent to the router and thus, controls which entities are linked to.
  • Alternatively, there are multiple readers, each acting independently according to their own rules.
  • Alternatively, the router sends all URLs for metadata sources associated with corresponding CIDs back to the client and the client decides which one to use. The client may also determine what type of context data it provides to the metadata source, such as GPS information, depending on whether the user wants to get or has paid for location based services.
  • To respect user privacy, user preferences can be maintained solely at the client. The client maintains control over whether and when the user preferences and attributes are forwarded to the router and/or metadata source/repository. In some cases, they are not provided at all, and the client aggregates and then tailors the metadata response from multiple URLs based on user preferences. In other cases, the client forwards the preferences to the metadata source directly after receiving its URL to the router. In this case, the router does not get access to the user preferences.
  • At the router, the router determines based on context or other information from the client how to re-direct the client to a metadata source located at a URL.
  • The metadata source at the URL sends different types of metadata or links to a requesting client, which enables the client to pick or the user to pick from among metadata/links presented in a user interface of the client.
  • As noted above, the metadata responses may be prioritized based on user preferences. In such embodiment, the client is programmed to get or learn user preferences and prioritizes links to metadata returned by the system accordingly.
  • In another embodiment, the router system provides additional services for managing users, including, for example, authenticating users and managing user accounts. This can be explicit management of information supplied by the user, or management of user transactions based on consent provided by the user. In either case, the router derives a user classification based on information it has gathered about the user's preferences for consuming content. In one embodiment, the router system classifies routing transactions based on the user's willingness to pay for products and services. Those willing to pay for premium content get a metadata response with opportunities to access this premium content, while those not willing to pay get no fee metadata responses that are subsidized by advertising, for example. Further, if the router has authenticated the user and the user's account status, it re-directs the user to URLs that are secure electronic commerce sites, initialized based on the user's identity. This enables the routing system to link the user directly to electronic transactions without requiring the metadata source to handle the authentication processing.
  • One particular example of the authentication service in the router is to enable direct linking into a Digital Rights Management (DRM) server or other e-commerce server, in a state where the client is pre-authenticated. The client and router provide authentication information needed to complete an electronic purchase through private and/or encrypted data fields, or a combination of public and private fields, where private only readable by certain entities.
  • Another service of the router is track the flow of content object sharing over networks. Digital certificates, or other identifying information of users, is used to detect different users that request metadata for a particular content object, which is uniquely identified via content identifier. This tracking of content object flow by content ID and user certificates provides data to the content owner regarding how content objects flow through networks of users. This provides another means to identify an affinity group for content and tailor content and metadata distribution to the preferences of the affinity group. This tracing method traces content objects as they are processed by new and different users. Each time a request for metadata is received, the router logs the request and also records user identification for the request, if available. The router analyzes this log to identify the path of the content object through new users.
  • As demonstrated in the example above, the router enables metadata responses to be governed by a hierarchy of rules distributed across the system, including macro rules implemented in the router that specify URLs to return, and micro rules implemented in the client that further control how the client presents and links to these URLs.
  • Examples of micro rules include: rules governing how authentication of a user occurs to enable access to different type of metadata sources, (e.g., use of identity triangle—what user knows—password, has—access token, ID card, and is: biometric login and user verification). The level of authentication dictates the nature of the metadata provided (what links, metadata, etc. are provided). The level of authentication also dictates purchase limits and usage rights (rights for redistribution or sharing with other users).
  • An additional service of the router system is the support for handling private and public fields in the data packets sent as metadata requests to the router. For example, the client device in the consumer domain sends public and private fields (public field is generally readable, private field is packaged by client and likely encrypted, intended to be read only by authorized service, such as secure transaction server that the router links to). The router uses the public field, for example, as data input for rules determining the URLs for the metadata responses. The metadata sources decrypt and use the data in the private fields to provide tailored information to the user, while keeping the user's information private and secure.
  • The rules in some systems also govern the amount of network resources allocated for a metadata transaction. In particular, the size of the socket, data pipe or channel opened between the metadata source and the client is a function of client's authentication level and user account status (e.g., indicating willingness and ability to pay).
  • There are a number of ways to propagate rules through the network infrastructure. In one embodiment, rules are pushed to client through content auxiliary channels in the content objects (such as file header/footer, encryption container, digital watermark, etc.) In another embodiment, rules are distributed with media consumption programs, such as media players, like Windows Media from Microsoft Corporation and iTunes from Apple Computer, etc.
  • Each component (client, router, and metadata source) executes its own set of rules established based on what it has learned about the user.
  • As noted above, the input to the rules includes user and non-user attributes, including, but not limited to user demographics, device platform, age, geography (GPS), time, search engine metrics that prioritize results for content searches based on the user's search history, which indicates preferences for types of content.
  • The input to the rules includes preferences derived from user behavior, content consumption history, most frequently accessed content, etc.
  • Another input includes content type, which enables the content to be targeted at content type preferences of the user or the user's rendering equipment. Also, the rules specify different metadata responses based on whether the client device is operating in on line or off line mode. Offline mode instructs the client to re-direct a metadata request to a metadata source in its cache of metadata, which serves as a local metadata repository.
  • The router system provides a number of opportunities for revenue generating data services. One such service is revenue sharing model in which fees collected for distributing metadata are shared with content owners as a function of usage data. In an embodiment of this service, the router tracks usage data corresponding to metadata requests for content objects and the usage data for these content objects is used to determine revenue sharing among content owners and distributors. The router tracks usage data and this usage data is used to determine how artists that created the content get a share of fee collected under a license in which collected fees distributed to the artists based on metrics dependent on the distribution of metadata requests for the content objects. Additional models of revenue sharing are fee based, where a portion of the fees paid by consumers for metadata responses are distributed to the content owners.
  • Another service of the router is an auditing function. One such audit is checking the validity of URLs supplied to it during registration. The router periodically checks URLs in its database to make sure they are current, valid, responsive, etc. The router also provides metadata request trend analysis that enables the metadata sources to anticipate metadata request work load and allocate more resources to serve metadata based on the anticipated workload.
  • The router itself is distributed and has instances of itself that are mirrored across the network. The router specifies to the clients which among several URLs to use for subsequent request for routing services.
  • Another service of the router is to track the form of content identification used to identify the content object for each transaction. This enables the router to flag content for subsequent content labeling, including layers of different content IDs. For example, a content object identified using a fingerprint is flagged for embedding a digital watermark. The digital watermark provides a finer grain identification than the fingerprint by differentiating among copies of the same content. The content ID in the watermark is then registered and associated with metadata responses that are tailored to a particular copy of the content object.
  • More on User Generated Metadata and Rules
  • Above, we described how to incorporate user generated metadata into the metadata routing system. The routing system has the flexibility to incorporate its own metadata repository for user created metadata, to link to user generated metadata repositories maintained by others, and to integrate a combination of both types of metadata sources. By establishing an interface that allows metadata providers to register links between content and metadata sources, the routing system has the flexibility to integrate different metadata sources into one unified metadata service. For example, the routing system maintains links between the identifier (or identifiers) for a piece of content (e.g., song, TV or radio program, movie, Podcast, advertisement, etc.) and sources of metadata, including user generated metadata within or outside the routing system's domain. The database, in particular, stores the unique identifier of the piece of content and associated URLs of the user generated metadata for that piece of content. In particular, the routing system can specifically link to the user generated metadata maintained in different user generated metadata sites on the Internet. Examples of web sites that have implemented systems for user generated metadata include Flickr and Del.icio.us, which provide web services operated by Yahoo. These systems enable users to apply metadata, called “tags,” to pieces of content. In particular, Flickr allows users to upload images and add tags to images within the context of the Fickr system. However, the tags are not persistently linked to content, and therefore, as content moves outside the bounds of the Flickr system (e.g., the Flickr servers or connected client device), the tags are easily lost. The routing system provides a means for persistently maintaining links between a content object and its metadata, even as the object is distributed across different domains, devices and networks. Further, it allows a content object to be persistently linked to several different user generated metadata sites.
  • When these capabilities of persistent linking across different sources of metadata are combined with rules based processing, the system fulfills a more sophisticated array of metadata requests across a broad array of metadata sources. Each piece of content becomes its own node or portal interconnected with disparate sources of metadata across heterogeneous distribution methods, networks, content formats, and devices. In addition, rules processing in the system filters metadata according to user preferences.
  • It is anticipated that in many applications, users will prefer user-community generated metadata over the original metadata from the content owner or distributor. An example is user generated metadata that assigns content ratings to content for parental control. In particular, a user may trust the content rating applied by the trusted community of which he or she is a member over the rating applied by an industry group. Today, as long as the user stays within the domain of a provider of trusted content (e.g., within a connected session to a web service), the user can take advantage of the metadata associated with the content in that domain. However, when content travels outside the domain (e.g., is stored in a device that does not respect or even understand the protocol or metadata from the domain, goes offline, is trans-coded or played, is emailed to a friend), then a scheme is needed to re-associate metadata and apply the user's preferences. The routing system supports this re-association and enforcement of user preferences by allowing the user to request metadata with the user's rules that specify that, in certain contexts, the content rating in the metadata from the user group is to be used instead of the industry content rating.
  • A typical usage scenario of the system to apply ratings is as follows: user encounters an content (in any of a myriad of ways: e.g., receives from a friend, downloads from a social networking site, records from a live broadcast, searches an archive); the user's device includes an application that incorporates the reader, which extracts a content ID from the content (or alternatively, the user selects the content, which triggers transmission of it to a remote reader that does the same); the reader forwards the content ID along with user preferences to the routing system, the routing system extracts the related metadata from linked sites specified by the associated URLs, the routing system applies the rules applicable to the content, including those based on user preferences, and sends back a metadata response to the user that informs the user of the rating and/or the reader automatically enforces the rating by controlling play out of the content.
  • These metadata sources, as noted, can be dynamic metadata sources based on dynamically generated metadata from searches, RSS feeds, and mash-ups. The URLs identify more than just IP addresses of physical devices, and extend to dynamic metadata sources in virtual environments such as Second Life (URL in protocol for Second Life adheres to SLTP protocol).
  • Federated Content Identity
  • The concept of federated identity has emerged in response to demands for a user-friendly and interoperable frame work for establishing user identity across disparate domains (e.g., across the security walls erected around different entities' databases, such as the metadata services of a content distributor, content owner, social networking site, metadata tagging sites like Flickr and del.icio.us). Simply stated from the user perspective, “federated identity” is an identity management framework that enables the user to access disparate data services, each with their unique secure log in procedures, with a single log in. As described below, embodiments of the routing system leverage federated identify technologies, such as SAML and WS-Trust, to establish and enforce user identity for users of the routing system, including both providers and consumers of metadata.
  • The disparity of content identification and metadata protocols creates a similar demand for a scheme of federated content identity. The routing system satisfies demand by creating a framework that unifies disparate content identification technologies (such as digital watermarking, content fingerprinting, headers in files whether un-encrypted or part of an encryption container) as well as incompatible protocols for content identifiers. Further, it unifies disparate sources of metadata, as well as different metadata formats. In short, it provides cross-platform content identity and metadata services. A typical usage example to leverage these capabilities is as follows: a user wishes to find all metadata relating to a particular concert tour associated with a particular song; the user submits the user preference “concert tour” and “year=2005”) for the song; the reader extracts one or more content identifiers from the song, packages them with the user preferences, and sends a request to the routing system; the routing system establishes a federated content identity for the song knowing the ID providers from the reader and the content IDs; the routing system uses this content identity to find linked sources of metadata in its database (e.g., gets the URLs of these metadata sources); the routing system aggregates the metadata responses from these URLs from different domains; the routing system applies the user's preferences and returns a metadata responses that relate to concert tour and the year 2005 to the user. The user need not concern herself with the details of identifying the content or gaining access to disparate metadata sources.
  • Public Interfaces for the Metadata System, Mash Ups for Metadata and Metadata Usage Statistics
  • The routing system establishes an interoperable system for associating content with metadata across disparate content identification and metadata systems. In so doing, it also provides a mechanism for monitoring consumption of content and metadata across disparate domains of content origin and consumption. The support for user generated metadata further enables new sources of metadata which users will likely value as much or more than the content itself. This is particularly true for a system that analyzes metadata usage and content usage and makes information available as additional metadata linked to the content because it facilitates the user's ability to search for content that is of particular interest to him. One of the must compelling types of metadata is the metadata that identifies content by its popularity within certain groups (e.g., popularity as defined by tastemakers, affinity groups, niche genres for content, etc.).
  • In view of this important function of identifying compelling metadata, there is a commensurate value in an interface that efficiently unlocks this value by establishing programmatic access to the metadata and metadata statistics. Within a single system for metadata generation, programmatic interfaces are provided for that particular system. However, an embodiment of the routing system described in this document provides a programmatic interface across heterogeneous content identification technologies and metadata sources, and further, provides a programmatic interface to the metadata usage data that is collected across these heterogeneous metadata sources and linked back to individual content items through a variety of content identification technologies.
  • Examples of programmable interface technology that the routing system leverages include mash-ups built on Web 2.0, Programmable web, and semantic web programming constructs and Application Programming Interfaces (APIs). The implementer can use these technologies to build the metadata response aggregator, traffic monitor, and rule processor detailed above, as well as to build their own versions of these modules on top of the routing system. For example, the system can be embodied in a hierarchy of mash-ups, each providing additional functionality on top of the APIs of other mash-ups of metadata services provided by the system. The routing system, by providing a mechanism of linking metadata sources to content identifiers, creates a Content Object Name Service (think of it as a Domain Name Service for content items). Further, the response aggregator, rule process or and traffic monitor build on top of this service, which as noted, can each be implemented as mash-ups of the routing system. When these metadata services are constructed in this form of interconnected mash-ups, the routing system provides a form of DNS for content metadata mash-ups.
  • Measuring Metadata Popularity and Tastemaker Identification
  • The tracking of content and metadata consumption in the system and subsequent publishing of this data to the user community enables user's to more effectively identify metadata that matches there preferences. It also provides an opportunity for content owners to analyze these preferences and re-package content with popular user generated metadata. Content owners can also identify unique affinity groups and tailor new releases to the preferences of these groups. As noted above, the system tracks several forms of usage data. These types of usage data include monitoring traffic of content objects (e.g., tracking object distribution), traffic of metadata requests (e.g., number of requests for particular metadata, or metadata from a particular source), and user preferences and rules processing (e.g., user preferences derived from metadata analysis, such as the affinity group analysis). With the support for dynamic metadata (metadata generated over time as an object is consumed) and the means to measure popularity of metadata and its providers, the system identifies high value metadata which provides an opportunity for content object owners and advertisers to package this popular metadata and monetize it (sell it or sell advertising presented with its consumption by users).
  • The system also is able to capture a historical archive of metadata generation and consumption data, which further allows content and metadata distribution to be analyzed to identify transient metadata captured from points in time to be packaged and monetized in a similar fashion. For example, dynamic metadata can be packaged with the content objects that caused its generation and distributed. Examples in include content packaged by tastes of an affinity group of users, a period of time, a geographic market, etc.
  • CMDS Example Implementation Summary
  • The Content Metadata Directory Services (CMDS) provides a global trusted directory service that connects consumers of identified content to content-provider authorized and managed metadata databases and other digital resources.
  • It solves the problems created by the fact that digital distribution separates content from packaging, new 1-1 marketing opportunities are not being optimally utilized for content distribution, and digital distribution is moving forward with proprietary channels that make the value chain more complex rather than simpler. The CMDS system provides all existing value chain participants an environment to agree upon metadata usage and manage their proprietary metadata, as opposed to being another proprietary metadata repository. It also provides cross-sell/up-sell e-commerce opportunities. The CMDS system is interoperable with all content identifiers, PC and mobile devices, and enables usage reporting with vital marketing statistics.
  • The CMDS system standardizes three components (1) Registration Interface, (2) Resolution Interface and (3) Router Requirements. The interfaces are specified in terms of XML-based Web Services, an existing industry standard, for simplicity and interoperability. The router requirements guarantee that the system functions properly and maximizes value to vendors and users. These minimal specs create a system that is simple for vendors and users to interact with, while providing extremely flexible workflow and architecture. For example, CMDS can either (1) create unique content identifiers (CIDs) that can be embedded with any technology, such as digital watermarks (DWM) or signed headers, or (2) utilize CIDs created by pre-existing systems such as content fingerprints (a.k.a. robust hashes), Electronic Product Codes (EPC), IFPI's Grid, and URI. Furthermore, users can learn more about artists, similar content and related items, and purchase content and related items.
  • The CMDS system provides users with valuable information and simple purchase options, and helps content owners and retailers increase ROI by expanding their knowledge of content usage and making it easier for consumers to buy content and related items.
  • CMDS Implementation Definitions
  • The terms used in the following sections are defined here, in alphabetical order.
  • Term Description
    Central Database A global, master Database (where Database defined below).
    Central Handler A global, master Handler (where Handler is defined below).
    Central Router A global, master Router (where Router is defined below).
    Content ID (CID) A unique content identifier. It is different for different pieces of content, and
    can be unique for different copies of the same content. The combination of the
    CID with ID Provider ID and ID Version is globally unique. These additional
    fields allow ID Providers to embed and detect a smaller namespace (i.e. fewer bits)
    and the system to work with all pre-existing ID systems. However, these
    additional fields also require slightly more complexity in the Router.
    Content Metadata A system for Content Providers to register Content IDs and URLs, and Users to
    Directory Services resolve Content IDs into URLs to obtain more information about the content
    (CMDS) where the Content Providers manage their proprietary metadata.
    Content Provider The provider of the content, such as the content owner and retailer, or any
    company with rights to distribute content and/or content metadata.
    Database The second component of a Router which is used to store the Content
    Provider's links to their proprietary metadata, and store vendors' or users'
    contact information.
    Note: Often the term is used in the plural because it can refer to several linked
    databases.
    Digital Watermark Data embedded within the content that does not degrade the content's quality
    (DWM) to end-users, but is reliably detectable by enabled hardware or software.
    EPC Electronic Product Code as specified by EPCGlobal.
    Fingerprint A fingerprint identifies content from features of the content. It is also known as
    a robust hash or content based identification (and should not be confused with
    a forensic DWM).
    Handler The first component of a Router which handles the registration or resolution
    requests and responses.
    Note: Often the term is used in the plural because it can refer to several linked
    handlers.
    ID Provider The company that provides the technology to identify the content and interface
    with a Router.
    ID Provider ID The unique ID assigned to the ID Provider. An ID rather than name is used so
    that the combination of ID Provider ID, ID Version and CID is a globally unique
    number (when the CID is a number, such as when created by this system), and
    numbers are faster to lookup in a Database. (If the CID is pre-existing, such as
    URI, it may be formatted as text.)
    ID Version The ID version provides the version of the CID algorithm. It enables the ID
    Provider to re-use the same IDs in different version of their algorithms, such as
    for different content types, as well as to use various ID formats. The ID Version
    is different for each algorithm that uses overlapping CIDs for an ID Provider.
    Mirror Database An exact duplicate of the Central Database.
    Mirror Handler An exact duplicate of the Central Handler.
    Mirror Router An exact duplicate of the Central Router.
    Resolution Request The interface defining the message sent to a Router to request URLs (or other
    Message information).
    Resolution The interface defining the message sent from a Router in response to a
    Response Message resolution request.
    Registration The manager of the CMDS system. For a public system, as used in B2C
    Authority environments, the Registration Authority is a trusted 3rd party vendor. There is
    one public Registration Authority. For a private system, as used in B2B
    environments, the Registration Authority is usually the private system provider.
    There may be numerous private Registration Authorities.
    Registration The interface defining the message sent to a Router to request registration of
    Request Message CIDs, URLs, vendors or users.
    Registration The interface defining the message sent from a Router in response to a
    Response Message registration request.
    Request Code A key part of the registration or resolution request message that describes the
    desired action for the message.
    Router The backend system that handles registration and resolution. It includes two
    main components, a Handler and Database.
    Note: Often the term is used in the plural because it can refer to several linked
    routers.
    User The end user of the system. For example, it may be a consumer linking to
    more information via their PC Multimedia jukebox, or a movie critic linking to
    current marketing materials via a closed, private system.
  • CMDS Background
  • The Content Metadata Directory Services (CMDS) system is needed since content identification technology cannot provide useful information without accessing a backend system that links the ID to relevant information (a.k.a. metadata). It is a router-based system, which is beneficial to a central metadata repository, so that content providers can manage their proprietary information and content can be routed to this information from any location.
  • CMDS provides a global trusted metadata directory service that connects consumers of identified content with authenticated “origin of source” databases and other content-provider authorized digital resources.
  • CMDS enables content owners to:
      • Leverage in-house digital asset management system
      • Gain from economies of scale
      • Act as the content authority over their own digital assets; and
      • Address digital distribution issues from a single, unified approach, rather than a fragmented approach.
      • Cross-sell/up-sell
  • CMDS also provides consumers metadata and e-commerce opportunities
      • Focused on routing
        • Content Providers manage their proprietary information
      • Enable eCommerce for all value chain participants
        • e.g. Both content owners and retailers can embed CIDs
      • Interoperability with all content identity provider technology
      • Compatible with both PC and mobile devices
      • Interoperability for multiple ID Providers whom license a common algorithm
      • Enable usage reporting and vital marketing statistics
    CMDS System Embodiment Overview
  • A content identification system has five main components: registration, embedding/calculating, reading, resolution, and a router, as shown in FIG. 4. These components can be grouped into content identification and content routing (e.g., CMDS) categories. The content identification components include embedding content identification (or calculating it for fingerprinting) and reading content identification (a.k.a. detection). The content owner usually handles the embedding and the consumer product usually handles the reading.
  • The CMDS components include:
  • 1. Registration Interface
  • 2. Resolution Interface
  • 3. A Router
  • These three components are standardized in the companion specification such that any content identification technology can interoperate. The example implementation is also optimized for both technologies, such as DWM, where the fewer bits in the identifier the better, and for technologies, such as URI, which have non-integer namespaces. The example implementation has the flexibility to be optimized for a PC or mobile environment (or any future hybrid environment).
  • In FIG. 4, the content is labeled Protected and Identified Content since it is identified when distributed due to this process, and may also be protected by other means. Although the focus of this example implementation is using identification to enhance content, the identification may also be used for protecting the content and/or other technology may be used to protect the content. When the identification is used to both enhance and protect the content, there are mutual benefits, such as pirated content that doesn't have the identification does not provide the enhance features to the user. In other words, this implementation is not a replacement for content protection, but synergistic with it.
  • A Registration Authority handles these three content routing components. For a public system, as used in B2C environments, the Registration Authority is a trusted 3rd party vendor. There is one public Registration Authority. For a private system, as used in B2B environments, the Registration Authority is usually the private system provider (and usually the only ID Provider). There may be numerous private Registration Authorities, and each system most likely interact with another system in this B2B environment.
  • This system's design allows the Content Providers (including content owners, such as Record Labels, Movie Studios and Stock Photo Agencies, and retailers, such as Apple iTunes, Napster, WalMart, Hollywood Video, etc.) to interact directly with the user, such as a consumer, as shown in FIG. 5. This enables the Content Providers to manage their own proprietary data. In other words, the usage model is the user interacts with a router, which redirects the user to the Content Provider for metadata and e-commerce opportunities.
  • Thus, the system routes requests for metadata to Content Providers, such as content owners and retailers. In other words, the Router includes a Database that mainly contains CIDs and URLs that link to metadata and e-commerce opportunities, which are stored by the Content Provider, not at the Router.
  • The system has a distributed architecture, as shown in FIG. 7. At this time, only the duplicates of the Central Router (labeled Mirror Routers) are specified. These Routers can have separate Registration and Resolution Routers. There will most likely be more Resolution Routers since there will be more resolution requests. In the future, Cached Routers will interact with the Mirror Resolution Routers and only save recent resolution requests for efficient responses. Cached Routers are not applicable to registration requests since these requests occur neither often nor repetitively and are immediately forwarded to the Central Router. The example implementation requires the reader to periodically request the address of the Router that it should be utilizing for registration and resolution; thus, the system can dynamically change configuration. It is unnecessary for the Central Router and Mirror Routers to request addresses, as they are all run by the Registration Authority and, thus, know each other's addresses.
  • A Router consists of a Handler and Database. A Handler accepts the registration and resolution requests, quickly obtains the required information and sends the registration and resolution responses. It may be a single software thread running on the same machine as the database, such as for a local low-quantity implementation, or it may quickly hand-off requests by request code or ID Provider (as both fields are in the XML message header) to various request handlers that are linked to a local request Databases across multiple CPUs, as shown in FIG. 6.
  • Workflow Example
  • An exemplar workflow demonstrating content owners and retailer registering contact information and content, and consumers linking to metadata and purchasing content is shown in Table 1. The example assumes that the ID Provider and two Content Providers, a content owner and retailer, have received their respective identification and passwords from the Registration Authority. It also assumes that ID Providers have registered contact information (via UpdateIDProvider request code), and distributed embedder and reader software. The request codes are shown in italics between the arrows for messages sent to the router.
  • TABLE 1
    Workflow Example
     Content Provider Router User
    1. Content owner registers initial
    contact information
    → Update ContentProvider →
    2. Content owner notified of success
    3. Content owner creates a CID
    → CreateCID →
    4. Content owner receives CID
    5. Content owner registers Primary
    URL
    → Reg URL →
    6. Content owner notified of success
    7. Content owner registers
    additional URLs
    → RegURLs →
    8. Content owner notified of success
    9. Retailer registers initial contact
    information
    → Update ContentProvider →
    10. Retailer notified of success
    11. Retailer registers a pre-existing
    CID
    → RegCID →
    12. Retailer notified of success
    13. Retailer registers Primary URL
    → RegURL →
    14. Retailer notified of success
    15. Consumer A listens to
    his PC
    Jukebox and clicks on the
    “more info” button
    based upon the URI
    in the audio content
    ← ResURLs ←
    16. Router provides
    consumer with URLs
    from content owner
    and retailer, some of which
    create dynamic web pages
    16(a). Consumer A learns
    more about the
    content and later
    purchases a CD by the same
    artist at the store.
    17. Consumer B decides to
    register to win a hybrid car
    ← RegUser ←
    18. Consumer B is notified
    of success
    19. Consumer B uses cell
    phone to learn
    more about a film via
    taking a picture of an ad and
    reading a DWM
    ← ResURLs ←
    20. Router forwards URLs to
    consumer B's cell phone.
    Since the user is
    registered, the URLs
    includes lists of local theatres
    playing the movie and favorite
    local stores selling the DVD
    20(a). The consumer buys the
    DVD from a local store!
  • Architecture Example
  • The architecture is flexible since the specification defines an extensible messaging interface and router design.
  • An example architecture which enables both content owners and retailers to use the system is shown in FIG. 8. Many other architectures or expansion of this architecture are possible, but this architecture is expected to be the most used architecture. This architecture enables the workflow discussed in the previous section, as well as many other workflows. The architecture includes:
      • Content owner environment with embedding/calculating software that has a registration interface to embed identification in the content (or store its fingerprint)
      • Retailer environment with embedding/calculating software that has a registration interface to embed or add identification to the content (or store its fingerprint)
      • A Router consisting of a Central Handler, Central Database, Mirror Handlers and Mirror Databases
      • Protected and identified content in cyberspace
      • User Environment with reader software that has a resolution interface to link the user to more information, as well as a registration interface to register the user, if the user opts-in to send secondary personal information
    Usage Scenario Examples
  • These usage scenarios help demonstrate the flexibility and capabilities of the specification. They also discuss what technically happens in the background (with request codes and other XML tags in parenthesis)—all in italics since they are technical details.
  • Consumer Linked to Metadata and eCommerce
  • This usage scenario includes most aspects of registrations for ID Providers, Content Providers, e.g. content owners and retailers, and Users, as well as Users, e.g. consumers, linking to metadata and eCommerce. It demonstrates several key aspects of the system, and is most similar to the workflow example in Table 1.
  • ID Provider Registration
  • The first step is registration of at least one ID provider. The ID provider receives an ID and password from the Registration Authority via a secured process, such as a mailed letter or telephone call and company and contact person security check. Next, the ID provider securely registers their contact information with the registration authority, either through the Registration Authority's software (via UpdateIDProvider) or through an interactive secure web page. The ID Provider is notified of success or any errors.
  • In the background, the ID Provider embedder and detector software contains the ID Provider ID, and submits it, along with an ID Version of the embedding or detection algorithm, with every request.
  • Content Owner Registers as Content Provider
  • The second step is registration of a content owner. The content owner receives a Content Provider name and password from the Registration Authority via a secured process, such as a mailed letter or telephone call and company and contact person security check. Then, the content owner uses their embedder or related software received from the ID Provider to securely register contact information (via UpdateContentProvider). The embedder software verifies the response, and notifies the content owner of success or any errors.
  • Alternatively, the content provider could have used the Registration Authorities secure web site to interactively register their contact information.
  • Content Owner Registers New Content
  • Once the Content Owner has registered, they securely register their content. First, they use the embedder or related software to obtain a unique Content ID (via Create CID). Afterwards, the Content Provider registers two primary URLs, one for PCs and one for mobile devices (via URLType XML tag with Full or WAP data entry), as well as four additional URLs, two for PC and two for mobile, (via six calls with RegURL request code). For example, for both PCs and mobile devices, the primary URL provide static information about the movie Fantasia from Disney, one additional URL provides information about songs in Fantasia, and the other additional URL provides items for sale regarding Fantasia from Amazon.com, using a dynamic web page via a URL including search terms based upon the CID. The software application verifies the response for success and let the content owner know about the success (or any errors).
  • In one alternative, the content owner could enter multiple URLs in the software's GUI with checkboxes for fully functional or WAP. In the background of this configuration, the software uses the request grouping method to obtain the CID (via CreateCID), register the primary URLs (via two calls with RegURL), and additional URLs (via two calls with RegURLs). The Routers handle the timing such that the CID is registered before the URLs.
  • In another alternative, the content owner can use the Registration Authorities secure web site, and interactively register the URLs, one-by-one.
  • Retailer Registers as Content Provider and Registers Content
  • A retailer, assuming they have worked out rights with the content owner, can also securely register as a Content Provider with the Registration Authority, obtain a Content Provider name and password, and register contact information (via UpdateContentProvider). For example, the retailer could be Apple iTunes store. Then, when the retailer prepares to sell content, they request a CID (via CreateCID) and add two URLs, one primary URL to sell songs by the same artist (via RegURL), and one additional URL to sell similar songs (via RegURLs).
  • Anonymous User Linking
  • When a user receives a copy of the content with the registered CIDs, the user can request and receive more information from their multimedia player. Preferably, the multimedia player includes a reader plug-in that always scans for CIDs, checks that URLs are registered for this CID, and displays a symbol or “more info by <company name>” icon to let the user know that the content is enhanced. This scanning process also makes the response time immediate since CID detection has already been performed.
  • When the user selects to receive more information, the user receives five web links with brief descriptions. There are three links from the content owner: one with the film history, one with related song information, one with items for sale regarding Fantasia from Amazon.com. There are two links from the retailer whom sold them the movie: one where they can buy songs by the same artist, and one where they can purchase similar content. The user can click on the links to visit the displayed web sites.
  • In the background, the reader software requests the URLs (via ResURLs) with a group containing two requests, one for the content owner's CID and one for the retailer's CID. As the last step, the reader software parsed the returned URLs and displayed them to the user.
  • If the CIDs are embedded by two different ID Provider technologies, the user will see two different “more info” buttons, e.g. one “more info from Disney” and one “more info from Apple iTunes Store” and the depending upon the user's selection, the corresponding request is sent and response is displayed.
  • Mobile User
  • When a cell phone user identifies content, he/she links to the WAP or WMI version of the registered URLs, assuming the Content Provider registered such URL types (via XML Tag URLType with WAP or WMI data during registration or resolution). Information, formatted for their small screen, is displayed. In addition, preferably, the user can select the display of only a primary link (for content owner or retailer) so that the Content Provider's information is displayed immediately after selecting to receive more information (without the user having to select again from a list of URLs and descriptions since they may be driving).
  • For example, when the cell phone user hears a song that they like on the radio, they can identify the song (via a DWM or fingerprint) and link to more information. Similarly, the mobile user can identify songs they are listening to on their PDA phone and link to more information.
  • User Registration
  • Another user decides to register personal information to obtain a chance to win a new hybrid car. They register from the reader plug-in for their multimedia player (via RegUser). The software application verifies the response for success and lets the user know about the success (or any errors). The user can update their information at any time (via Update User), or decide to opt-out for one specific link or all future links.
  • Registered User Linking
  • When this registered user requests more information about the video from the reader plug-in software (via ResURLs), the same five links as displayed for the anonymous user are displayed, as well as links to additional theatres in the user's zip code that are playing Fantasia or similar movies, as well as stores in the user's zip code that carry the related merchandise. In addition, if the Content Provider (e.g. content owner or retailer) maintain information for each username, they can suggest other items based upon the user's previous purchases, or produce a “instant chat” icon if this is a preferred customer who has purchases several things in the past (equivalent to nicely dressed shopper or frequent shopper card holders getting better service in the physical store). Someday this user believes they will be one-click away from purchasing any of the listed items, when all stores share the same secure user information.
  • Content Provider and ID Provider Reports and Billing
  • At the end of the month (or any other time), the Content Provider (e.g. content owner or retailer) logs onto the Registration Authorities web page and securely views usage data for each of their registered CIDs. They see that their new movie is hot in the northeast part of the USA and Canada, especially by 8-to-10 year olds around 7 PM EST. They also see that its usage has been starting to decline, and represents 20% of their current resolution usage for this age group, indicating that it is time to release a new movie with this target audience. Finally, they can see their costs and billing options, such as automatic withdrawal at fixed amounts or monthly billing.
  • The ID Provider can also log onto the same web site and view aggregate usage data for all of the CIDs registered using their technology. However, they cannot view stats by individual CIDs since that is owned by the Content Provider.
  • In the background, each Router is saving log files for each hit, and, preferably, daily processing the log files to aggregate usage data to provide real-time interaction with these stats, as well as automatic capabilities to email reports to the Content Provider and ID Provider.
  • Fingerprints/Robust Hashes Link Content to URLs
  • When using fingerprints to identify content, the fingerprint is calculated from the content and entered into a database. Then, when trying to identify content, the fingerprint is calculated, and matched to the closest fingerprint in the database that also falls within a certain threshold of certainty. The fingerprint is usually a collection of sub-fingerprints, especially when content is streaming. As such, the fingerprint is not a unique content ID, but the fingerprint database links the fingerprint (i.e. collection of sub-fingerprints) to a unique content ID.
  • Content Provider Registration
  • The Content Provider can either (i) utilize the fingerprint provider's proprietary content ID system and register pre-existing CIDs with a Router (via RegCID), or (ii) request a unique CID (via CreateCID) and use it in the fingerprint database. Then, the Content Provider can register URLs to link to the CID (via RegURL and RegURLs).
  • In case (i), CID uniqueness is guaranteed since the fingerprint database guarantees the CID is unique in that database, and the combination of the CID with ID Provider ID and ID Version guarantee global uniqueness. In case (ii), the CID is guaranteed to be unique by the Central Router, and the same combination is globally unique. The ID Version is uniquely defined for each fingerprint algorithm and related database for each ID Provider.
  • Linking Users to Metadata with Fingerprints
  • The user selects to receive more information as with any CID and receives URLs and short descriptions (via ResURLs). The user then clicks on the URL with the information that he/she wants to receive.
  • In the background, when a user requests to receive more information for content identified with fingerprint, the fingerprint reader calculates the fingerprint, sends it to the fingerprint server (either running on the fingerprint provider's server or on the Central Router), the fingerprint server determines the CID from the fingerprint database, returns the CID to the reader, and the reader uses the CID to request the URLs (via ResURLs) from the Router. The Router, having access to the IDProviderID, ID Version and CID data in the resolution request message, uses this globally unique combination to lookup the correct URLs. The proper ID Version is known by the reader since it used that version of the algorithm to determine the CID.
  • Linking Via Other ID Systems, Such as EPC
  • In some cases, a different Registration Authority will have previously provided a unique identity, possibly for other purposes, and it is optimal to be able to use this unique content ID in this system. For example, the Electronic Product Code (EPC) provides unique IDs with radiofrequency identifiers (RFIDs). Similarly, IFPI's GRid provides unique content IDs. Or, 4C provides unique IDs with Verance's DWM. Furthermore, an ID Provider could generate their own unique ID, such as using the “album:artist:song” combination from ID3 tags.
  • An example 96 bit EPC format, also known as general identifier (GID-96) is:
      • Header: 8 bits
      • Manufacturer: 28 bits or 268 million unique IDs
      • Product (SKU): 24 bits or 16 million unique IDs
      • Serial Number: 36 bits or 68 billion unique IDs
  • As the goal of CMDS is to link users' to information managed by content owners and identified by multiple ID technology providers, whereas the goal of EPCNet involves tracking items through the distribution process for each participant, the backend structures are different. Thus, these two networks can work synergistically, such as with the EPCNet IS having an interface to a CMDS Router. An example of using EPC, such as a film poster ad containing an RFID with EPC GID-96 format, is described below.
  • Register URLs for Pre-Existing CID
  • The first step is that the Content Provider registers the pre-existing CID (via RegCID). Then, the Content Provider registers a primary Full URL (viaRegURL), and, if desired, they can register additional URLs (via RegURL or RegURLs) or URLs for mobile formats.
  • When using this specification to create CIDs, the CID namespace is guaranteed to be unique for each ID Provider and their current ID Version (e.g. algorithm version), and the CID format is decimal. However, since the pre-identified content may have CIDs that overlap other CIDs used by the same ID Provider in this system, the ID Version (via IDVersion XML tag) is used to determine the proper CID namespace. For example, a CID representing a GID-96 EPC code has the hex format of HH.MMMMMMM.PPPPPP.SSSSSSSSS where H is header (8 bits), M is Manufacture (28 bits or 268 million unique IDs), P is Product SKU (24 bits or 16 million unique IDs) and S is Serial Number (36 bits or 68 billion unique IDs). Thus, the ID Provider has an ID Version for the EPC GID-96 format, and different ID Versions for other EPC formats or other CID formats (e.g. DWM). When the embedder registers an EPC GID-96 format CID, it sends the corresponding ID Version.
  • Link to URL with Pre-Existing CID
  • The reader software detects the pre-existing CID, sends it to the router (via ResURL), receives URLs and displays them to the user.
  • In the background, the router, having access to the IDProviderID, ID Version and CID data, uses this globally unique combination to lookup the correct URLs. The proper ID Version is known by the reader since it needs to use that version of the algorithm to detect the CID.
  • Interoperable ID Technology from Multiple ID Providers
  • When one company licenses embedder and detector technology (i.e. OEM) to multiple ID Providers, there arises the user-desired solution where one ID Provider's reader can utilize a CID embedded with another ID Provider's embedder. However, the ID Provider desires “credit” for the embedding process; thus, this content routing system tracks the embedding ID Provider.
  • ID Provider ID Embedded in Content
  • Each ID Provider's embedder embeds their ID Provider ID along with the CID that is requested and embedded by the Content Provider (via CreateCID).
  • Embedding ID Provider ID Included with URL Requests
  • When the reader software reads a CID, it also reads the embedding ID Provider ID. If the embedding ID Provider ID is different than that stored in the reader, it is included in the URL resolution request message (via the EmbIDProviderID XML field). The Router logs the embedding ID Provider's ID for any further action, such as being properly compensated for the embedding process.
  • CMDS Section Conclusion
  • In conclusion, the companion specification provides valuable information to consumers, and enables a distributed routing architecture such that Content Providers manage their proprietary data and interaction with the consumer. Content Providers can include content owners, such as Record Labels, Movie Studios, stock photo agencies, etc., and retailers, such as Apple iTunes, Walmart (clicks-and-mortar), catalog companies, advertisers, Netflicks, etc.
  • Furthermore, the specification enables Content Providers to use any identity provider technology to link users to the proper information. In addition, when multiple ID Providers are sharing a content identification OEM algorithm, every router can seamlessly interoperate and track usage for proper payments. Importantly, the system enables multiple CIDs to exist in content such that the complete value chain (e.g. content owners and retailers) can participate, or create business rules for participation.
  • Furthermore, the specification is optimized for all identification technologies and existing systems, including digital watermarks (DWM), fingerprints (a.k.a. robust hashes), Electronic Product Codes (EPC), IFPI's Grid, and URI. Finally, the specification includes logging, not only for security tracing, but also for usage report that help ID Providers understand router demands and Content Providers understand content usage. The specification can easily be expanded to handle usage cases around seeding multiple ID systems and providing “buy now” functionality for non-legitimate content.
  • In the end, the specification should help content owners and retailers (thus distributors) increase sales (t ROI) by expanding the knowledge of content usage and making it easier for consumers to buy content and related items.
  • The following example implementation uses industry standard XML-based Web Service to provide an open interface to the Routers.
  • Overview of Example CMDS Implementation
  • The main components of the specification of this example CMDS implementation include:
      • Registration Interface
        • Registration Request Messages
        • Registration Response Messages
      • Resolution Interface
        • Resolution Request Messages
        • Resolution Response Messages
      • Router Requirements
  • The registration and resolution request messages use XML and include:
      • Header
      • Body
        • Primary Information
        • Secondary Information
  • The response messages are simpler. The registration response message is simple, requiring no header or body sub-sections, and the resolution response message only includes primary and secondary information sub-sections.
  • ID Providers, Content Providers, and Users
  • To understand this example implementation, it is helpful to understand the relationship between ID Providers, Content Providers and Users.
  • ID Providers: Companies that provide the technology for content identification and to interface with a Router.
  • Content Providers: Providers of the content, such as the content owner and retailer, or any company with rights to distribute content and/or content metadata. For example, content owners can include Record Labels, Movie Studios, and Stock Photo Agencies. Retailers can include Apple iTunes, Wal-Mart (click-and-mortar), advertisers, catalog companies, and Napster.
  • Users: The end users of the system. For example, it may be a consumer linking to more information via their PC Multimedia jukebox, or a movie critic linking to current marketing materials via a closed, private system.
  • CID, ID Version, ID Provider ID and Globally Uniqueness
  • Furthermore, this example implementation is based upon a unique content identifier, labeled a CID. It is critical that CIDs are unique for each ID Provider ID and ID Version. CIDs can overlap for different ID Provider IDs or different ID Versions. ID Provider IDs are different for each ID Provider, and an ID Provider could register multiple ID Provider IDs, if determined as needed by the Registration Authority.
  • The ID Version is the version of the technology/algorithm that embeds and reads the CID. The ID Version is always known by the embedder and reader since they determine which algorithm to embed or read the CID. The ID Provider can have CIDs that overlap when they have different ID Versions, and uses different ID Version when CIDs can overlap.
  • For example, a video may have the same CID as a song, or one song embedded by ID Provider 1 may have the same CID as a different song embedded by ID Provider 2 (or by ID Provider 1 using a new ID Version).
  • As such, CIDs are not globally unique unless combined with these other variables. Thus, the combination created by appending IDProviderID, IDVersion and CID together (e.g. appending <IDProviderID><IDVersion><CID>) is a globally unique ID, usually a number.
  • Alternatively, the globally unique combination can be represented as a URI, formatted as “CMDS://<IDProviderID>.<IDVersion>.<CID>”.
  • The advantages to dividing the namespace in this format are twofold: (1) fewer bits are needed to represent CIDs since CIDs can be re-used in new content or new algorithm versions, and (2) the system is easier to integrate with pre-existing identity systems such as EPC, fingerprinting and 4C/Verance DWM since the CIDs can overlap between these systems but be differentiated with the ID Version.
  • Finally, for many identification technologies, the CID is an integer, and it is most efficient for transport and backend/router processing to use an integer field. However, for other identification technologies a text field is required, and the router can process the text into a unique content identifier. As such, the CID format is determined by ID Version data, and properly handled by a Router. As an aside, two XML schemas will be present for these requests, one for an integer CID and one for a text CID. If possible, it is optimal to use the integer format. Along these lines, databases can be indexed by all three identifiers (IDProviderID, IDVersion and CID) as separate variables or databases, or one database can use this triplet ID as a globally unique index when the CID is integer format.
  • Registration Interface Specification
  • The registration process enables the content provider to obtain unique CIDs and link the CID to URLs. It also enables the ID Provider, Content Provider, and User to register contact information.
  • The registration works from both (i) an interactive human-readable web interface and (ii) a web services interface that interacts directly with registration software, such as a CID embedder (or multimedia plug-in for user registration) that runs on the vendor's or user's computer.
  • Secure Authenticated Channels
  • The client web and software interface uses a secure authenticated channel with the Router. This protection is required so that no one but the proper vendor can change the registration data.
  • Content Provider, ID Provider and User Registration
  • Content Providers and ID Providers initially register with the Registration Authority via a process that verifies them and the contact person to be a trusted provider. During this process, the Content Provider is assigned a unique vendor-name and password, and the ID Provider is assigned a unique numeric ID and password.
  • ID Providers are assigned a unique number rather than name for the following reasons: it is quicker for a Router to lookup a number, the ID Provider's software remembers the number (so the human readability is not important for remembering the unique identification), and the globally unique combination of IDProviderID, IDVersion, and CID is a number.
  • Once they receive their vendor info and password, Content Providers and ID Providers can update their contact information via their embedder software or directly with Registration Authorities interactive web site.
  • Users register via the reader software, which registers a username and password, and should provide the user the option to store the password for future usage. The reader software keeps the username and submits it with each resolution request, as well as offers the user the option to block sending the username (for one request or all future requests). In other words, this particular system is an opt-in system, with capabilities to opt-out.
  • Registration Request Message
  • The Registration Request Message is the interface that defines the message sent to a Router for data registration. The Registration Request Message interface includes an XML Header and Body. Examples are shown below, and the format is described below.
  • Registration Request Root Elements, Sub-Elements and Grouping
  • Registration request messages choose one root elements from several options, include: <RegistrationCIDRequest> for CreateCID and RegCID request codes; <RegistrationURLRequest> for RegURL, DelURL, RegURLs, and DelURLs request codes; and <RegistrationContactInfoRequest> for UpdateContentProvider, UpdateIDProvider, RegUser and UpdateUser request codes. (More root elements may be added when the handling of integer and text CIDs is finalized, e.g. RegistrationIntCIDRequest and RegistrationTextCIDRequest.) There are sub-elements, including: <Header> for message headers, <Body> for message body, and <PrimaryInfo> and <SecondaryInfo> when needed. Grouping of registration requests is allowed (and it is expected to be specified when the transmission method, e.g. SOAP, is finalized, as discussed below).
  • Registration Request Message XML Header
  • The XML header is:
  • XML Tag Format Description Status
    Version Integer The version of this request message. The current version Required
    is 1.
    IDProviderID Integer Identity technology provider number as stored in the Required
    product (e.g. software) interacting with a Router. IDs 0-511
    are reserved (as described below).
    RequestCode Text Requests a Router to take a specified action. Required
  • The allowable Request Codes for registration include:
  • Request Code Description
    CreateCID Create a unique content ID
    RegCID Register pre-existing CID from other unique
    identification standard
    RegURL Register one URL
    DelURL Delete one URL
    RegURLs Register several URLs
    DelURLs Delete several URLs
    UpdateContentProvider Update Content Provider contact information
    UpdateIDProvider Update ID Provider contact information
    RegUser Register new username, password and
    contact information
    UpdateUser Update user contact information
      • This header data can help the router quickly distribute the message to various request handlers for the detailed actions to be handled.
      • The request codes RegURLs and DelURLs register or delete multiple URLs in one message, which requires less interaction from the registration software but requires parsing by the Router.
      • The ID Provider IDs' 0-to-511 are reserved, such as for the case when the ID Provider embeds their ID within the content since there are several interoperable readers.
    Registration Request Message XML Body
  • For each Request Code, the Resolution Message XML Body includes the following information.
  • Request Codes: CreateCID and RegCID
  • The XML body has primary information, which includes CID related variables, for the registration request, and secondary information which includes optional descriptive data for the CID.
  • The primary request information is:
  • XML Tag Format Description Status
    ContentProviderName Text Content Provider Required
    name.
    Password Text Content Provider Required
    password.
    IDVersion Integer The version of the CID Required
    algorithm.
    CID Integer The unique content ID Required for
    or Text formatted as integer RegCID
    (preferable) or text, as
    determined by the ID
    Version.
    CIDExpiration Date Expiration date for Optional
    CID so it can be
    reused. Use with
    caution (as described
    below)
    Private Binary Binary data that can Optional
    be used by the ID
    Provider for any
    private reason.
      • The CID Expiration field should be used with great caution since content may exist for a long time. It is most relevant to temporary content, like news papers or catalogs.
  • The secondary request information is:
  • XML Tag Format Description Status
    Title Text Title of the content. Optional
    Copyright Text Copyright dates. Optional
    AdultFlag Boolean TRUE for adult content, and FALSE for all other content Optional
    ContentType Text Content type choices include: audio—music, audio—speech, Optional
    video videotrack, video—audiotrack, image, and text.
    ArtistName Text Artists full name Optional
    ArtistEmail Text Artists email address Optional
    ArtistPhone Text Artists phone number Optional
    ArtistURL Text ID Provider, Content Provider or User Artist web page. Optional
  • Request Codes: RegURL, DelURL, RegURLs and DelURLs
  • The XML body information is:
  • XML Tag Format Description Status
    ContentProviderName Text Content provider name. Required
    Password Text Content provider password. Required
    IDVersion Integer The ID version provides the version of the Required
    CID algorithm.
    CID Integer The unique content ID formatted as Required
    or Text integer (preferable) or text, according to
    the IDVersion.
    Primary Boolean TRUE for Primary URL, and FALSE for Required
    Additional URLs.
    URLType Text The URL Type, such as for a WAP Required
    enabled cell phone or fully functional PC
    (more details below).
    URL Text The URL that links the content to more Required
    information.
    URLVariables Text A list of XML tags, separated by a colon Optional
    “:”, that define the XML fields which are
    appended at the end of the URL or the
    term ALL for all of the request tags (more
    details below).
    URLActivation Date Date to activate the URL. If no date is set, Optional
    the URL is activated, and remains active
    unless it has expired.
    URLExpiration Date Date to de-activate URL. If no date is Optional
    present, the URL has no expiration, and is
    active, unless it has not yet been
    activated.
    Desc Text Brief description of URL, less than 128 Required,
    characters with spaces except for
    DelURL and
    DelURLs
    Private Binary Binary data that can be used by the ID Optional
    Provider for any private reason.
  • The allowable URL Types (for all request codes that include this field):
  • URL Type Code Description
    Full Fully functional web pages
    WAP Wireless Application Protocol (WAP) web page
    WMI W3C Mobile Web Initiative (MWI)
      • The URL Variables enables the URL to deep link into a database.
      • For RegURLs, a list of Primary, URLType, URL, URLVariables, URLActivation, URLExpiration, and Desc data elements are separate by semicolons “;”.
        • The field has an entry for each URL (a space for no data is okay), or not be used at all
      • For DelURL and DelURLs, the data elements in URLVariables, URLActivation, URLExpiration, and Desc are optional, and are ignored if included.
      • For DelURLs, a list of Primary, URLType and URL data elements are separated by semicolons “;”.
        • The other fields, including IDVersion and CID, remains constant
  • URLs are categorized into Primary and Additional URLs, where there can be one Primary URL for each URL Type and as many additional URLs as desired. This categorization allows immediate redirection for the user, as well as choice of all associated URLs (i.e. additional actions) for the user. In other words, Primary URLs enable the system to automatically display the primary web site for the user, thus not requiring the user to click on the desired URL after selecting to receive more information. There is a balance, since while reducing the number of required clicks, Primary URLs also reducing the choices and retail opportunities.
  • Request Codes: UpdateContentProvider, UpdateIDProvider, RegUser and UpdateUser
  • The XML body information is:
  • XML Tag Format Description Status
    RegName Text Content Provider Name, Username, or ID Required
    Provider ID. The ID Provider ID is converted
    to an integer inside the router's handler.
    Password Text ID Provider, Content Provider or User Required
    password
    BizName Text Company's full name Required, except for
    RegUser and
    UpdateUser
    BizEmail Text Company's email address Optional
    BizAddress1 Text Company's street address, first line Required, except for
    RegUser and
    UpdateUser
    BizAddress2 Text Company's street address, second line Optional
    BizCity Text Company's city Required, except with
    RegUser and
    UpdateUser
    BizState Text Company's state Required, except with
    RegUser and
    UpdateUser
    BizZip Text Company's zip Required, except with
    RegUser and
    UpdateUser
    BizCountry Text Company's country Required, except with
    RegUser and
    UpdateUser
    BizPhone Text Company's phone number Optional
    BizURL Text ID Provider, Content Provider or User Optional
    company web page.
    BizLogoURL Text ID Provider or Content Provider company Optional
    logo.
    BizTemplateURL Text ID Provider or Content Provider company Optional
    template.
    NameTitle Text Contact's name title (e.g. Mr., Ms., etc.) Optional
    NameFirst Text Contact's first name Required
    NameMiddle Text Contact's middle name or initial Optional
    NameLast Text Contact's last name Required
    NameSuffix Text Contact's name suffix (e.g. JR., III, etc.) Optional
    Email Text Contact's email address Required
    Address1 Text Contact's street address, first line Required, except for
    RegUser and
    UpdateUser
    Address2 Text Contact's street address, second line Optional
    City Text Contact's city Required, except for
    RegUser and
    UpdateUser
    State Text Contact's state Required, except for
    RegUser and
    UpdateUser
    Zip Text Contact's zip Required
    Country Text Contact's country Required
    Phone Text Contact's phone number Required, except for
    RegUser and
    UpdateUser
    Cell Text Contact's cell phone number Optional
    Fax Text Contact's fax number Optional
    IM Text Contact's instant message address Optional
    Language Text Contact's preferred spoken Optional
    language.
    Sex Text Contact's Sex (M or Male, or F or Optional
    Female)
    Ag Integer Contact's Age Optional
    Private Binary Binary data that can be used by the Optional
    ID Provider for any private reason.
      • List of countries from Windows XP “Region and Language Options” in Control Panel
      • List of languages from Windows XP “Region and Language Options” in Control Panel
    Registration Response Message
  • The Registration Response Message is the interface that defines the message sent from a Router in response to data registration. The Registration Response interface includes a success code, URL and brief description of the URL, or error code and associated URL and description, as well as private data. Examples are shown below, and the format is described below.
  • Registration Response Root Element and Grouping
  • All registration response messages have one root element of <RegistrationResponse> (and </RegistrationResponse>), and no sub-elements. Grouping of registration requests is allowed (and it is expected to be specified when the transmission method, e.g. SOAP, is finalized).
  • Registration Response XML Message
  • The registration response message XML format for all requests is:
  • XML Tag Format Description Status
    Version Integer The version of this request message. The current version Required
    is 1.
    RtnCode Integer Return code where “0” means success and any positive Required
    number as an error code. For this version, the only valid
    error code is “1”.
    URL Text URL, or list of URLs separated by semicolons “;” Optional
    Desc Text Brief description of URL or error, or list of descriptions Required
    of URLs, with each description or error text having 128 for errors
    characters or less including spaces, and separated by
    semicolons “;”.
    Private Binary Binary data that can be used by the ID Provider for any Optional
    private reason.
      • For the RtnCode, error codes, like “2”, may be defined in the future such that the system can automatically handle the error. For this version, providing the vendor or user with the error text is enough, and, thus, “1” is the only valid error code.
    Registration Response Message Data
  • For the request for a unique ID (CreateCID): the message returns a “0” for success in the RtnCode field and the CID in the Desc field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • For the request for registering CIDs from other system ID (RegCID): the message returns a “0” for success in the RtnCode field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • For the request to register or delete a URL (RegURL, DelURL, RegURLs, and DelURLs): the message returns a “0” for success in the RtnCode field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • For the request for content provider, ID provider or user registration (UpdateContentProvider, UpdateIDProvider, RegUser, and UpdateUser): the message returns a “0” for success in the RtnCode field and RegName (e.g. ContentProviderName, IDProviderID, or UserName) in the Desc field for optional verification—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • Content Provider Display
  • The Content Provider is notified of the success or error. In the case of error, the error text and URL shall be displayed.
  • Resolution Interface Specification
  • The resolution architecture connects the readers to a Router such that content identification can be used to provide users with interesting related data and purchasing opportunities.
  • The resolution interface employs a web services interface.
  • Secure Authenticated Channel for Request Address
  • The web services interface uses a secure authenticated channel with the Router for ResRegAddress and ResResAddress. This protection is required to eliminate spoofing of the Router.
  • Resolution Request Message
  • The Resolution Request Message is the interface that defines the message sent to a Router for data lookup. The Resolution Request Message interface includes an XML Header and Body. Examples are shown and the format is described below.
  • Resolution Request Root Elements, Sub-Elements and Grouping
  • Resolution request messages choose one of two root elements: <ResolutionURLRequest> for ResURL and ResURLs request codes; and <ResolutionAddressRequest> for ResRegAddress and ResResAddress request codes. (More root elements may be added when the handling of integer and text CIDs is finalized, e.g. ResolutionURLintRequest and ResolutionURLtextRequest.) There are sub-elements, including: <Header> for message headers, <Body> for message body, and <PrimaryInfo> and <SecondaryInfo> when needed. Grouping of registration requests is allowed (and it is expected to be specified when the transmission method, e.g. SOAP, is finalized). Grouping is useful when the ID Provider reader can read multiple CIDs embedded in the content (e.g. one CID from a content owner and one CID from a retailer).
  • Resolution Request Message XML Header
  • The XML header is the same as for a registration request. This header data can help the router quickly distribute the message to various request handlers for the detailed actions to be handled.
  • The allowable Request Codes for resolution include:
  • Request Code Description
    ResURL Resolve the primary URL
    ResURLs Resolve the primary and additional URLs
    Res2ndInfo Resolve the secondary information
    ResRegAddress Resolve the address of the Registration Router
    for registration requests
    ResResAddress Resolve the address of the Resolution Router
    for resolution requests
  • Resolution Request Message XML Body
  • For each Request Code, the Resolution Message XML Body includes the following information.
  • Request Code: ResURL, ResURLs and Res2ndInfo
  • For these request codes, the message includes primary and secondary information. The Primary Information portion contains the data required to properly service the request. The Secondary Information contains user-specific data and is intended for user specific links and aggregate usage monitoring and reporting.
  • Privacy issues should be considered when sending the secondary information.
  • Preferably, the user permits the secondary information to be sent.
  • The primary request information includes:
  • XML Tag Format Description Status
    Timestamp Time Time stamp of triggering event. Used to a Required
    id in management of “stale” requests that
    have timed out. Format is Coordinated
    Universal Time (e.g. 2005-04-
    14T13:20:00Z)
    EmbIDProviderID Integer The ID Provider ID that embedded the Required if different
    CID, if different than that of the reader than IDProviderID,
    software ID Provider ID otherwise blank
    IDVersion Integer The ID version provides the version of the Required
    CID algorithm.
    CID Integer The unique content ID formatted as Required
    or Text integer (preferable) or text, as defined by
    the IDVersion.
    URLType Text The URL Type, such as for a WAP Required, except for
    enabled cell phone or fully functional PC. Res2ndInfo
    Response2ndInfo Boolean TRUE if secondary response information Required, ignored
    is requested, and FALSE if not. (It is not for Res2ndInfo
    signaling that secondary request
    information is included in this request).
    Private Binary Binary data that can be used by the ID Optional
    Provider for any private reason.
      • Private data could, for example, include part of an image or audio so the server can detect the embedded CID. The binary data format should be known by the ID Provider handler, as well as preferably included in the header of the binary data.
  • The secondary request information includes:
  • XML Tag Format Description Status
    ReaderID Integer A unique ID that identifies the reader application per Optional
    purchase or installation. (More details below)
    Transaction ID Integer A unique ID that identifies the transaction for the reader. Optional
    (More details below)
    OS Text Operating system, including Windows, WinCE, Mac, Optional
    Symbian, J2ME, BREW, PALM OS, Microsoft
    Smartphone/Pocket PC
    OSVersion Text Request OS for version from OS and send in same format Optional
    GPS Text GPS coordinates of requesting device, if available Optional
    Username Text Identification of the user and links to data that the user has Optional
    registered
    sLanguage Text User's preferred spoken language. Optional
    sSex Text User's Sex (M or Male, or F or Female) Optional
    sAge Integer User's Age Optional
    sZip Text User's postal code Optional
    sCountry Text User's Country. Optional
      • The Reader ID eliminates the statelessness of a Web Services request and enables useful usage tracking. It is optional due to privacy concerns and shall be able to be turned off by the user.
        • It can be calculated from the reader machine or pre-assigned via purchase/activation codes, where the latter is preferable for mobile devices that may not be able to generate GUIDs.
      • The Transaction ID provides further tracking upon the reader ID, and can also be turned off by the user.
        • It can be as simple as starting with 1 and counting each transaction by that reader.
      • Note that “s” in front of variables means that it is the secondary information, and allows anonymous data aggregation without a user registering.
        • If the Username is included, none of these “s” variables are needed since they have been registered by the user and are stored in a Router
        • sLanguage uses the list of languages from Windows XP “Region and Language Options” in Control Panel
        • sCountry uses list of countries from Windows XP “Region and Language Options” in Control Panel
  • As such, the following actions are enabled:
      • Aggregate usage monitoring and reporting
      • Secondary data about the user to be used for detailed usage monitoring and user specific resolution responses
    Request Code: ResRegAddress and ResResAddress
  • For this request codes, the message includes:
  • XML Tag Format Description Status
    Timestamp Time Time stamp of triggering event. Used to aid in management of Required
    “stale” requests that have timed out. Format is Coordinated
    Universal Time (e.g. 2005-04-14T13:20:00Z)
    ReaderIP Text IP address of the embedder or reader. Utilized to determine Required
    the correct registration and resolution Router addresses with
    which to interface.
  • Resolution Response Message
  • The Resolution Response Message is the interface that defines the message from a Router in response to data lookup. The Resolution Response interface has primary information, which includes a success code, URL and brief description of the URL, or error code and associated text, and has secondary information which provides content-specific metadata. Examples are shown below, and the format is described below.
  • Resolution Response Root Element, Sub-Elements and Grouping
  • All resolution response messages have one root element: <ResolutionResponse> (and </ResolutionResponse>), and sub-elements of <PrimaryInfo> and <SecondaryInfo>. Grouping of resolution requests is allowed (and it is expected to be specified when the transmission method, e.g. SOAP, is finalized). Grouping is useful when the ID Provider reader can read multiple CIDs embedded in the content (e.g. one CID from a content owner and one CID from a retailer).
  • Resolution Response XML Message
  • The XML primary response information for all requests is:
  • XML Tag Format Description Status
    Version Integer The version of this request message. Required
    The current version is 1.
    RtnCode Integer Return code where “0” means Required
    success and any positive number as
    an error code. For this version, the
    only valid error code is “1”.
    URL Text URL, or list of URLs separated by Required for successful
    semicolons “;” resolution requests,
    Optional otherwise
    Desc Text Brief description of URL or error, or Required, except for
    list of descriptions of URLs, with Res2ndInfo and
    each description or error text having ResRegAddress and
    128 characters or less including ResResAddress
    spaces, and separated by
    semicolons “;”.
    BizLogoURL Text Content Provider's URL for their Optional, except for
    company logo. ResURL, ResURLs, and
    Res2ndInfo if registered
    by the Content Provider
    BizTemplateURL Text Content Provider's URL for their Optional, except for
    desired display template. ResURL, ResURLs, and
    Res2ndInfo if registered
    by the Content Provider
    Private Binary Binary data that can be used by the Optional
    ID Provider for any private reason.
      • For the RtnCode, error codes, like “2”, may be defined in the future such that the system can automatically handle the error. For this version, providing the vendor or user with the error text is enough, and, thus, “1” is the only valid error code (and “0” or “1” are the only valid RtnCodes).
      • The URL Variables are added to the URL after a question mark “?” either as XML data (i.e. between their XML tags) or as text formatted as XML tag=data, both with colons “:” between the XML tags
        • XML data example=<IDVersion>1<ADVersion>:CID=999 <CID>999</CID>
        • Text example=IDVersion=1:CID=999
        • Thus, the URL that is returned can point deep inside a database
      • BizLogoURL and BizTemplateURL are required if they were registered by the Content Provider and the request code is ResURL, ResURLs or Res2ndInfo.
        • If they were never been registered, they are optional.
  • The XML secondary response information for all requests is required for Res2ndInfo request codes or when the Response2ndInfo flag is set:
  • XML Tag Format Description Status
    Title Text Title of the content. Required for
    2ndInfo request
    Copyright Text Copyright dates. Required for
    2ndInfo request
    AdultFlag Boolean “1” for adult content, and “0” Required for
    for all other content 2ndInfo request
    ContentType Text Content type choices include: Required for
    audio—music, audio—speech, 2ndInfo request
    video—video track,
    video—audio track, image and
    text.
    ArtistName Text Artist's full name Required for
    2ndInfo request
    ArtistEmail Text Artist's email address Required for
    2ndInfo request
    ArtistPhone Text Artist's phone number Required for
    2ndInfo request
    ArtistURL Text Artist web page. Required for
    2ndInfo request
    BizName Text Company's full name Required for
    2ndInfo request
    BizEmail Text Company's email address Required for
    2ndInfo request
    BizAddress1 Text Company's street address, Required for
    first line 2ndInfo request
    BizAddress2 Text Company's street address, Required for
    second line 2ndInfo request
    BizCity Text Company's city Required for
    2ndInfo request
    BizState Text Company's state Required for
    2ndInfo request
    BizZip Text Company's zip Required for
    2ndInfo request
    BizCountry Text Company's country Required for
    2ndInfo request
    BizPhone Text Company's phone number Required for
    2ndInfo request
    BizURL Text Company web page. Required for
    2ndInfo request
  • This secondary information comes from a combination of data included when registering a CID and when registering a Content Provider. Although the fields are required for Res2ndInfo or when the Response2ndInfo flag is set, many of the fields are optional when registering and, thus, may not be returned (or be returned blank) even when requested. The secondary information enables the user to view basic artist information, such as may be desirable for photos from a stock agency, and content provider information, which is probably desirable for all content.
  • Resolution Response Message Data
  • For the request for URL (ResURL): the message returns a “0” for success in the RtnCode field, the primary URL in the URL field, the brief description of the URL in the Desc field, and the secondary information if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field. The Primary URL has been registered with the Primary flag set, and matches the requested ID Provider ID, ID Version, CID and URL Type.
  • For the request for all URLs (ResURLs): the message returns a “0” for success in the RtnCode field, the list of all URLs with the primary URL listed first, separated by semicolons “;” in the URL field, the list of brief descriptions of the URLs, separated by semicolons “;” in the Desc field, and the secondary information if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field. The URLs all match the requested ID Provider ID, ID Version, CID and URL Type. For each URL Type, there is only one primary URL and it is listed first. The secondary information does not have multiple items in each field since it is linked to the CID and not to the URLs. In other words, the secondary info does not change with URLs, only CIDs.
  • For the request of secondary information (Res2ndInfo): the message returns a “0” for success in the RtnCode field, and the secondary information in the corresponding fields—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • For the request of the Router address (ResRegAddress and ResResAddress): the message returns a “0” for success in the RtnCode field, the local Routers' web or IP address in the URL field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • User Display
  • When only the primary URL exists, the reader software launches a web browser with the primary URL, such that the primary web page is “immediately” displayed for the user. This always happens with ResURL, and may happen with ResURLs.
  • When requesting multiple URLs, the reader software displays the links and descriptions with the Content Provider's logo and template, if BizLogoURL and BizTemplateURL fields have been registered by the Content Provider. If not, the reader can use its proprietary template. The template defines which secondary CID information (e.g. title, copyright, adult flag content type, artist info and content provider company info) is displayed. The template uses the corresponding XML tags (in between < >) for the secondary data as variables to display this data.
  • If the reader is always connected, it should read the CID, request secondary information (potentially caching URLs), and then display to the user that more information is available from <BizName>. This approach causes the response to be immediate upon the user's selection of more information and removes the chance that the user selects more information and no URLs have been registered. In addition, if the content includes multiple CIDs, e.g. one from the content owner and one from the retailer, it also enables the user to differentiate the information source.
  • Router Requirements
  • The following requirements enable the Router system to function properly and provide value to vendors and users.
  • CID & URL Requirements
  • A Router guarantees that requested or registered CIDs are unique for the given ID Provider ID and ID Version. For requested CIDs, the generating algorithm should guarantee unique IDs. For registered CIDs, the system checks the databases to make sure the CID has not already been registered by that ID Provider with that ID Version. If it has been registered, the system should send back an appropriate error.
  • When registering URLs, the system checks that a CID has been registered by the requesting Content Provider name, ID Provider ID and IDVersion. If not, the system should send back an appropriate error.
  • A Router guarantees that there is only one Primary URL registered for each URL Type given the ID Provider ID, ID Version and CID.
  • The Databases include:
      • The date that a CID is registered (CIDRegDate) and last modified (CIDModDate)
      • The date that a URL is registered (URLRegDate) and last modified (URLModDate)
    Log Files and Usage Reports
  • Log file saves the request time, response delay (in milliseconds), request IP address and registration or resolution XML message, excluding private data, for every request. Log files at least span the previous 6 months.
  • The aggregate usage data should be visible to the registered ID Providers and Content Providers via an interactive, secure web site, with abilities to export to excel or delimited (tab or comma) text files for download or automatic emailing. Daily, weekly and monthly reports shall be automatically generated for immediate viewing or export. Monthly usage reports should be kept for the life of the system, daily and weekly reports for two years.
  • Reports include:
    • 1. For each CID registered by each Content Provider, and for all CIDs registered by each ID Provider and each Content Provider, for the requested date range
      • 1.1. For all users and users sending secondary information (including registered users and user sending anonymous secondary information)
        • 1.1.1. Total successful links
        • 1.1.2. Aggregate links per date (in the date range)
        • 1.1.3. Aggregate links per hour for a 24 hour period
        • 1.1.4. Aggregate links per day of the week
        • 1.1.5. Aggregate links per IP address
        • 1.1.6. Average response time
        • 1.1.7. Total unsuccessful links grouped by error code
      • 1.2. For users sending secondary information
        • 1.2.1. Aggregate links per reader ID (which enables ranking of anonymous users)
        • 1.2.2. Aggregate links per username (which enables ranking of registered users)
        • 1.2.3. Aggregate links per country
        • 1.2.4. Aggregate links per zip
        • 1.2.5. Aggregate links per sex
        • 1.2.6. Aggregate links per age
        • 1.2.7. Aggregate links per group
        • 1.2.8. Aggregate links per language
  • The reports allow Content Providers to access CID specific usage statistics.
  • The age groups are defined as:
  • Age Group Code Age Group Description
    Age0-5 Users between birth and 5 years old
    Age6-10 Users between 5 and 10 years old
    Age11-15 Users between 11 and 15 years old
    Age16-20 Users between 16 and 20 years old
    Age21-25 Users between 21 and 25 years old
    Age26-30 Users between 26 and 30 years old
    Age31-40 Users between 31 and 40 years old
    Age41-50 Users between 41 and 50 years old
    Age51-60 Users between 51 and 60 years old
    Age61-80 Users between 61 and 80 years old
    Age81+ Users over 81 years old
  • The registered vendors shall also be able to create custom reports with any begin and end data in the last 2 years. These custom reports will take a little time to calculate since daily reports have to be analyzed. The system may allow for custom reports with fields not included in the report list below for the last 6 months. These reports will take some time to calculate since they require log files to be analyzed.
  • Distributed Architecture
  • In order for the distributed architecture of the Router to function properly and be able to be expanded in the future, the following occur.
  • The reader requests the web or IP address of registration and/or resolution router, which ever are applicable, every week. Thus, the system architecture can be dynamically changed every week.
  • The number of Mirror Routers is set by the Registration Authority. The Mirror Routers forward all registration requests immediately to the Central Router, and wait its response that the information is correct (or the CID is unique). They also send aggregate usage files to the Central Router and synchronize with the Central Database daily. The daily time is not sent so that they don't all hit the Central Router simultaneously. Finally, they forward resolution requests for CIDs that don't exist in their database and wait for the response before responding to the User, to make sure they were not registered during that recent day.
  • XML Schemas
  • The XML schemas are specified, most likely, with grouped (e.g., within WSDL) as follows:
      • Registration CID Request Message Schema for CreateCID and RegCID request codes
        • One for integer and one for text CIDs
      • Registration URL Request Message Schema for RegURL, DelURL, RegURLs, and DelURLs request codes
        • One for integer and one for text CIDs
      • Registration Contact Information Request Message Schema for UpdateContentProvider, UpdateIDProvider, RegUser and UpdateUser request codes
      • Registration Response Message Schema as used by all registration requests
      • Resolution Request Message Schema for ResURL, ResURLs, and Res2ndInfo request codes
        • One for integer and one for text CIDs
      • Resolution Request Message Schema for Request Router addresses via ResRegAddress and ResResAddress
      • Resolution Response Message Schema as used by all resolution requests
    Packing and Transmission Methods
  • The XML packing and transmission methods need to be specified, and include http, https, WSDL, SOAP and secure Web Services, such as SAML, WS-License or WS-Security. Public key architecture, such as described in XKMS, X-KRSS, and X-KISS, is probably not required since this example implementation has Content Provider Name and password as part of the standard XML message interface, and the contact data is not mission critical.
  • Importantly, the http or https link should be maintained from request to response, and only broken after the response is received, thus increasing efficiency and reducing risk of firewall interfering with the response (as well as not requiring the client embedder or reader software to act as a server).
  • Database Elements
  • Describing the database elements and possible arrangements helps the reader understand the interface and router since it provides an overview of how the requests are handled.
  • Database Management
  • Database management is desirable and includes:
      • Check URLs at least once a month
        • Report dead URLs to Content Provider (using contact person's email) whom requested the CID and registered the related URL
          • Uses CID Owner Information
        • Report CIDs with no Primary URL but with additional URLs to Content Provider
          • This assumes that a CID with no URLs at all has not been distributed yet or is not used for that URL Type
    Database Information
  • The Primary Databases include the following information. The structure does not need to be as implied by the tables. However, the tables provide a nice outline and help to conceptually understand how the message interface is used.
  • CID Owner Information
  • Label ContentProviderName IDProviderID IDVersion CID CIDExpiration CIDRegDate CIDModDate
    Type Text Integer Integer Integer Date Date Date
    or Text
    continued . . .
    Title Copyright AdultFlag ContentType ArtistName ArtistEmail ArtistPhone ArtistURL
    Text Text Boolean Text Text Text Text Text
      • This information is entered when requesting a CID (CreateCID) or when registering pre-existing CID from another ID standard (RegCID).
        • the CID for RegCID is checked for uniqueness given ID Provider ID and ID Version
    CID Link Information
  • Label IDProviderID IDVersion CID Primary URL Type URL URLVariable Desc
    Type Integer Integer Integer or Text Boolean Byte Text Text Text
    continued . . .
    URLActivation URLExpiration URLReg Date URLModDate
    Date Date Date Date
      • This information is entered or removed when a URL is registered or deleted (RegURL and RegURLs or DelURL and DelURLs), respectively
        • Check that only one Primary URL for each URL Type is registered when registering a primary URL with RegURL (as described in the spec)
      • There may be one database or several databases
      • There could be a different database for each ID Provider ID, or ID Provider ID and ID Version.
      • The database could combine ID Provider ID, ID Version, and CID to one index.
        • There could be two databases, one for numeric combinations (where CID is an integer) and one for text combinations (where CID is text based) or one database with a text index. The registration or resolution schema could be used to determine which database to use. The integer combination is optimal for efficiency.
      • Fields may be combined.
        • For example, rather than having URLType, URL and Description, there may be FullURL, FullDesc, WAPURL, WAPDesc, WMIURL, WMIDesc—or any combination.
      • The database can convert URL Type text to integer for speed
        • URL Type: Full=1, a WAP=2 and a WMI=3.
          The Secondary Databases include the following information:
    Content Provider, ID Provider and User Information
  • Label <RegName>* Password BizName BizEmail BizAddress1 BizAddress2 BizCity
    Type <type> Text Text Text Text Text Text
    continued . . .
    BizState BizZip BizCountry BizPhone BizURL BizLogoURL BizTemplateURL
    Text Text Text Text Text Text Text
    continued . . .
    Name Email Address1 Address2 City State Zip Country Phone Cell Fax
    Text Text Text Text Text Text Text Text Text Text Text
    continued . . .
    IM Language Sex Age
    Text Text Text Integer
      • <RegName> is ContentProviderName, IDProviderID, or UserName
      • <type> is Text, Integer, or Text for ContentProvider, ID Provider or User databases, respectively
      • Boolean can be stored with TRUE=1 and FALSE=0
      • Sex can be stored as Boolean with Female=TRUE=1 and Male=FALSE=0
    Registration Message Examples Create a Content ID Request Message (CreateCID)
  • <RegistrationCIDRequest>
     <Header>
      <Version>1</Version>
      <IDProviderID>123</IDProviderID>
      <RequestCode>CreateCID</RequestCode>
     </Header>
     <Body>
      <PrimaryInfo>
       <ContentProviderName>Disney</ContentProviderName>
       <Password>walt4pres</Password>
       <IDVersion>1</IDVersion>
      </PrimaryInfo>
      <SecondaryInfo>
       <Title>Fantasia</Title>
       <Copyright>1960</Copyright>
       <AdultFlag>0</AdultFlag>
       <ContentType>video-videatrack</ContentType>
       <ArtistEmail>fantasia@disney.com</ArtistEmail>
      </SecondaryInfo>
     </Body>
    </RegistrationCIDRequest>
  • Response Message (CreateCID)
  • <RegistrationResponse>
     <Version>1</Version>
     <RtnCode>0</RtnCode>
     <Desc>999</Desc>
    </RegistrationResponse>
  • Register a Pre-Existing Content ID Request Message (RegCID)
  • <RegistrationCIDRequest>
     <Header>
      <Version>1</Version>
      <IDProviderID>321</IDProviderID>
      <RequestCode>RegCID</RequestCode>
     </Header>
     <Body>
      <PrimaryInfo>
       <ContentProviderName>Apple</ContentProviderName>
       <Password>1984year</Password>
       <IDVersion>2</IDVersion>
       <CID>111</CID>
      </PrimaryInfo>
      <SecondaryInfo>
       <Title>Fantasia</Title>
       <Copyright>1960</Copyright>
       <AdultFlag>0</AdultFlag>
       <ContentType>video-audiotrack</ContentType>
      </SecondaryInfo>
     </Body>
    </RegistrationCIDRequest>
  • Response Error Message (RegCID)
  • <RegistrationResponse>
     <Version>1</Version>
     <RtnCode>1</RtnCode>
     <URL>http://www.cmds.com/error/error8.html</URL>
     <Desc>
      CID is already registered. Please verify the CID and ID
       Version and try again.
     </Desc>
    </RegistrationResponse>
  • Register Multiple URLs
  • Registering one URL with RegURL is extremely similar except there is only one data element in the Primary, URLType, URL, URLVariables, URLActivation, URLExpiration, and Desc fields. Alternatively, multiple URLs can be registered by grouping multiple RegURL calls in the transmission. Deleting one or more URLs with DelURL or DelURLs is very similar except that URLVariables, URLActivation, URLExpiration, and Desc are optional, and ignored if included. As for RegURL, in DelURL, there is only one URL included in the URL XML field.
  • Request Message (RegURLs)
  • <RegistrationURLRequest>
     <Header>
      <Version>1</Version>
      <IDProviderID>123</IDProviderID>
      <RequestCode>RegURLs</RequestCode>
     </Header>
     <Body>
      <ContentProviderName>Disney</ContentProviderName>
      <Password>walt4pres</Password>
      <IDVersion>1</IDVersion>
      <CID>999</CID>
      <Primary>1;1;0;0;0;0</Primary>
      <URLType>Full;WAP;Full;WAP;Full;WAP</URLType>
      <URL>
        www.disney.com/fantasia;
        wap.disney.com/fantasia;
        www.disney.com/fantasia/music;
        wap.disney.com/fantasia/music;
        www.amazon.com/search?fantasia;
        wap.amazon.com/search?fantasia;
      </URL>
      <URLVariables>
        IDProviderID:IDVersion:CID:ReaderID:OS:Username;
        IDProviderID:IDVersion:CID:ReaderID:OS:Username;
        IDProviderID:IDVersion:CID:ReaderID:OS:Username;
        IDProviderID:IDVersion:CID:ReaderID:OS:Username;
        IDProviderID:IDVersion:CID:ReaderID:OS:Username;
        IDProviderID:IDVersion:CID:ReaderID:OS:Username;
      </URLVariables>
      <Desc>
       Fantasia movie info from Disney.com;
       Fantasia movie info from Disney.com (WAPFormat);
       Fantasia music info from Disney.com;
       Fantasia music info from Disney.com (WAPFormat);
       Fantasia memorabilia from Amazon.com;
       Fantasia memorabilia from Amazon.com (WAPformat);
      </Desc>
     </Body>
    </RegistrationURLRequest>
  • Response Message (RegURLs)
  • <RegistrationResponse>
     <Version>1</Version>
     <RtnCode>0</RtnCode>
    </RegistrationResponse>
  • Register a User
  • Updating a Content Provider, ID Provider or User is very similar to registering a User, except that the name and password have already been assigned as opposed to being checked for uniqueness. In addition, the User does not need to enter business information.
  • Request Message (RegUser)
  • <RegistrationContactInfoRequest>
     <Header>
      <Version>1</Version>
      <IDProviderID>123</IDProviderID>
      <RequestCode>RegUser</RequestCode>
     </Header>
     <Body>
      <RegName>klevy</RegName>
      <Password>ken1sgreat</Password>
      <BizName>AIPL</BizName>
      <BizEmail>levy@aipl.com</BizEmail>
      <BizAddress1>110 NE Cedar Street</BizAddress1>
      <BizCity>Stevenson</BizCity>
      <BizState>WA</BizState>
      <BizZip>98648</BizZip>
      <BizCountry>USA</BizCountry>
      <BizPhone>509-427-5374</BizPhone>
      <BizURL>www.AIPL.com</BizURL>
      <NameFirst>Ken</NameFirst>
      <NameLast>Levy</NameLast>
      <Email>levy@aipl.com</Email>
      <Address1>110 NE Cedar Street</Address1>
      <City>Stevenson</City>
      <State>WA</State>
      <Zip>98648</Zip>
      <Country>USA</Country>
      <Cell>509-427-5374</Cell>
      <Language>English</Language>
      <Sex>M</Sex>
      <Age>40</Age>
     </Body>
    </RegistrationContactInfoRequest>
  • Response Message (RegUser)
  • First, the user receives an error because their username “klevy” exists.
  • <RegistrationResponse>
     <Version>1</Version>
     <RtnCode>1</RtnCode>
     <URL>http://www.cmds.com/error/error6.html</URL>
     <Desc>
      Username is already registered.
      Please try a different username.
     </Desc>
    </RegistrationResponse>
  • Then, they re-try with the user name “kenlevy”, and it is successful.
  • <RegistrationResponse>
     <Version>1</Version>
     <RtnCode>0</RtnCode>
     <Desc>kenlevy</Desc>
    </RegistrationResponse>
  • Resolution Message Examples
  • Resolve URLs
  • Resolving one URL is very similar, where the only change is that one URL is returned in the response message.
  • Request Message (ResURLs)
  • <ResolutionURLRequest>
     <Header>
      <Version>1</Version>
      <IDProviderID>123</IDProviderID>
      <RequestCode>ResURLs</RequestCode>
     </Header>
     <Body>
      <PrimaryInfo>
       <Timestamp>2005-04-14T13:20:00Z</Timestamp>
       <IDVersion>1</IDVersion>
       <CID>999</CID>
       <URLType>Full</URLType>
       <Response2ndInfo>TRUE</Response2ndInfo>
      </PrimaryInfo>
      <SecondaryInfo>
       <ReaderID>789</ReaderID>
       <TransactionID>235</TransactionID>
       <OS>Windows</OS>
       <Username>kenlevy</Username>
      </SecondaryInfo>
     </Body>
    </ResolutionURLRequest>
  • Response Message (ResURLs)
  • <ResolutionResponse>
     <PrimaryInfo>
      <Version>1</Version>
      <RtnCode>0</RtnCode>
      <URL>
       www.disney.com/fantasia?
        IDProviderID=123:IDVersion=1:CID=999:
        ReaderID=789:ReaderID=789:0S=Windows:
        Username=kenlevy;
       www.disney.com/fantasia/music?
        IDProviderID=123:IDVersion=1:CID=999:
        ReaderID=789:ReaderID=789:0S=Windows:
        Username=kenlevy;
       www.amazon.com/search?fantasia?
        IDProviderID=123:IDVersion=1:CID=999:
        ReaderID=789:ReaderID=789:0S=Windows:
        Username=kenlevy;
     </URL>
      <Desc>
       Fantasia movie info from Disney.com;
       Fantasia music info from Disney.com;
       Fantasia memorabilia from Amazon.com;
      </Desc>
      <BizLogoURL>disney.com/CMDS/logo.jpg</BizLogoURL>
    <BizTemplateURL>disney.com/CMDS/template</BizTemplateURL>
     </PrimaryInfo>
     <SecondaryInfo>
      <Title>Fantasia</Title>
      <Copyright>1960</Copyright>
      <AdultFlag>0</AdultFlag>
      <ContentType>video-videotrack</ContentType>
      <ArtistEmail>fantasia@disney.com</ArtistEmail>
      <BizName>Disney</BizName>
      <BizURL>www.disney.com</BizURL>
     </SecondaryInfo>
    </ResolutionResponse>
  • Resolve Router Address
  • Requesting the registration router address is very similar, where only the request code changes.
  • Request Message (ResResAddress)
  • <ResolutionAddressRequest>
     <Header>
      <Version>1</Version>
      <IDProviderID>123</IDProviderID>
      <RequestCode>ResResAddress</RequestCode>
     </Header>
     <Body>
      <Timestamp>2005-04-14T13:20:00Z</Timestamp>
      <ReaderIP>206.58.236.61</ReaderIP>
     </Body>
    </ResolutionAddressRequest>
  • Response Message (ResResAddress)
  • <ResolutionResponse>
     <PrimaryInfo>
      <Version>1</Version>
      <RtnCode>0</RtnCode>
      <URL>198.70.207.6/CMDS/cgi_bin</URL>
     </PrimaryInfo>
    </ResolutionResponse>
  • Error Text Examples
  • Some error text examples include:
    • 1. “Content is registered, but no URL in database. Please contact <ContentProviderName> at <BizEmail>.”
    • 2. “Content is registered, but URL is marked as inactive. Please contact <ContentProviderName>.”
    • 3. “No record in database matching the content. Please contact <ContentProviderName> at <BizEmail>.”
    • 4. “Request format error—incomplete data. Please contact software provider.”
    • 5. “Primary URL is already registered. Please try again and verify settings, especially Primary and IDVersion.”
    • 6. “Username is already registered. Please try a different username.”
    • 7. “Password is not a valid format. It needs to be at least 6 characters with a number. Please try again.”
    • 8. “CID is already registered. Please verify the CID and ID Version and try again.”
    • 9. “CID is not registered. Please verify the Content Provider Name, ID Version and CID.”
    • 10. “CID is expired as content is out of date.”
  • The system is very flexible and can enable multiple future possibilities. The enhancements include: (1) seed and interoperate multiple ID systems, and (2) enabling “buy now” links for illegitimate content. Another enhancement includes integrating multiple ID Provider technologies or cached Routers.
  • Seed and Interoperate with Multiple ID Systems
  • In a future version of the messages (e.g. with the number “2” in the Version XML header tag), the following steps could enable this system to seed and interoperate with multiple ID systems:
  • 1. Add a registration request code to register other IDs that are linked to a CID
    2. Add a resolution request code to return the other IDs
    3. Add a resolution request code to return the CID given the other ID
  • Even when the other IDs are returned, the receiving software needs to know how to register the other IDs with each proprietary system to enable seeding multiple systems from one piece of software.
  • Registration Request Message
  • Specifically, the following request code could be added to version 2 of the registration message:
  • Request Code: RegOtherIDs
  • XML Tag Format Description Status
    ContentProviderName Integer Content provider name. Required
    Password Text Content provider password. Required
    IDVersion Integer The ID version provides the version of the CID algorithm. Required
    CID Text The unique content ID formatted according to the Required
    IDVersion. Since these requests are few, speed is not
    critical and integer CIDs are carried as text.
    W3C_URI Text World Wide Web Consortium (W3C) Uniform Resource Optional
    Identifier (URI). http://www.ietf.org/rfc/rfc2396.txt. Format
    is text.
    IDF_DOI Text International DOI Foundation (IDF) Digital Object Identifier Optional
    (DOI). www.doi.org. Format is text.
    OASIS_ERI Text OASIS's unique ID. http://www.oasis-open.org/who/ Format Optional
    is text.
    CISAC_CIS Integer International Confederation Of Societies Of Authors And Optional
    Composers (CISAC) Common Information System (CIS).
    http://www.CISAC.org. Format is 96 bits.
    ISO_ISRC Text (12 The ISRC (International Standard Recording Code) was Optional
    chars) developed by ISO (International Organisation for
    Standardisation) to identify sound and audio-visual
    recordings. It is known as International Standard ISO 3901.
    http://www.iso.ch/cate/d9515.html. Format is 12 characters.
    SMPTE_UMID Integer Society of Motion Picture Television Engineers (SMPTE) Optional
    Unique Material Identifier (UMID). www.smpte.org 330M-
    2000. Format is 64 bits.
    ISO- Text Moving Pictures Expert Group (MPEG) Digital Item Optional
    IEC_MPEG21_DII Identification (DII). ISO/IEC 21000-3. Format is text.
    ISO_ISAN Integer ISO International Standard Audiovisual Number (ISAN). Optional
    http://www.nlc-bnc.ca/iso/tc46sc9/isan.htm. Format is 64
    bits.
    ISO_V-ISAN Integer ISO Identifier for Versions of Audiovisual works. w4636 Optional
    Format is 96 bits.
    ISO_ISWC Text (9 ISO Information System Work Code (ISWC). Optional
    chars) http://www.iswc.org. Format is 9 digits.
    cIDf Integer Content ID Forum (cIDf).www.cidf.org. Format is 96 bits. Optional
    IFPI_Grid Text (18 IFPI Global Release Identifier (GRid). www.ifpi.org/grid. Optional
    chars) The format is 18 characters.
    EBU_WUMI Integer European Broadcast Union (EBU) Watermark Unique Optional
    Material Identifier (WUMI). http://www.ebu.ch. Format is
    64 bits.
    Ad-ID Text (12 Ad-ID LLC's advertising ID. www.aaaa.org. Format is 12 Optional
    chars) characters.
    TVAnyTime_CRID Text TV Anytime's unique identifier. http://www.tv-anytime.og. Optional
    Format is text.
    CRF Text Content Reference Forum (CRF). www.crforum.org. Optional
    Format is text.
    ISO_ISBN Integer ISO International Standard Book Number (ISBN). Format is Optional
    (10 10 digits.
    digits)
    ISO_ISSN Integer ISO International Standard Serial Number (ISSN). Format Optional
    (8 digits) is 8 digits.
    ISO_ISTC Text ISO International Standard Textual Work Code. Format is Optional
    text (since not sure of format).
    ONIX Text ONline Information eXchange (ONIX) Optional
    http://www.editeur.org/onix.html. Format is text (since not
    sure of format).
    UCC_UPC Integer Uniform Code Council (UCC) Universal Product Code Optional
    (12 (UPC) www.uc-council.org. Format is 12 digits.
    digits)
    EPCGlobal_EPC Integer EPCGlobal Electronic Product Code (EPC). Optional
    www.EPCGlobal.com. Format is 96 bits.
    Symbol_PDF417 Array Symbol 2D bar code standard. Portable Document Format Optional
    (1.1 (PDF). Format is 1.1 kBytes.
    kBytes)
    Private Binary Binary data that can be used by the ID Provider for any Optional
    private reason.
  • Registration Response Message
  • For the request for registering other system ID (RegOtherIDs): the message returns a “0” for success in the RtnCode field—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • Resolution Request Message
  • The following resolution request codes could be added, with the corresponding response data:
  • Request Code: ResCIDGivenOtherID
  • This request uses the same format as used in ResURL, except the CID XML field contains the other ID data (and the CID is returned).
  • Request Code: ResOtherIDs
  • This request includes primary information, and uses the same data as for RegOtherIDs, except that the Content Provider ID and Password XML tags are optional. In addition, the Timestamp XML tag from the ResURL Request Code above is included as required fields.
  • Resolution Response Message
  • For requesting a CID given another unique ID (ResCIDGivenOtherID): the message returns a “0” for success in the RtnCode field, the CID in the Desc field, and the secondary information if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • For requesting other unique IDs (ResOtherIDs): the message returns a “0” for success in the RtnCode field, and a list of the registered other IDs with each entry separated by a semicolon “;” each entry in the format consisting of the other system XML tag as defined for RegOtherIDs request code and related ID separated by a colon “:” in the Desc field, and the secondary information in the corresponding fields if requested—or “1” for error in the RtnCode, the error URL in the URL field, and the error text in the Desc field.
  • Database Elements
  • The corresponding database elements could be:
  • Unique ID Systems Database
  • Label IDProviderID Version CID W3C URI IDF DOI OASIS ERI
    Size Integer Integer Integer or Text Text Text Text
    continued . . .
    CISAC CIS ISRC SMPTE ISO/IEC MPEG21 ISO ISAN ISO VISAN
    UMID DII
    Integer (96 Text (12 Integer (64 Text Integer (64 Integer (96
    bits) chars) bits) bits) bits)
    continued . . .
    ISO ISWC clDf IFPI Grid EBU WUMI Ad-ID TV AnyTime CRF
    CRID
    Text (9 Integer (96 Text (18 Integer (64 Text (12 Text Text
    digits) bits) chars) bits) chars)
    continued . . .
    ISO ISBN ISO ISSN ISO ONIX UCC UPC UCC EPC Symbol PDF
    ISTC 417
    Integer (10 Integer (8 Text? Text? Integer (12 Integer (96 Array (1.1
    digits) digits) digits) bits) kBytes)
  • “Buy Now” for Illegitimate Content
  • When the multimedia player goes to play or transfer raw content (i.e. neither encrypted nor digitally signed), it calls the reader plug-in to check for a CID and whether or not the content is copy protected. If this raw content is copy protected and contains a CID, an explanation and “buy now” link can be provided to the user.
  • Note that the existence of a CID does not necessarily mean that the content cannot be played, as the consumer may have converted a purchased CD to compressed audio, or bought non-encrypted content. The content needs to also have a copy protection identifier, such as Copy Control Information (CCI) in the content ID, such as DWM, payload. The Player can log this event so it only checks raw content once.
  • By including a rights' flag linked to URLs, one primary rights URL can be registered using existing registration requests, and the rights URL can be returned to the reader to offer a “buy now” link to purchase legitimate content. Specifically, the rights flag is an additional XML field in registration and resolution messages, and is included in the database elements with the URLs.
  • Universal Reader Interface
  • When content owners and retailers are both acting as Content Providers, thus, both marking the content with their own CID, the user sees two different “more info” buttons, one from the content owner and one from the retailer. There could even be an additional “more info” button from the distributor, such as ISP.
  • The Registration Authority could, in the future, provide a plug-in that provides a universal reader interface that integrates CIDs and URLs from different ID Provider detectors. This example implementation could be expanded to include a standard reader-application interface, which is the interface between a generic reader plug-in and ID Provider detector. Thus, all installed ID technology detectors could call (or be called from) the generic reader plug-in, and all CIDs sent to a Router from the generic reader plug-in.
  • Not only would the interface be specified for this generic reader plug-in, but the Registration Authority would also have to provide the plug-in for distribution for all multimedia players. The generic plug-in could have the ID provider plug-ins call it with their resolution request XML messages, then display one “more info” button for the user, and finally send requests for all detected CIDs to a Router. This approach would only require the ID Provider plug-ins to change their call from an IP address to an internal DLL, and remove their user display.
  • Cached Routers
  • The architecture enables Mirror Routers to link to Cached Routers for resolution requests. Cached Routers are not applicable to registration requests since these requests occur neither often nor repetitively, and are immediately forwarded to the Central Router. These Cached Routers will temporarily maintain their Cached Database for recent resolution requests. It is expected that the data will have a time limit set by the Registration Authority. The Cached Routers will also send usage information to their linked Mirror Router daily. This architecture becomes truly distributed and efficient.
  • Concluding Remarks
  • Having described and illustrated the principles of the technology with reference to specific implementations, it will be recognized that the technology can be implemented in many other, different, forms. To provide a comprehensive disclosure without unduly lengthening the specification, applicants incorporate by reference the patents and patent applications referenced above.
  • The methods, processes, and systems described above may be implemented in hardware, software or a combination of hardware and software. For example, the auxiliary data encoding processes may be implemented in a programmable computer or a special purpose digital circuit. Similarly, auxiliary data decoding may be implemented in software, firmware, hardware, or combinations of software, firmware and hardware. The methods and processes described above may be implemented in programs executed from a system's memory (a computer readable medium, such as an electronic, optical or magnetic storage device).
  • The particular combinations of elements and features in the above-detailed embodiments are exemplary only; the interchanging and substitution of these teachings with other teachings in this and the incorporated-by-reference patents/applications are also contemplated. The inventor submits that the invention encompasses the claims set forth below, as well as systems and computer readable mediums that implement these methods. The embodiments described in this document are also inventive and applicant reserves the right to claim various embodiments and combinations thereof as its invention.

Claims (16)

We claim:
1. A system for providing metadata responses for objects in response to a requesting device, the system comprising:
a fingerprint handler for receiving fingerprints extracted from an audio or image signal sensed from a mobile device sensor of the requesting device, the handler in communication with a first database for obtaining a content ID corresponding to the fingerprints, and one or more metadata responses corresponding to the content ID;
a handler for receiving a digital code extracted from the audio or image signal sensed from the mobile device sensor, the handler in communication with a second database for obtaining one or more metadata responses corresponding to the digital code;
a rules processor for processing rules associated with the content ID and digital code, and for determining priority of metadata response to be provided to a requesting mobile device; and
a response aggregator for forming a metadata response based on output of the rules processor, and for providing an aggregated metadata response for presentation on the requesting device.
2. The system of claim 1 wherein the fingerprints comprise sub-fingerprints taken from portions of the audio or image signal, the sub-fingerprints linking to the content ID.
3. The system of claim 2 further including a fingerprint calculator for receiving the portions of the audio or image signal and computing the sub-fingerprints from the portions of the signal.
4. The system of claim 1 wherein the digital code comprises a digital identifier conveying a second content ID extracted from a digital watermark embedded in the audio or image signal.
5. The system of claim 1 including:
a first registration interface for receiving electronic registration of the content ID and the one or more metadata responses, and a content signal version of the audio or image signal for registering fingerprints of the content signal in the first database; and
a first fingerprint calculator in communication with the first registration interface to receive the content signal and calculate fingerprints of the content signal for registration in the first database.
6. The system of claim 5 including a second registration interface configured to receive the digital code and register the digital code in the second database.
7. The system of claim 1 wherein the rule processor is configured to determine, in response to a metadata request, types of content IDs to be extracted from the signal, and provide an instruction to be sent to the requesting mobile device specifying the types of content IDs.
8. The system of claim 1 wherein the rule processor is configured to determine priority of metadata response based on priority of content ID and digital code.
9. The system of claim 1 including:
plural different registration interfaces for registering different content ID types for the audio or image signal; and wherein the rules processor is configured to determine priority of metadata response among the different content ID types.
10. The system of claim 1 including:
plural different fingerprint handlers, each of the plural different fingerprint handlers having a corresponding database;
plural different handlers for processing corresponding digital codes of different types extracted from the audio or image signal; and
wherein the rule processor is configured to determine priority of metadata response among metadata responses obtained by one of the fingerprint handlers relative to one of the handlers for processing the digital codes of different types.
11. A method for providing metadata responses for objects in response to a requesting device, the method comprising:
in a network based resolver system, comprising one or more processors, executing on the one or processors, acts of:
in response to receiving for registration in the router system a content object, calculating sub-fingerprints for audio or image portions of the content object;
assigning a content ID to the sub-fingerprints in a first database;
assigning a digital code to be encoded on the content object in second database;
receiving fingerprints extracted from an audio or image signal sensed from a mobile device sensor of the requesting device;
from the first database, obtaining a content ID corresponding to the fingerprints, and one or more metadata responses corresponding to the content ID;
receiving the digital code extracted from the audio or image signal sensed from the mobile device sensor;
from the second database, obtaining one or more metadata responses corresponding to the digital code;
processing rules associated with the content ID and digital code, and determining priority of metadata response to be provided to a requesting mobile device; and
forming a metadata response based on output of the processing of the rules, and for providing an aggregated metadata response for presentation on the requesting device.
12. The method of claim 11 wherein the digital code comprises a digital identifier conveying a second content ID extracted from a digital watermark embedded in the audio or image signal.
13. The method of claim 11 wherein the processing of the rules comprises, determining, in response to a metadata request, types of content IDs to be extracted from the signal, and providing an instruction to be sent to the requesting mobile device specifying the types of content IDs.
14. The method of claim 11 wherein the processing of the rules comprises determining priority of metadata response based on priority of content ID and digital code.
15. The method of claim 11:
providing plural different registration interfaces for registering different content ID types for the audio or image signal; and wherein the processing of rules comprises determining priority of metadata response among the different content ID types.
16. The method of claim 11 including:
providing plural different fingerprint handlers, each of the plural different fingerprint handlers having a corresponding database;
providing plural different handlers for processing corresponding digital codes of different types extracted from the audio or image signal; and
wherein the processing of rules comprises determining priority of metadata response among metadata responses obtained by one of the fingerprint handlers relative to one of the handlers for processing the digital codes of different types.
US14/577,280 2005-12-21 2014-12-19 Rules driven pan id metadata routing system and network Abandoned US20150205877A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/577,280 US20150205877A1 (en) 2005-12-21 2014-12-19 Rules driven pan id metadata routing system and network
US15/208,541 US10191996B2 (en) 2005-12-21 2016-07-12 Rules driven pan ID metadata routing system and network

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US75325705P 2005-12-21 2005-12-21
US74740806P 2006-05-16 2006-05-16
US11/614,947 US8924412B2 (en) 2005-12-21 2006-12-21 Rules driven pan ID metadata routing system and network
US14/577,280 US20150205877A1 (en) 2005-12-21 2014-12-19 Rules driven pan id metadata routing system and network

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/614,947 Continuation US8924412B2 (en) 2005-12-21 2006-12-21 Rules driven pan ID metadata routing system and network

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/208,541 Continuation US10191996B2 (en) 2005-12-21 2016-07-12 Rules driven pan ID metadata routing system and network

Publications (1)

Publication Number Publication Date
US20150205877A1 true US20150205877A1 (en) 2015-07-23

Family

ID=38218837

Family Applications (8)

Application Number Title Priority Date Filing Date
US11/614,942 Active 2027-04-17 US8364720B2 (en) 2005-12-21 2006-12-21 Content metadata directory services
US11/614,947 Active 2031-11-16 US8924412B2 (en) 2005-12-21 2006-12-21 Rules driven pan ID metadata routing system and network
US11/614,921 Active 2032-07-28 US9275157B2 (en) 2005-12-21 2006-12-21 Content metadata directory services
US13/753,177 Active 2027-12-07 US9218429B2 (en) 2005-12-21 2013-01-29 Content metadata directory services
US14/577,280 Abandoned US20150205877A1 (en) 2005-12-21 2014-12-19 Rules driven pan id metadata routing system and network
US14/977,278 Active 2027-03-21 US9892206B2 (en) 2005-12-21 2015-12-21 Content metadata directory services
US15/208,541 Active 2027-07-05 US10191996B2 (en) 2005-12-21 2016-07-12 Rules driven pan ID metadata routing system and network
US15/894,519 Active 2027-02-18 US10685061B2 (en) 2005-12-21 2018-02-12 Content metadata directory services

Family Applications Before (4)

Application Number Title Priority Date Filing Date
US11/614,942 Active 2027-04-17 US8364720B2 (en) 2005-12-21 2006-12-21 Content metadata directory services
US11/614,947 Active 2031-11-16 US8924412B2 (en) 2005-12-21 2006-12-21 Rules driven pan ID metadata routing system and network
US11/614,921 Active 2032-07-28 US9275157B2 (en) 2005-12-21 2006-12-21 Content metadata directory services
US13/753,177 Active 2027-12-07 US9218429B2 (en) 2005-12-21 2013-01-29 Content metadata directory services

Family Applications After (3)

Application Number Title Priority Date Filing Date
US14/977,278 Active 2027-03-21 US9892206B2 (en) 2005-12-21 2015-12-21 Content metadata directory services
US15/208,541 Active 2027-07-05 US10191996B2 (en) 2005-12-21 2016-07-12 Rules driven pan ID metadata routing system and network
US15/894,519 Active 2027-02-18 US10685061B2 (en) 2005-12-21 2018-02-12 Content metadata directory services

Country Status (6)

Country Link
US (8) US8364720B2 (en)
EP (2) EP2312470B1 (en)
JP (2) JP5016610B2 (en)
CN (1) CN101379464B (en)
CA (1) CA2634489C (en)
WO (1) WO2007076459A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150074090A1 (en) * 2006-06-21 2015-03-12 Napo Enterprises, Llc Historical Media Recommendation Service
US9892206B2 (en) 2005-12-21 2018-02-13 Digimarc Corporation Content metadata directory services
US20180130096A1 (en) * 2016-11-04 2018-05-10 Dynasign Corporation Global-Scale Wireless ID Marketing Registry System for Mobile Device Proximity Marketing
US20180137174A1 (en) * 2016-11-14 2018-05-17 International Business Machines Corporation Container application execution using image metadata
US20190114049A1 (en) * 2016-06-07 2019-04-18 Alibaba Group Holding Limited Method, device, and terminal device for extracting data
US10567485B2 (en) * 2018-01-27 2020-02-18 Vicente Alexei Mantrana-Exposito Techniques for coordinating the sharing of content among applications
US20220095018A1 (en) * 2020-09-23 2022-03-24 Sony Group Corporation Unified programming guide for content associated with broadcaster and vod applications
US20220141312A1 (en) * 2020-10-29 2022-05-05 Comcast Cable Communications, Llc Generating Unique Identifiers

Families Citing this family (487)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7724919B2 (en) 1994-10-21 2010-05-25 Digimarc Corporation Methods and systems for steganographic processing
US7644282B2 (en) 1998-05-28 2010-01-05 Verance Corporation Pre-processed information embedding system
US6737957B1 (en) 2000-02-16 2004-05-18 Verance Corporation Remote control signaling using audio watermarks
US8234218B2 (en) * 2000-10-10 2012-07-31 AddnClick, Inc Method of inserting/overlaying markers, data packets and objects relative to viewable content and enabling live social networking, N-dimensional virtual environments and/or other value derivable from the content
US8707185B2 (en) * 2000-10-10 2014-04-22 Addnclick, Inc. Dynamic information management system and method for content delivery and sharing in content-, metadata- and viewer-based, live social networking among users concurrently engaged in the same and/or similar content
US8316450B2 (en) * 2000-10-10 2012-11-20 Addn Click, Inc. System for inserting/overlaying markers, data packets and objects relative to viewable content and enabling live social networking, N-dimensional virtual environments and/or other value derivable from the content
US8117281B2 (en) * 2006-11-02 2012-02-14 Addnclick, Inc. Using internet content as a means to establish live social networks by linking internet users to each other who are simultaneously engaged in the same and/or similar content
US8055899B2 (en) 2000-12-18 2011-11-08 Digimarc Corporation Systems and methods using digital watermarking and identifier extraction to provide promotional opportunities
US7127463B2 (en) * 2002-04-18 2006-10-24 International Business Machines Corporation Optimization of database network traffic based upon data-use analysis
US7356523B2 (en) * 2002-05-23 2008-04-08 International Business Machines Corporation Dynamic optimization of prepared statements in a statement pool
EP2442566A3 (en) 2002-10-15 2012-08-08 Verance Corporation Media Monitoring, Management and Information System
EP2357623A1 (en) 2003-04-25 2011-08-17 Apple Inc. Graphical user interface for browsing, searching and presenting media items
US20040215534A1 (en) 2003-04-25 2004-10-28 Apple Computer, Inc. Method and system for network-based allowance control
US20060239501A1 (en) 2005-04-26 2006-10-26 Verance Corporation Security enhancements of digital watermarks for multi-media content
US7844548B2 (en) 2003-10-15 2010-11-30 Apple Inc. Techniques and systems for electronic submission of media for network-based distribution
US7555543B2 (en) * 2003-12-19 2009-06-30 Microsoft Corporation Server architecture for network resource information routing
US7668939B2 (en) * 2003-12-19 2010-02-23 Microsoft Corporation Routing of resource information in a network
US7647385B2 (en) * 2003-12-19 2010-01-12 Microsoft Corporation Techniques for limiting network access
US7920713B2 (en) * 2004-12-20 2011-04-05 Lsi Corporation Recorded video broadcast, streaming, download, and disk distribution with watermarking instructions
US20060184960A1 (en) * 2005-02-14 2006-08-17 Universal Music Group, Inc. Method and system for enabling commerce from broadcast content
EP1866780A4 (en) 2005-03-30 2013-07-31 Welch Allyn Inc Communication of information between a plurality of network elements
US8020004B2 (en) 2005-07-01 2011-09-13 Verance Corporation Forensic marking using a common customization function
US8781967B2 (en) 2005-07-07 2014-07-15 Verance Corporation Watermarking in an encrypted domain
US20070027808A1 (en) * 2005-07-29 2007-02-01 Microsoft Corporation Strategies for queuing events for subsequent processing
US20070028262A1 (en) * 2005-07-29 2007-02-01 Zermatt Systems, Inc. Virtual discovery of content available to a device
US20070162761A1 (en) 2005-12-23 2007-07-12 Davis Bruce L Methods and Systems to Help Detect Identity Fraud
US20080027931A1 (en) * 2006-02-27 2008-01-31 Vobile, Inc. Systems and methods for publishing, searching, retrieving and binding metadata for a digital object
US7689554B2 (en) * 2006-02-28 2010-03-30 Yahoo! Inc. System and method for identifying related queries for languages with multiple writing systems
US20080086311A1 (en) * 2006-04-11 2008-04-10 Conwell William Y Speech Recognition, and Related Systems
US9313248B2 (en) 2006-04-13 2016-04-12 Johnny Stuart Epstein Method and apparatus for delivering encoded content
US8117246B2 (en) * 2006-04-17 2012-02-14 Microsoft Corporation Registering, transfering, and acting on event metadata
GB0702603D0 (en) * 2006-05-05 2007-03-21 Omnifone Ltd Pc client
US7962634B2 (en) 2006-05-15 2011-06-14 Apple Inc. Submission of metadata content and media content to a media distribution system
US8015237B2 (en) * 2006-05-15 2011-09-06 Apple Inc. Processing of metadata content and media content received by a media distribution system
US7827162B2 (en) * 2006-05-15 2010-11-02 Apple Inc. Media package format for submission to a media distribution system
US8762418B1 (en) * 2006-05-31 2014-06-24 Oracle America, Inc. Metadata that allows refiltering and data reclassification without accessing the data
JP4175390B2 (en) * 2006-06-09 2008-11-05 ソニー株式会社 Information processing apparatus, information processing method, and computer program
US20080040374A1 (en) * 2006-08-04 2008-02-14 Yahoo! Inc. Automated identification and tagging of pages suitable for subsequent display with a mobile device
KR100816184B1 (en) * 2006-08-10 2008-03-21 한국전자거래진흥원 System of electronic document repository which guarantees authenticity of the electronic document and issues certificates and method of registering, reading, issuing, transferring, a certificate issuing performed in the system
US7693906B1 (en) * 2006-08-22 2010-04-06 Qurio Holdings, Inc. Methods, systems, and products for tagging files
US8738749B2 (en) 2006-08-29 2014-05-27 Digimarc Corporation Content monitoring and host compliance evaluation
US8707459B2 (en) * 2007-01-19 2014-04-22 Digimarc Corporation Determination of originality of content
US8010511B2 (en) 2006-08-29 2011-08-30 Attributor Corporation Content monitoring and compliance enforcement
US20080059425A1 (en) * 2006-08-29 2008-03-06 Attributor Corporation Compliance information retrieval
US9654447B2 (en) 2006-08-29 2017-05-16 Digimarc Corporation Customized handling of copied content based on owner-specified similarity thresholds
US20080059211A1 (en) * 2006-08-29 2008-03-06 Attributor Corporation Content monitoring and compliance
US8832246B2 (en) * 2006-09-18 2014-09-09 Emc Corporation Service level mapping method
US8612570B1 (en) 2006-09-18 2013-12-17 Emc Corporation Data classification and management using tap network architecture
US8943401B2 (en) * 2006-09-29 2015-01-27 Yahoo! Inc. Script-based content-embedding code generation in digital media benefit attachment mechanism
US8965783B2 (en) * 2006-09-29 2015-02-24 Yahoo! Inc. Content-embedding code generation in digital media benefit attachment mechanism
CA2665556A1 (en) * 2006-10-04 2008-04-17 Welch Allyn, Inc. Dynamic medical object information base
US9417758B2 (en) * 2006-11-21 2016-08-16 Daniel E. Tsai AD-HOC web content player
US9477969B2 (en) 2006-12-12 2016-10-25 Yahoo! Inc. Automatic feed creation for non-feed enabled information objects
US20090234814A1 (en) * 2006-12-12 2009-09-17 Marco Boerries Configuring a search engine results page with environment-specific information
US10242415B2 (en) 2006-12-20 2019-03-26 Digimarc Corporation Method and system for determining content treatment
US9179200B2 (en) 2007-03-14 2015-11-03 Digimarc Corporation Method and system for determining content treatment
US9582804B2 (en) * 2006-12-22 2017-02-28 Excalibur Ip, Llc Link retrofitting of digital media objects
KR20080063601A (en) * 2007-01-02 2008-07-07 삼성전자주식회사 Apparatus and method for transmission of content rights through multimedia message in mobile communication system
US8819079B2 (en) * 2007-02-02 2014-08-26 Rogers Family Trust System and method for defining application definition functionality for general purpose web presences
US8073863B2 (en) * 2007-02-12 2011-12-06 Bsp Software Llc Batch management of metadata in a business intelligence architecture
US9098167B1 (en) 2007-02-26 2015-08-04 Qurio Holdings, Inc. Layered visualization of content representations
US8776149B1 (en) * 2007-03-05 2014-07-08 At&T Intellectual Property I, L.P. Preference-based media alerts
US8108834B2 (en) * 2007-03-21 2012-01-31 International Business Machines Corporation Defining and executing processes using declarative programming language constructs
US20080281945A1 (en) * 2007-03-23 2008-11-13 Gogomobile, Inc. Distributed content system and method
US9996627B2 (en) * 2007-03-30 2018-06-12 Excalibur Ip, Llc Point of presence distribution mechanism for digital content objects
EP2156386A4 (en) * 2007-05-03 2012-05-02 Google Inc Monetization of digital content contributions
US8094872B1 (en) 2007-05-09 2012-01-10 Google Inc. Three-dimensional wavelet based video fingerprinting
US8019717B2 (en) * 2007-05-18 2011-09-13 Sap Ag Definition of context for specifying uniqueness of identifiers and context-based identifier mapping
US20080301685A1 (en) * 2007-05-31 2008-12-04 Novell, Inc. Identity-aware scheduler service
US8819080B2 (en) * 2007-06-13 2014-08-26 The Boeing Company System and method for collection, retrieval, and distribution of data
US8611422B1 (en) 2007-06-19 2013-12-17 Google Inc. Endpoint based video fingerprinting
KR101370381B1 (en) * 2007-06-26 2014-03-06 삼성전자주식회사 User terminal device and proxy server of IPTV System, operating method thereof
US7991910B2 (en) 2008-11-17 2011-08-02 Amazon Technologies, Inc. Updating routing information based on client location
US8028090B2 (en) 2008-11-17 2011-09-27 Amazon Technologies, Inc. Request routing utilizing client location information
US20090012987A1 (en) * 2007-07-05 2009-01-08 Kaminsky David L Method and system for delivering role-appropriate policies
KR101340036B1 (en) * 2007-07-10 2013-12-10 삼성전자주식회사 Method for generating Electronic Content Guide and apparatus therefor
US20090031381A1 (en) * 2007-07-24 2009-01-29 Honeywell International, Inc. Proxy video server for video surveillance
US7792128B2 (en) * 2007-08-06 2010-09-07 Cisco Technology, Inc. Maintaining a content category cache at a gateway on a data path
US8468212B2 (en) 2007-08-08 2013-06-18 Silicon Image, Inc. Network repository for metadata
US9111285B2 (en) 2007-08-27 2015-08-18 Qurio Holdings, Inc. System and method for representing content, user presence and interaction within virtual world advertising environments
US20090061902A1 (en) * 2007-09-05 2009-03-05 Fatdoor, Inc. Directories and groupings in a geo-spatial environment
US20090076897A1 (en) * 2007-09-13 2009-03-19 Robert Ennals Location-based filtering and advertising enhancements for merged browsing of network contents
US8548964B1 (en) 2007-09-28 2013-10-01 Emc Corporation Delegation of data classification using common language
US8868720B1 (en) 2007-09-28 2014-10-21 Emc Corporation Delegation of discovery functions in information management system
US9141658B1 (en) 2007-09-28 2015-09-22 Emc Corporation Data classification and management for risk mitigation
US8522248B1 (en) 2007-09-28 2013-08-27 Emc Corporation Monitoring delegated operations in information management systems
US9461890B1 (en) 2007-09-28 2016-10-04 Emc Corporation Delegation of data management policy in an information management system
US9323901B1 (en) 2007-09-28 2016-04-26 Emc Corporation Data classification for digital rights management
CN101821735B (en) * 2007-10-08 2013-02-13 皇家飞利浦电子股份有限公司 Generating metadata for association with collection of content items
US8392604B2 (en) * 2007-10-09 2013-03-05 Yahoo! Inc. Peer to peer browser content caching
US8441475B2 (en) * 2007-10-24 2013-05-14 International Business Machines Corporation Arrangements for enhancing multimedia features in a virtual universe
US8261307B1 (en) 2007-10-25 2012-09-04 Qurio Holdings, Inc. Wireless multimedia content brokerage service for real time selective content provisioning
US8798436B2 (en) * 2007-10-31 2014-08-05 Ryan Steelberg Video-related meta data engine, system and method
US8630525B2 (en) * 2007-10-31 2014-01-14 Iron Mountain Group, LLC Video-related meta data engine system and method
US20100076866A1 (en) * 2007-10-31 2010-03-25 Ryan Steelberg Video-related meta data engine system and method
US20090119121A1 (en) * 2007-11-02 2009-05-07 Mwstory Co., Ltd. Peer-to-peer service providing system and method for preventing contents from being illegally distributed
US10452768B2 (en) * 2007-11-03 2019-10-22 International Business Machines Corporation Managing source annotation metadata
US20090132462A1 (en) * 2007-11-19 2009-05-21 Sony Corporation Distributed metadata extraction
US7953731B2 (en) * 2007-11-19 2011-05-31 Cisco Technology, Inc. Enhancing and optimizing enterprise search
KR100911058B1 (en) * 2007-11-22 2009-08-06 한국전자통신연구원 Method of finding metadata server
US8676902B2 (en) * 2007-11-28 2014-03-18 International Business Machines Corporation System and method for service oriented email client application
US7756920B2 (en) * 2007-11-28 2010-07-13 Apple Inc. Resubmission of media for network-based distribution
KR101528853B1 (en) * 2007-12-14 2015-07-01 삼성전자주식회사 Method and apparatus for sevicing API and creating API mashup, and computer readable medium thereof
US9773098B1 (en) * 2007-12-19 2017-09-26 Google Inc. Media content feed format for management of content in a content hosting website
US8856861B2 (en) * 2007-12-20 2014-10-07 Samsung Electronics Co., Ltd. Generic rights token and DRM-related service pointers in a common protected content file
US10692092B2 (en) * 2007-12-21 2020-06-23 Ebay Inc. System and method for providing on-line advertising with dynamic content
US8949326B1 (en) * 2007-12-21 2015-02-03 Liveops, Inc. Routing work to resources in a web-based social network
US20090182739A1 (en) * 2008-01-10 2009-07-16 Microsoft Corporation Using metadata to route documents
EP2235912A4 (en) * 2008-01-24 2016-05-04 Ericsson Telefon Ab L M Method and apparatus for checking aggregated web sevices
US20090210323A1 (en) * 2008-02-13 2009-08-20 Voxp Pte. Ltd. Distributed Purchasing System for User Generated Content and/or Products/Services Advertised Through User Generated Content
US7885951B1 (en) * 2008-02-15 2011-02-08 Lmr Inventions, Llc Method for embedding a media hotspot within a digital media file
US8682960B2 (en) 2008-03-14 2014-03-25 Nokia Corporation Methods, apparatuses, and computer program products for providing filtered services and content based on user context
WO2009116856A2 (en) * 2008-03-18 2009-09-24 Civolution B.V. Generating statistics of popular content
US7970820B1 (en) 2008-03-31 2011-06-28 Amazon Technologies, Inc. Locality based content distribution
US7962597B2 (en) 2008-03-31 2011-06-14 Amazon Technologies, Inc. Request routing based on class
US8606996B2 (en) 2008-03-31 2013-12-10 Amazon Technologies, Inc. Cache optimization
US8321568B2 (en) 2008-03-31 2012-11-27 Amazon Technologies, Inc. Content management
US8447831B1 (en) 2008-03-31 2013-05-21 Amazon Technologies, Inc. Incentive driven content delivery
US8601090B1 (en) 2008-03-31 2013-12-03 Amazon Technologies, Inc. Network resource identification
JP5170235B2 (en) * 2008-03-31 2013-03-27 富士通株式会社 Context information collection management system, domain management device, semantic information system management device, route management device, and context information collection management method
US8886745B2 (en) * 2008-04-07 2014-11-11 Qualcomm Incorporated Methods and apparatus for delivering auxiliary data to device
US20090259684A1 (en) * 2008-04-09 2009-10-15 Macrovision Corporation Digital content library service
US20090257336A1 (en) * 2008-04-09 2009-10-15 Anthony David Knight Device for marking optical discs in a non-destructive, tamper-proof manner for licensing and other purposes
WO2009132444A1 (en) 2008-04-28 2009-11-05 Sitemasher Corporation Object-oriented system for creating and managing websites and their content
US8261363B2 (en) * 2008-04-29 2012-09-04 Ricoh Company, Ltd. Managing electronic data with identification data
US9342287B2 (en) 2008-05-05 2016-05-17 Apple Inc. Software program ratings
US10255580B2 (en) 2008-05-05 2019-04-09 Apple Inc. Network-based distribution of application products
US20090276333A1 (en) * 2008-05-05 2009-11-05 Cortes Ricardo D Electronic submission and management of digital products for network-based distribution
US9076176B2 (en) 2008-05-05 2015-07-07 Apple Inc. Electronic submission of application programs for network-based distribution
DE102008037094B4 (en) * 2008-05-08 2015-07-30 Siemens Aktiengesellschaft Storing and providing medical image data in a computer-based distributed system
US8458352B2 (en) * 2008-05-14 2013-06-04 International Business Machines Corporation Creating a virtual universe data feed and distributing the data feed beyond the virtual universe
US9268454B2 (en) * 2008-05-14 2016-02-23 International Business Machines Corporation Trigger event based data feed of virtual universe data
CN101588484B (en) * 2008-05-19 2011-02-09 华为技术有限公司 Method, device, system and terminal for uploading metadata
GB2460412B (en) * 2008-05-28 2012-09-19 Hewlett Packard Development Co Information sharing
WO2009149440A1 (en) * 2008-06-06 2009-12-10 Divx, Inc. Multimedia distribution and playback systems and methods using enhanced metadata structures
US8074258B2 (en) * 2008-06-18 2011-12-06 Microsoft Corporation Obtaining digital identities or tokens through independent endpoint resolution
GB2461050A (en) * 2008-06-18 2009-12-23 Geotate Bv Storing location metadata independently of image data
US8078205B2 (en) * 2008-06-24 2011-12-13 Snapdat Networks, Inc. Method and system for sharing and storing digital information in mobile devices
US8259938B2 (en) 2008-06-24 2012-09-04 Verance Corporation Efficient and secure forensic marking in compressed
US8522015B2 (en) * 2008-06-27 2013-08-27 Microsoft Corporation Authentication of binaries in memory with proxy code execution
US9407681B1 (en) 2010-09-28 2016-08-02 Amazon Technologies, Inc. Latency measurement in resource requests
US20100042615A1 (en) * 2008-08-12 2010-02-18 Peter Rinearson Systems and methods for aggregating content on a user-content driven website
US8520979B2 (en) * 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
US8407609B2 (en) * 2008-08-21 2013-03-26 Linqware Inc. System and method for providing and tracking the provision of audio and visual presentations via a computer network
US8527474B2 (en) * 2008-08-28 2013-09-03 Visa Usa, Inc. Acquirer device and method for support of merchant data processing
US8548946B2 (en) * 2008-10-14 2013-10-01 Microsoft Corporation Content package for electronic distribution
CN102197632A (en) * 2008-10-29 2011-09-21 杜比实验室特许公司 Internetworking domain and key system
US20100205628A1 (en) 2009-02-12 2010-08-12 Davis Bruce L Media processing methods and arrangements
US8356059B2 (en) * 2008-11-14 2013-01-15 Microsoft Corporation Method and system for rapid and cost-effective development of user generated content
US8073940B1 (en) 2008-11-17 2011-12-06 Amazon Technologies, Inc. Managing content delivery network service providers
US20100125567A1 (en) * 2008-11-18 2010-05-20 Morris Robert P Method and System for managing Metadata associated with a resource
US10977693B2 (en) 2008-11-26 2021-04-13 Free Stream Media Corp. Association of content identifier of audio-visual data with additional data through capture infrastructure
US10880340B2 (en) 2008-11-26 2020-12-29 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US10334324B2 (en) 2008-11-26 2019-06-25 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US9986279B2 (en) 2008-11-26 2018-05-29 Free Stream Media Corp. Discovery, access control, and communication with networked services
US8180891B1 (en) 2008-11-26 2012-05-15 Free Stream Media Corp. Discovery, access control, and communication with networked services from within a security sandbox
US9154942B2 (en) 2008-11-26 2015-10-06 Free Stream Media Corp. Zero configuration communication between a browser and a networked media device
US10567823B2 (en) 2008-11-26 2020-02-18 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US9519772B2 (en) 2008-11-26 2016-12-13 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US9961388B2 (en) 2008-11-26 2018-05-01 David Harrison Exposure of public internet protocol addresses in an advertising exchange server to improve relevancy of advertisements
US10631068B2 (en) 2008-11-26 2020-04-21 Free Stream Media Corp. Content exposure attribution based on renderings of related content across multiple devices
US10419541B2 (en) 2008-11-26 2019-09-17 Free Stream Media Corp. Remotely control devices over a network without authentication or registration
US8412823B1 (en) 2009-03-27 2013-04-02 Amazon Technologies, Inc. Managing tracking information entries in resource cache components
US8756341B1 (en) * 2009-03-27 2014-06-17 Amazon Technologies, Inc. Request routing utilizing popularity information
US8688837B1 (en) 2009-03-27 2014-04-01 Amazon Technologies, Inc. Dynamically translating resource identifiers for request routing using popularity information
CN102461066B (en) 2009-05-21 2015-09-09 数字标记公司 Differentiate the method for content signal
JP5317835B2 (en) * 2009-06-03 2013-10-16 キヤノン株式会社 Content attribute information providing apparatus, content attribute information providing method, and computer program
US10127295B2 (en) * 2009-06-05 2018-11-13 Microsoft Technolofy Licensing, Llc Geographic co-location service for cloud computing
US8782236B1 (en) 2009-06-16 2014-07-15 Amazon Technologies, Inc. Managing resources using resource expiration data
US8095552B2 (en) * 2009-07-14 2012-01-10 International Business Machines Corporation Data tag descriptor
US9213776B1 (en) 2009-07-17 2015-12-15 Open Invention Network, Llc Method and system for searching network resources to locate content
WO2011011718A2 (en) 2009-07-24 2011-01-27 Welch Allyn, Inc. Configurable health-care equipment apparatus
US9729609B2 (en) 2009-08-07 2017-08-08 Apple Inc. Automatic transport discovery for media submission
WO2011021909A2 (en) 2009-08-21 2011-02-24 Samsung Electronics Co., Ltd. Method and apparatus for providing contents via network, method and apparatus for receiving contents via network, and method and apparatus for backing up data via network, backup data providing device, and backup system
US8397073B1 (en) 2009-09-04 2013-03-12 Amazon Technologies, Inc. Managing secure content in a content delivery network
US8935217B2 (en) 2009-09-08 2015-01-13 Apple Inc. Digital asset validation prior to submission for network-based distribution
US8433771B1 (en) 2009-10-02 2013-04-30 Amazon Technologies, Inc. Distribution network with forward resource propagation
US8175617B2 (en) 2009-10-28 2012-05-08 Digimarc Corporation Sensor-based mobile search, related methods and systems
US8644971B2 (en) * 2009-11-09 2014-02-04 Phil Weinstein System and method for providing music based on a mood
US20110125585A1 (en) * 2009-11-20 2011-05-26 Rovi Technologies Corporation Content recommendation for a content system
US20110126230A1 (en) * 2009-11-20 2011-05-26 Rovi Technologies Corporation Content ingestion for a content system
US20110125774A1 (en) * 2009-11-20 2011-05-26 Rovi Technologies Corporation Content integration for a content system
US20110125809A1 (en) * 2009-11-20 2011-05-26 Rovi Technologies Corporation Managing different formats for media files and media playback devices
US8719867B2 (en) * 2009-11-20 2014-05-06 At&T Intellectual Property I, Lp Method and apparatus for presenting media content
US20110126276A1 (en) * 2009-11-20 2011-05-26 Rovi Technologies Corporation Cross platform gateway system and service
US20110126104A1 (en) * 2009-11-20 2011-05-26 Rovi Technologies Corporation User interface for managing different formats for media files and media playback devices
US20110125753A1 (en) * 2009-11-20 2011-05-26 Rovi Technologies Corporation Data delivery for a content system
US9111004B2 (en) * 2009-12-17 2015-08-18 International Business Machines Corporation Temporal scope translation of meta-models using semantic web technologies
US9026412B2 (en) * 2009-12-17 2015-05-05 International Business Machines Corporation Managing and maintaining scope in a service oriented architecture industry model repository
US8631071B2 (en) * 2009-12-17 2014-01-14 International Business Machines Corporation Recognition of and support for multiple versions of an enterprise canonical message model
KR101870928B1 (en) 2010-01-19 2018-07-19 엘지전자 주식회사 Electronic device and operating method of same
WO2011092786A1 (en) * 2010-01-26 2011-08-04 日本電気株式会社 Content distribution system, content distribution method, application server system, user terminal, and recording medium
US9495338B1 (en) 2010-01-28 2016-11-15 Amazon Technologies, Inc. Content distribution network
US9037790B2 (en) * 2010-03-05 2015-05-19 International Business Machines Corporation Systems, methods, and computer program products for providing high availability metadata about data
US8140570B2 (en) * 2010-03-11 2012-03-20 Apple Inc. Automatic discovery of metadata
US10437437B1 (en) * 2010-03-25 2019-10-08 Open Invention Network Llc Method and device for appending information in a conversation in a voice based networking website
US9645996B1 (en) 2010-03-25 2017-05-09 Open Invention Network Llc Method and device for automatically generating a tag from a conversation in a social networking website
US9565298B1 (en) * 2010-03-25 2017-02-07 Open Invention Network Llc Method and device for appending information in a conversation in a voice based networking website
CN101872447A (en) * 2010-06-13 2010-10-27 深圳市天朗时代科技有限公司 Network platform system and management method
US8631508B2 (en) 2010-06-22 2014-01-14 Rovi Technologies Corporation Managing licenses of media files on playback devices
CN101894228B (en) * 2010-06-23 2017-04-12 深圳市天朗时代科技有限公司 Identifier distribution and analysis method and multimedia reader
WO2012009485A1 (en) 2010-07-13 2012-01-19 Rovi Technologies Corporation Systems and methods for electronic sell-through of interactive multimedia content authored for distribution via physical media
WO2012009672A1 (en) * 2010-07-16 2012-01-19 Altruik, Inc. System and method for improving webpage indexing and optimization
USD632397S1 (en) 2010-07-22 2011-02-08 Welch Allyn, Inc. Portions of a patient-monitor housing
USD635681S1 (en) 2010-07-22 2011-04-05 Welch Allyn, Inc. Patient-monitor housing
USD671222S1 (en) 2010-07-22 2012-11-20 Welch Allyn, Inc. Module for a patient-monitor or the like
US8712930B1 (en) 2010-08-09 2014-04-29 Google Inc. Encoding digital content based on models for predicting similarity between exemplars
WO2012028952A2 (en) * 2010-08-31 2012-03-08 France Telecom Relationship management system and method of operation thereof
US8655881B2 (en) 2010-09-16 2014-02-18 Alcatel Lucent Method and apparatus for automatically tagging content
US8533192B2 (en) 2010-09-16 2013-09-10 Alcatel Lucent Content capture device and methods for automatically tagging content
US9607131B2 (en) 2010-09-16 2017-03-28 Verance Corporation Secure and efficient content screening in a networked environment
US8666978B2 (en) * 2010-09-16 2014-03-04 Alcatel Lucent Method and apparatus for managing content tagging and tagged content
US9003035B1 (en) 2010-09-28 2015-04-07 Amazon Technologies, Inc. Point of presence management in request routing
US9712484B1 (en) 2010-09-28 2017-07-18 Amazon Technologies, Inc. Managing request routing information utilizing client identifiers
US8468247B1 (en) 2010-09-28 2013-06-18 Amazon Technologies, Inc. Point of presence management in request routing
US10958501B1 (en) 2010-09-28 2021-03-23 Amazon Technologies, Inc. Request routing information based on client IP groupings
US8527748B2 (en) * 2010-10-01 2013-09-03 Schneider Electric USA, Inc. System and method for hosting encrypted monitoring data
US8880905B2 (en) 2010-10-27 2014-11-04 Apple Inc. Methods for processing private metadata
US8762852B2 (en) * 2010-11-04 2014-06-24 Digimarc Corporation Smartphone-based methods and systems
US20120124172A1 (en) 2010-11-15 2012-05-17 Google Inc. Providing Different Versions of a Media File
EP2641186B1 (en) * 2010-11-16 2023-01-11 TIBCO Software Inc. Fast content-based routing
US8452874B2 (en) 2010-11-22 2013-05-28 Amazon Technologies, Inc. Request routing processing
US8935360B2 (en) * 2010-12-03 2015-01-13 Salesforce.Com, Inc. Techniques for metadata-driven dynamic content serving
US9437239B2 (en) 2010-12-09 2016-09-06 Solabyte Corporation Electronic system for the protection and control of license transactions associated with the disablement of replicated read only media and its bound licensed content
US9075964B2 (en) 2010-12-09 2015-07-07 Solabyte Corporation Electronic system for the protection and control of license transactions associated with the alteration of replicated read only media and its bound licensed content
US20120159337A1 (en) * 2010-12-17 2012-06-21 Kerry Travilla System and method for recommending media content
US20120254351A1 (en) * 2011-01-06 2012-10-04 Mr. Ramarao Babbellapati Method and system for publishing digital content for passive consumption on mobile and portable devices
US8676794B2 (en) 2011-02-09 2014-03-18 Bellmar Communications Llc Method and system for online searching of physical objects
CN103765453B (en) 2011-02-16 2018-08-14 维萨国际服务协会 Snap mobile payment device, method and system
US10586227B2 (en) 2011-02-16 2020-03-10 Visa International Service Association Snap mobile payment apparatuses, methods and systems
AU2011200696B2 (en) * 2011-02-17 2014-03-06 Canon Kabushiki Kaisha Method, apparatus and system for rating images
US20120221498A1 (en) * 2011-02-19 2012-08-30 Setjam, Inc. Aggregating and normalizing entertainment media
BR112013021057A2 (en) 2011-02-22 2020-11-10 Visa International Service Association universal electronic payment devices, methods and systems
US8453048B2 (en) 2011-03-07 2013-05-28 Microsoft Corporation Time-based viewing of electronic documents
US9607084B2 (en) * 2011-03-11 2017-03-28 Cox Communications, Inc. Assigning a single master identifier to all related content assets
US20120240243A1 (en) * 2011-03-16 2012-09-20 Yasden - Comercio International E Servicos, Sociedade Unipessoal LDA System, method, and computer program product for creation, transmission, and tracking of electronic document
US9071569B1 (en) * 2011-03-22 2015-06-30 Amdocs Software Systems Limited System, method, and computer program for content metadata and authorization exchange between content providers and service providers
US8538679B1 (en) 2011-04-08 2013-09-17 Oberweis Dairy, Inc. Enhanced geocoding
US9235863B2 (en) 2011-04-15 2016-01-12 Facebook, Inc. Display showing intersection between users of a social networking system
US10467042B1 (en) 2011-04-27 2019-11-05 Amazon Technologies, Inc. Optimized deployment based upon customer locality
US8521759B2 (en) * 2011-05-23 2013-08-27 Rovi Technologies Corporation Text-based fuzzy search
US8842875B2 (en) 2011-05-26 2014-09-23 Digimarc Corporation Image related methods and systems
US8699747B2 (en) 2011-05-26 2014-04-15 Digimarc Corporation Image-related methods and systems
US9146881B2 (en) * 2011-06-03 2015-09-29 Commandhub, Inc. Mobile data vault
US8782532B2 (en) * 2011-06-10 2014-07-15 Qualcomm Innovation Center, Inc. Website object-request method and system
US9515904B2 (en) 2011-06-21 2016-12-06 The Nielsen Company (Us), Llc Monitoring streaming media content
US9355393B2 (en) 2011-08-18 2016-05-31 Visa International Service Association Multi-directional wallet connector apparatuses, methods and systems
US9582598B2 (en) 2011-07-05 2017-02-28 Visa International Service Association Hybrid applications utilizing distributed models and views apparatuses, methods and systems
US10121129B2 (en) 2011-07-05 2018-11-06 Visa International Service Association Electronic wallet checkout platform apparatuses, methods and systems
US8365069B1 (en) * 2011-08-17 2013-01-29 International Business Machines Corporation Web content management based on timeliness metadata
US10242358B2 (en) 2011-08-18 2019-03-26 Visa International Service Association Remote decoupled application persistent state apparatuses, methods and systems
US9710807B2 (en) 2011-08-18 2017-07-18 Visa International Service Association Third-party value added wallet features and interfaces apparatuses, methods and systems
US10825001B2 (en) 2011-08-18 2020-11-03 Visa International Service Association Multi-directional wallet connector apparatuses, methods and systems
US9665656B2 (en) * 2011-08-18 2017-05-30 International Business Machines Corporation Automated service solution delivery
US8903944B2 (en) * 2011-09-09 2014-12-02 Cable Television Laboratories, Inc. Version selective content delivery
US10223730B2 (en) 2011-09-23 2019-03-05 Visa International Service Association E-wallet store injection search apparatuses, methods and systems
CN103918247B (en) 2011-09-23 2016-08-24 数字标记公司 Intelligent mobile phone sensor logic based on background environment
EP2579609A1 (en) * 2011-10-06 2013-04-10 Thomson Licensing Method and apparatus for providing information for a multimedia content item
US9292842B2 (en) * 2011-10-28 2016-03-22 Anil H. Pereira Systems and methods for managing software licensing agreements
US10277421B2 (en) * 2011-10-31 2019-04-30 Extreme Networks, Inc. Route lookup resolution
US8533481B2 (en) 2011-11-03 2013-09-10 Verance Corporation Extraction of embedded watermarks from a host content based on extrapolation techniques
US8923548B2 (en) 2011-11-03 2014-12-30 Verance Corporation Extraction of embedded watermarks from a host content using a plurality of tentative watermarks
US8682026B2 (en) 2011-11-03 2014-03-25 Verance Corporation Efficient extraction of embedded watermarks in the presence of host content distortions
US8615104B2 (en) 2011-11-03 2013-12-24 Verance Corporation Watermark extraction based on tentative watermarks
US20130124480A1 (en) * 2011-11-14 2013-05-16 Clint Chua System and Method for Viewer Based Image Metadata Sanitization
US8745403B2 (en) 2011-11-23 2014-06-03 Verance Corporation Enhanced content management based on watermark extraction records
US9462040B2 (en) * 2011-12-07 2016-10-04 Cisco Technology, Inc. Network-based dynamic data management
US9323902B2 (en) * 2011-12-13 2016-04-26 Verance Corporation Conditional access using embedded watermarks
US9547753B2 (en) 2011-12-13 2017-01-17 Verance Corporation Coordinated watermarking
US8856957B1 (en) * 2011-12-22 2014-10-07 Amazon Technologies, Inc. Federated identity broker
US9129087B2 (en) 2011-12-30 2015-09-08 Rovi Guides, Inc. Systems and methods for managing digital rights based on a union or intersection of individual rights
US9009794B2 (en) 2011-12-30 2015-04-14 Rovi Guides, Inc. Systems and methods for temporary assignment and exchange of digital access rights
AU2013214801B2 (en) 2012-02-02 2018-06-21 Visa International Service Association Multi-source, multi-dimensional, cross-entity, multimedia database platform apparatuses, methods and systems
US8971791B2 (en) * 2012-02-16 2015-03-03 1974 Productions Inc. Method for delivering music content to a smart phone
US10142383B2 (en) 2012-02-16 2018-11-27 1974 Productions, Inc. Method for delivering music content to a smart phone
US9727708B2 (en) 2012-02-21 2017-08-08 Pulselocker, Inc. Method and apparatus for limiting access to data by process or computer function with stateless encryption
EP2817744A4 (en) * 2012-02-23 2015-11-04 Vidispine Ab Method and system for searches of digital content using a time interval
US9626664B2 (en) 2012-03-07 2017-04-18 Clearxchange, Llc System and method for transferring funds
US10970688B2 (en) 2012-03-07 2021-04-06 Early Warning Services, Llc System and method for transferring funds
US10395247B2 (en) 2012-03-07 2019-08-27 Early Warning Services, Llc Systems and methods for facilitating a secure transaction at a non-financial institution system
US10395223B2 (en) 2012-03-07 2019-08-27 Early Warning Services, Llc System and method for transferring funds
US20130246385A1 (en) * 2012-03-13 2013-09-19 Microsoft Corporation Experience recommendation system based on explicit user preference
WO2013147779A1 (en) * 2012-03-28 2013-10-03 Diy Media, Inc. System and method for tracking use of portable objects
US8620021B2 (en) 2012-03-29 2013-12-31 Digimarc Corporation Image-related methods and arrangements
JP6019675B2 (en) 2012-03-30 2016-11-02 ブラザー工業株式会社 Function execution device
JP6019676B2 (en) 2012-03-30 2016-11-02 ブラザー工業株式会社 Communication device
US10623408B1 (en) 2012-04-02 2020-04-14 Amazon Technologies, Inc. Context sensitive object management
CN108337320B (en) * 2012-04-13 2020-09-01 高盛有限责任公司 System and method for scalable structured data distribution
US9436773B2 (en) * 2012-04-20 2016-09-06 The Boeing Company Method and computer program for discovering a dynamic network address
US8775671B2 (en) * 2012-05-11 2014-07-08 Sap Ag Managing information exchange between business entities
JP6066586B2 (en) * 2012-05-22 2017-01-25 キヤノン株式会社 Information processing system, control method thereof, and program thereof
US9401886B2 (en) * 2012-05-30 2016-07-26 International Business Machines Corporation Preventing personal information from being posted to an internet
CN102812690B (en) * 2012-05-30 2014-06-11 华为技术有限公司 Method, device and system for obtaining data type definition
US9203624B2 (en) 2012-06-04 2015-12-01 Apple Inc. Authentication and notification heuristics
US9154551B1 (en) 2012-06-11 2015-10-06 Amazon Technologies, Inc. Processing DNS queries to identify pre-processing information
US20140006318A1 (en) * 2012-06-29 2014-01-02 Poe XING Collecting, discovering, and/or sharing media objects
JP5867319B2 (en) 2012-07-03 2016-02-24 ブラザー工業株式会社 Communication device
CA2854067C (en) * 2012-07-04 2018-12-11 Huawei Technologies Co., Ltd. Method, device and system for recording multimedia data
GB201216667D0 (en) * 2012-07-10 2012-10-31 Paz Hadar Inside - on-line virtual reality immersion and integration system
JP5900228B2 (en) * 2012-08-06 2016-04-06 ブラザー工業株式会社 Communication device
US9215269B2 (en) * 2012-08-23 2015-12-15 Amazon Technologies, Inc. Predictive caching for content
AU2013204953B2 (en) 2012-08-30 2016-09-08 The Nielsen Company (Us), Llc Methods and apparatus to collect distributed user information for media impressions
US9571606B2 (en) 2012-08-31 2017-02-14 Verance Corporation Social media viewing system
US8869222B2 (en) 2012-09-13 2014-10-21 Verance Corporation Second screen content
US9106964B2 (en) 2012-09-13 2015-08-11 Verance Corporation Enhanced content distribution using advertisements
US9678961B2 (en) 2012-09-13 2017-06-13 Canon Europa N.V. Method and device for associating metadata to media objects
US9323577B2 (en) 2012-09-20 2016-04-26 Amazon Technologies, Inc. Automated profiling of resource usage
US8924443B2 (en) * 2012-10-05 2014-12-30 Gary Robin Maze Document management systems and methods
CN102908827B (en) * 2012-10-30 2014-06-18 厦门柏润氟材料科技有限公司 Composite filtering material with skin-core structure, as well as preparation method and application of composite filtering material
US9357382B2 (en) * 2012-10-31 2016-05-31 Intellisist, Inc. Computer-implemented system and method for validating call connections
US8990188B2 (en) 2012-11-30 2015-03-24 Apple Inc. Managed assessment of submitted digital content
KR101710667B1 (en) * 2012-12-17 2017-02-27 한국전자통신연구원 Device and method for providing service application using robot
US10205698B1 (en) 2012-12-19 2019-02-12 Amazon Technologies, Inc. Source-dependent address resolution
US9087341B2 (en) 2013-01-11 2015-07-21 Apple Inc. Migration of feedback data to equivalent digital assets
CN112130874A (en) * 2013-01-11 2020-12-25 辛纳科尔股份有限公司 Method and system for background control panel configuration selection
US9317872B2 (en) 2013-02-06 2016-04-19 Muzak Llc Encoding and decoding an audio watermark using key sequences comprising of more than two frequency components
US9641498B2 (en) * 2013-03-07 2017-05-02 Fiserv, Inc. Single sign-on processing for associated mobile applications
US9015328B2 (en) 2013-03-07 2015-04-21 Fiserv, Inc. Single sign-on processing for associated mobile applications
US9262793B2 (en) 2013-03-14 2016-02-16 Verance Corporation Transactional video marking system
US9773058B2 (en) * 2013-03-15 2017-09-26 Shazam Investments Ltd. Methods and systems for arranging and searching a database of media content recordings
US9633023B2 (en) * 2013-03-15 2017-04-25 Microsoft Technology Licensing, Llc Efficient DVCS storage system
AU2013100802B4 (en) * 2013-04-11 2013-11-14 Uniloc Luxembourg S.A. Device authentication using inter-person message metadata
US9697533B2 (en) 2013-04-17 2017-07-04 The Nielsen Company (Us), Llc Methods and apparatus to monitor media presentations
US9454789B2 (en) 2013-05-03 2016-09-27 Digimarc Corporation Watermarking and signal recognition for managing and sharing captured content, metadata discovery and related arrangements
US9934482B2 (en) 2013-05-24 2018-04-03 Sap Se Content maintenance optimization
US9294391B1 (en) 2013-06-04 2016-03-22 Amazon Technologies, Inc. Managing network computing components utilizing request routing
US10068246B2 (en) 2013-07-12 2018-09-04 The Nielsen Company (Us), Llc Methods and apparatus to collect distributed user information for media impressions
US20150019653A1 (en) * 2013-07-15 2015-01-15 Civolution B.V. Method and system for adding an identifier
US9251549B2 (en) 2013-07-23 2016-02-02 Verance Corporation Watermark extractor enhancements based on payload ranking
US9634920B1 (en) * 2013-07-24 2017-04-25 Amazon Technologies, Inc. Trace deduplication and aggregation in distributed systems
US9749304B1 (en) 2013-07-30 2017-08-29 Google Inc. System and methods for accessing multiple resources via one identifier
JP5753999B2 (en) * 2013-09-12 2015-07-22 メタフロンティア合同会社 Terminal device, data processing program, and data management system
US10116697B2 (en) 2013-09-20 2018-10-30 Open Text Sa Ulc System and method for geofencing
US10824756B2 (en) 2013-09-20 2020-11-03 Open Text Sa Ulc Hosted application gateway architecture with multi-level security policy and rule promulgations
EP2851833B1 (en) * 2013-09-20 2017-07-12 Open Text S.A. Application Gateway Architecture with Multi-Level Security Policy and Rule Promulgations
JP6264815B2 (en) 2013-09-30 2018-01-24 ブラザー工業株式会社 Communication device
US10084869B2 (en) * 2013-10-04 2018-09-25 Verto Analytics Oy Metering user behaviour and engagement with user interface in terminal devices
US9332035B2 (en) 2013-10-10 2016-05-03 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9953068B1 (en) * 2013-10-16 2018-04-24 Google Llc Computing usage metrics for a content sharing platform
US9208334B2 (en) 2013-10-25 2015-12-08 Verance Corporation Content management using multiple abstraction layers
US10198777B2 (en) * 2013-12-06 2019-02-05 Remote Media, Llc System, method, and application for exchanging content in a social network environment
US20150161282A1 (en) * 2013-12-11 2015-06-11 Yahoo! Inc. Method and System for Smart URL Shortening Service
US10224056B1 (en) 2013-12-17 2019-03-05 Amazon Technologies, Inc. Contingent device actions during loss of network connectivity
US9237138B2 (en) 2013-12-31 2016-01-12 The Nielsen Company (Us), Llc Methods and apparatus to collect distributed user information for media impressions and search terms
US9832353B2 (en) 2014-01-31 2017-11-28 Digimarc Corporation Methods for encoding, decoding and interpreting auxiliary data in media signals
US9311639B2 (en) 2014-02-11 2016-04-12 Digimarc Corporation Methods, apparatus and arrangements for device to device communication
US9608870B1 (en) * 2014-02-28 2017-03-28 Google Inc. Deep link verification for native applications
EP3117626A4 (en) 2014-03-13 2017-10-25 Verance Corporation Interactive content acquisition using embedded codes
US10289713B2 (en) 2014-03-24 2019-05-14 Ca, Inc. Logical validation for metadata builder
US10289430B2 (en) * 2014-03-24 2019-05-14 Ca, Inc. Interactive user interface for metadata builder
US9501556B2 (en) 2014-03-24 2016-11-22 Ca, Inc. Importing metadata into metadata builder
US9934216B2 (en) 2014-03-24 2018-04-03 Ca, Inc. Schema validation for metadata builder
US9460210B2 (en) 2014-04-04 2016-10-04 Dropbox, Inc. Enriching contact data based on content sharing history in a content management system
KR20160147861A (en) * 2014-04-23 2016-12-23 후아웨이 테크놀러지 컴퍼니 리미티드 Information object acquisition method, server and user equipment
US10635645B1 (en) 2014-05-04 2020-04-28 Veritas Technologies Llc Systems and methods for maintaining aggregate tables in databases
US10078668B1 (en) * 2014-05-04 2018-09-18 Veritas Technologies Llc Systems and methods for utilizing information-asset metadata aggregated from multiple disparate data-management systems
US9544388B1 (en) 2014-05-09 2017-01-10 Amazon Technologies, Inc. Client-side predictive caching for content
US9690760B2 (en) * 2014-05-15 2017-06-27 International Business Machines Corporation Bidirectional hyperlink synchronization for managing hypertexts in social media and public data repository
JP6402494B2 (en) 2014-05-30 2018-10-10 ブラザー工業株式会社 Function execution system, function execution device, and communication terminal
US10853356B1 (en) 2014-06-20 2020-12-01 Amazon Technologies, Inc. Persistent metadata catalog
US9749447B2 (en) * 2014-06-30 2017-08-29 Mark Spence Distributed Process Framework
RU2608668C2 (en) * 2014-07-30 2017-01-23 Общество С Ограниченной Ответственностью "Яндекс" System and method for control and organisation of web-browser cache for offline browsing
US9905233B1 (en) 2014-08-07 2018-02-27 Digimarc Corporation Methods and apparatus for facilitating ambient content recognition using digital watermarks, and related arrangements
US9396480B2 (en) * 2014-08-21 2016-07-19 Verizon Patent And Licensing Inc. Providing on-demand audience based on network
US20160063539A1 (en) 2014-08-29 2016-03-03 The Nielsen Company (Us), Llc Methods and apparatus to associate transactions with media impressions
CN104243561B (en) * 2014-09-02 2018-08-10 联想(北京)有限公司 A kind of electronic equipment, information processing method and information transmission system
JP6027069B2 (en) * 2014-09-18 2016-11-16 富士フイルム株式会社 VPN access control system, its operating method and program, and VPN router and server
US10353914B2 (en) 2014-09-29 2019-07-16 International Business Machines Corporation Federated management of a plurality of metadata storage mechanisms
US9858681B2 (en) * 2014-10-27 2018-01-02 Digimarc Corporation Signal detection, recognition and tracking with feature vector transforms
EP3224776A1 (en) * 2014-11-24 2017-10-04 ZooZ Mobile Ltd. Computerized transaction routing system and methods useful in conjunction therewith
US10097448B1 (en) 2014-12-18 2018-10-09 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10091096B1 (en) 2014-12-18 2018-10-02 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US9326046B1 (en) 2015-03-19 2016-04-26 Amazon Technologies, Inc. Uninterrupted playback of video streams using lower quality cached files
US10839359B2 (en) 2015-03-23 2020-11-17 Early Warning Services, Llc Payment real-time funds availability
US10748127B2 (en) 2015-03-23 2020-08-18 Early Warning Services, Llc Payment real-time funds availability
US10878387B2 (en) 2015-03-23 2020-12-29 Early Warning Services, Llc Real-time determination of funds availability for checks and ACH items
US10225326B1 (en) 2015-03-23 2019-03-05 Amazon Technologies, Inc. Point of presence based data uploading
US10832246B2 (en) 2015-03-23 2020-11-10 Early Warning Services, Llc Payment real-time funds availability
US10769606B2 (en) 2015-03-23 2020-09-08 Early Warning Services, Llc Payment real-time funds availability
KR20160115264A (en) * 2015-03-26 2016-10-06 삼성전자주식회사 Displaying apparatus, server and operation method of the same
US9819567B1 (en) 2015-03-30 2017-11-14 Amazon Technologies, Inc. Traffic surge management for points of presence
US11016946B1 (en) * 2015-03-31 2021-05-25 EMC IP Holding Company LLC Method and apparatus for processing object metadata
US9614845B2 (en) 2015-04-15 2017-04-04 Early Warning Services, Llc Anonymous authentication and remote wireless token access
US9832141B1 (en) 2015-05-13 2017-11-28 Amazon Technologies, Inc. Routing based request correlation
US10585869B2 (en) * 2015-05-22 2020-03-10 Open Text Holdings, Inc. System and method for generating, maintaining, and querying a database for computer investigations
US10078658B2 (en) 2015-07-10 2018-09-18 Whether or Knot LLC Systems and methods for electronic data distribution
US10970695B2 (en) 2015-07-21 2021-04-06 Early Warning Services, Llc Secure real-time transactions
US11151522B2 (en) 2015-07-21 2021-10-19 Early Warning Services, Llc Secure transactions with offline device
US11037122B2 (en) 2015-07-21 2021-06-15 Early Warning Services, Llc Secure real-time transactions
US11151523B2 (en) 2015-07-21 2021-10-19 Early Warning Services, Llc Secure transactions with offline device
US11062290B2 (en) 2015-07-21 2021-07-13 Early Warning Services, Llc Secure real-time transactions
US11386410B2 (en) 2015-07-21 2022-07-12 Early Warning Services, Llc Secure transactions with offline device
US10956888B2 (en) 2015-07-21 2021-03-23 Early Warning Services, Llc Secure real-time transactions
US10963856B2 (en) 2015-07-21 2021-03-30 Early Warning Services, Llc Secure real-time transactions
US11157884B2 (en) 2015-07-21 2021-10-26 Early Warning Services, Llc Secure transactions with offline device
US11037121B2 (en) 2015-07-21 2021-06-15 Early Warning Services, Llc Secure real-time transactions
US10438175B2 (en) 2015-07-21 2019-10-08 Early Warning Services, Llc Secure real-time payment transactions
US10701038B2 (en) * 2015-07-27 2020-06-30 Cisco Technology, Inc. Content negotiation in a content centric network
US10324600B2 (en) 2015-07-27 2019-06-18 Adp, Llc Web page generation system
US10417317B2 (en) 2015-07-27 2019-09-17 Adp, Llc Web page profiler
US10742764B2 (en) * 2015-07-27 2020-08-11 Adp, Llc Web page generation system
US10097566B1 (en) 2015-07-31 2018-10-09 Amazon Technologies, Inc. Identifying targets of network attacks
US10445625B2 (en) * 2015-09-21 2019-10-15 Ricoh Company, Ltd. Metadata tagging mechanism
US10084782B2 (en) 2015-09-21 2018-09-25 Early Warning Services, Llc Authenticator centralization and protection
US9774619B1 (en) 2015-09-24 2017-09-26 Amazon Technologies, Inc. Mitigating network attacks
US10693933B2 (en) * 2015-10-29 2020-06-23 Netflix, Inc. Techniques for modifying a rules engine in a highly-scaled computing environment
US11593075B2 (en) 2015-11-03 2023-02-28 Open Text Sa Ulc Streamlined fast and efficient application building and customization systems and methods
US10270878B1 (en) 2015-11-10 2019-04-23 Amazon Technologies, Inc. Routing for origin-facing points of presence
US10904328B2 (en) * 2015-12-03 2021-01-26 Christopher Balz System, method, and apparatus for providing and utilizing a link metadata system for the internet
US10341415B2 (en) 2015-12-10 2019-07-02 Slingshot Technologies, Inc. Electronic information tree-based routing
US10257307B1 (en) 2015-12-11 2019-04-09 Amazon Technologies, Inc. Reserved cache space in content delivery networks
US10205994B2 (en) 2015-12-17 2019-02-12 The Nielsen Company (Us), Llc Methods and apparatus to collect distributed user information for media impressions
US10348639B2 (en) 2015-12-18 2019-07-09 Amazon Technologies, Inc. Use of virtual endpoints to improve data transmission rates
US10063649B2 (en) * 2015-12-29 2018-08-28 Ca, Inc. Data translation using a proxy service
US10445755B2 (en) * 2015-12-30 2019-10-15 Paypal, Inc. Data structures for categorizing and filtering content
US11388037B2 (en) 2016-02-25 2022-07-12 Open Text Sa Ulc Systems and methods for providing managed services
US10419557B2 (en) * 2016-03-21 2019-09-17 International Business Machines Corporation Identifying and managing redundant digital content transfers
US10536540B2 (en) * 2016-05-02 2020-01-14 Microsoft Technology Licensing, Llc Computing system architecture for producing file analytics
US10354348B2 (en) * 2016-05-17 2019-07-16 Hitachi Vantara Corporation Digital evidence management
US10075551B1 (en) 2016-06-06 2018-09-11 Amazon Technologies, Inc. Request management for hierarchical cache
US11868445B2 (en) * 2016-06-24 2024-01-09 Discovery Communications, Llc Systems and methods for federated searches of assets in disparate dam repositories
US10372883B2 (en) * 2016-06-24 2019-08-06 Scripps Networks Interactive, Inc. Satellite and central asset registry systems and methods and rights management systems
US10110694B1 (en) 2016-06-29 2018-10-23 Amazon Technologies, Inc. Adaptive transfer rate for retrieving content from a server
US9992086B1 (en) 2016-08-23 2018-06-05 Amazon Technologies, Inc. External health checking of virtual private cloud network environments
US10033691B1 (en) 2016-08-24 2018-07-24 Amazon Technologies, Inc. Adaptive resolution of domain name requests in virtual private cloud network environments
US9996310B1 (en) * 2016-09-15 2018-06-12 Amazon Technologies, Inc. Content prioritization for a display array
US11144928B2 (en) 2016-09-19 2021-10-12 Early Warning Services, Llc Authentication and fraud prevention in provisioning a mobile wallet
US10698869B2 (en) * 2016-09-27 2020-06-30 Bank Of America Corporation System and method for data structure migration control
US10616250B2 (en) 2016-10-05 2020-04-07 Amazon Technologies, Inc. Network addresses with encoded DNS-level information
US10719616B2 (en) 2016-10-25 2020-07-21 Beatport, LLC Secure content access system
CN106572165A (en) * 2016-10-26 2017-04-19 宜人恒业科技发展(北京)有限公司 Distributed global unique ID application method
US10789386B2 (en) * 2016-11-09 2020-09-29 Reavire, Inc. Dispatching identity information from secure hardware appliance
US10405034B1 (en) * 2016-11-14 2019-09-03 Cox Communications, Inc. Biometric access to personalized services
US11080804B1 (en) * 2016-12-16 2021-08-03 Google Llc Model for representing online ownership information
US10372499B1 (en) 2016-12-27 2019-08-06 Amazon Technologies, Inc. Efficient region selection system for executing request-driven code
US10831549B1 (en) 2016-12-27 2020-11-10 Amazon Technologies, Inc. Multi-region request-driven code execution system
EP3349394B1 (en) * 2017-01-16 2021-11-10 Vertigo Media, Inc. System, method, and application for exchanging content in a social network environment
KR102024933B1 (en) * 2017-01-26 2019-09-24 한국전자통신연구원 apparatus and method for tracking image content context trend using dynamically generated metadata
US10938884B1 (en) 2017-01-30 2021-03-02 Amazon Technologies, Inc. Origin server cloaking using virtual private cloud network environments
US10572907B2 (en) * 2017-01-31 2020-02-25 Walmart Apollo, Llc Systems and methods for a search engine marketing internal auction system
US10496844B2 (en) 2017-02-23 2019-12-03 Salesforce.Com, Inc. Representing access permissions to documents
US11210670B2 (en) 2017-02-28 2021-12-28 Early Warning Services, Llc Authentication and security for mobile-device transactions
US10552500B2 (en) 2017-03-02 2020-02-04 International Business Machines Corporation Presenting a data instance based on presentation rules
US20180260404A1 (en) * 2017-03-08 2018-09-13 Quantum Corporation Global access to removable storage media items
US10503613B1 (en) 2017-04-21 2019-12-10 Amazon Technologies, Inc. Efficient serving of resources during server unavailability
US10187443B2 (en) 2017-06-12 2019-01-22 C-Hear, Inc. System and method for encoding image data and other data types into one data format and decoding of same
US11588872B2 (en) 2017-06-12 2023-02-21 C-Hear, Inc. System and method for codec for combining disparate content
US11075987B1 (en) 2017-06-12 2021-07-27 Amazon Technologies, Inc. Load estimating content delivery network
US10447648B2 (en) 2017-06-19 2019-10-15 Amazon Technologies, Inc. Assignment of a POP to a DNS resolver based on volume of communications over a link between client devices and the POP
US10903985B2 (en) 2017-08-25 2021-01-26 Keysight Technologies Singapore (Sales) Pte. Ltd. Monitoring encrypted network traffic flows in a virtual environment using dynamic session key acquisition techniques
CN111194443A (en) * 2017-09-05 2020-05-22 肖氏工业集团公司 Audible acoustic performance tool
US10742593B1 (en) 2017-09-25 2020-08-11 Amazon Technologies, Inc. Hybrid content request routing system
US10872097B2 (en) * 2017-12-01 2020-12-22 Salesforce.Com, Inc. Data resolution system for management of distributed data
CA3027220A1 (en) * 2017-12-12 2019-06-12 Interset Software, Inc. Tracking file movement in a network environment
US11132335B2 (en) 2017-12-12 2021-09-28 Interset Software, Inc. Systems and methods for file fingerprinting
US10866963B2 (en) 2017-12-28 2020-12-15 Dropbox, Inc. File system authentication
US20190213616A1 (en) * 2018-01-11 2019-07-11 Point Inside, Inc. Shopper Traffic Flow Spatial Analytics Based on Indoor Positioning Data
US11861024B1 (en) * 2018-01-26 2024-01-02 Wells Fargo Bank, N.A. Systems and methods for data risk assessment
US10592578B1 (en) 2018-03-07 2020-03-17 Amazon Technologies, Inc. Predictive content push-enabled content delivery network
US11120013B2 (en) * 2018-06-22 2021-09-14 Attestiv Inc. Real time visual validation of digital content using a distributed ledger
WO2020026036A1 (en) 2018-07-31 2020-02-06 Marvell World Trade Ltd. Metadata generation at the storage edge
US10893030B2 (en) 2018-08-10 2021-01-12 Keysight Technologies, Inc. Methods, systems, and computer readable media for implementing bandwidth limitations on specific application traffic at a proxy element
US11044258B2 (en) * 2018-08-24 2021-06-22 Kyocera Document Solutions Inc. Decentralized network for secure distribution of digital documents
US10862852B1 (en) 2018-11-16 2020-12-08 Amazon Technologies, Inc. Resolution of domain name requests in heterogeneous network environments
US11238026B2 (en) 2018-11-26 2022-02-01 Home Box Office, Inc. Identifier technology for entertainment data
US11025747B1 (en) 2018-12-12 2021-06-01 Amazon Technologies, Inc. Content request pattern-based routing system
US10979528B2 (en) 2018-12-17 2021-04-13 At&T Intellectual Property I, L.P. System for trend discovery and curation from content metadata and context
US10893108B2 (en) 2019-03-13 2021-01-12 Cisco Technology, Inc. Maintaining application state of mobile endpoint device moving between virtualization hosts based on sharing connection-based metadata
KR20200112386A (en) * 2019-03-22 2020-10-05 삼성전자주식회사 Electronic device and control method thereof
CN110297655B (en) * 2019-06-21 2023-06-06 百度在线网络技术(北京)有限公司 Method, device, equipment and storage medium for generating patch package
WO2021016286A1 (en) * 2019-07-22 2021-01-28 C-Hear, Inc. System and method for codec for combining disparate content
CN115883500A (en) 2019-08-21 2023-03-31 可可株式会社 Method and server for providing activity information related to social network service to chat room
CN110516069B (en) * 2019-08-28 2023-07-25 中南大学 Fasttext-CRF-based quotation metadata extraction method
US11115912B1 (en) 2019-10-15 2021-09-07 Sprint Communications Company L.P. Distributed ledger directory service for wireless communication networks
WO2021113393A1 (en) * 2019-12-02 2021-06-10 Qwqer Llc Buyer and seller interaction system
US11062400B1 (en) * 2020-01-14 2021-07-13 VALID8 Financial Inc. System and method for data synchronization and verification
US11190417B2 (en) * 2020-02-04 2021-11-30 Keysight Technologies, Inc. Methods, systems, and computer readable media for processing network flow metadata at a network packet broker
US11501786B2 (en) 2020-04-30 2022-11-15 The Nielsen Company (Us), Llc Methods and apparatus for supplementing partially readable and/or inaccurate codes in media
CN112783931A (en) * 2020-07-21 2021-05-11 南方电网调峰调频发电有限公司信息通信分公司 System and method for realizing data sharing service based on multi-view data directory
US10963507B1 (en) * 2020-09-01 2021-03-30 Symphonic Distribution Inc. System and method for music metadata reconstruction and audio fingerprint matching
US11568065B2 (en) 2021-01-15 2023-01-31 Bank Of America Corporation System for securing electronic data by aggregation of distributed electronic database entries
US11709813B2 (en) * 2021-06-10 2023-07-25 Jpmorgan Chase Bank, N.A. System and method for implementing a contract data management module
CN113923584A (en) * 2021-09-01 2022-01-11 赛因芯微(北京)电子科技有限公司 Matrix-based audio channel metadata and generation method, equipment and storage medium
CN113905321A (en) * 2021-09-01 2022-01-07 赛因芯微(北京)电子科技有限公司 Object-based audio channel metadata and generation method, device and storage medium
US11797552B2 (en) * 2021-10-01 2023-10-24 Sap Se System and method for selective retrieval of metadata artefact versions
CN114143695A (en) * 2021-10-15 2022-03-04 赛因芯微(北京)电子科技有限公司 Audio stream metadata and generation method, electronic equipment and storage medium
US20230291944A1 (en) * 2022-03-02 2023-09-14 Streaming Global, Inc. Content delivery platform

Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0853412A2 (en) * 1996-12-02 1998-07-15 International Business Machines Corporation System method for efficiently transferring datastreams in a multimedia system
US5870754A (en) * 1996-04-25 1999-02-09 Philips Electronics North America Corporation Video retrieval of MPEG compressed sequences using DC and motion signatures
WO2000013136A1 (en) * 1998-08-31 2000-03-09 Digital Video Express, L.P. Watermarking system and methodology for digital multimedia content
US6122403A (en) * 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
WO2000065536A1 (en) * 1999-04-27 2000-11-02 Massachusetts Institute Of Technology Method for compensating the digital watermarking distortion on a multimedia signal
US20020067858A1 (en) * 2000-05-17 2002-06-06 Emmanuel Lazaridis System, method and computer program product for extracting quantitative summaries of information from images
US20020099737A1 (en) * 2000-11-21 2002-07-25 Porter Charles A. Metadata quality improvement
US20020138440A1 (en) * 2001-03-21 2002-09-26 Vijay Vaidyanathan Method and system for automatically distributing fees, including a reseller commission, during a digital file transaction
US20020157005A1 (en) * 2001-04-20 2002-10-24 Brunk Hugh L. Including a metric in a digital watermark for media authentication
US20020188841A1 (en) * 1995-07-27 2002-12-12 Jones Kevin C. Digital asset management and linking media signals with related data using watermarks
US20020186844A1 (en) * 2000-12-18 2002-12-12 Levy Kenneth L. User-friendly rights management systems and methods
US6505160B1 (en) * 1995-07-27 2003-01-07 Digimarc Corporation Connected audio and other media objects
US20030012548A1 (en) * 2000-12-21 2003-01-16 Levy Kenneth L. Watermark systems for media
US20030061490A1 (en) * 2001-09-26 2003-03-27 Abajian Aram Christian Method for identifying copyright infringement violations by fingerprint detection
US6574609B1 (en) * 1998-08-13 2003-06-03 International Business Machines Corporation Secure electronic content management system
US20030110163A1 (en) * 2001-12-04 2003-06-12 Compaq Information Technologies Group, L.P. System and method for efficiently finding near-similar images in massive databases
US20040064537A1 (en) * 2002-09-30 2004-04-01 Anderson Andrew V. Method and apparatus to enable efficient processing and transmission of network communications
US20040091111A1 (en) * 2002-07-16 2004-05-13 Levy Kenneth L. Digital watermarking and fingerprinting applications
US20040243634A1 (en) * 2003-03-05 2004-12-02 Levy Kenneth L. Content identification, personal domain, copyright notification, metadata and e-Commerce
US20040249768A1 (en) * 2001-07-06 2004-12-09 Markku Kontio Digital rights management in a mobile communications environment
US20050066187A1 (en) * 1999-03-27 2005-03-24 Microsoft Corporation Encrypting a digital object on a key ID selected therefor
US6889211B1 (en) * 1999-07-28 2005-05-03 Hitachi, Ltd. Method and system for distributing multimedia data with management information
US20050102236A1 (en) * 2003-08-04 2005-05-12 Jean-Philippe Wary Method for the protection of a digital content
US7020304B2 (en) * 2002-01-22 2006-03-28 Digimarc Corporation Digital watermarking and fingerprinting including synchronization, layering, version control, and compressed embedding
US7031492B1 (en) * 1999-06-01 2006-04-18 Thomson Licensing Digital data watermarking system using novel watermark insertion and detection methods
US7065226B1 (en) * 1999-06-01 2006-06-20 Hitachi, Ltd. Method for embedding information and extracting the same
US8924412B2 (en) * 2005-12-21 2014-12-30 Digimarc Corporation Rules driven pan ID metadata routing system and network

Family Cites Families (71)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5267351A (en) * 1989-12-22 1993-11-30 Avid Technology, Inc. Media storage and retrieval system
US6135646A (en) 1993-10-22 2000-10-24 Corporation For National Research Initiatives System for uniquely and persistently identifying, managing, and tracking digital objects
US7010144B1 (en) 1994-10-21 2006-03-07 Digimarc Corporation Associating data with images in imaging systems
US6614914B1 (en) 1995-05-08 2003-09-02 Digimarc Corporation Watermark embedder and reader
US6947571B1 (en) 1999-05-19 2005-09-20 Digimarc Corporation Cell phones with optical capabilities, and related applications
AU5386796A (en) * 1995-04-11 1996-10-30 Kinetech, Inc. Identifying data in a data processing system
US5907837A (en) * 1995-07-17 1999-05-25 Microsoft Corporation Information retrieval system in an on-line network including separate content and layout of published titles
US7711564B2 (en) * 1995-07-27 2010-05-04 Digimarc Corporation Connected audio and other media objects
US7171018B2 (en) * 1995-07-27 2007-01-30 Digimarc Corporation Portable devices and methods employing digital watermarking
US6829368B2 (en) 2000-01-26 2004-12-07 Digimarc Corporation Establishing and interacting with on-line media collections using identifiers in media signals
EP0766468B1 (en) * 1995-09-28 2006-05-03 Nec Corporation Method and system for inserting a spread spectrum watermark into multimedia data
US8180844B1 (en) * 2000-03-18 2012-05-15 Digimarc Corporation System for linking from objects to remote resources
US20030056103A1 (en) 2000-12-18 2003-03-20 Levy Kenneth L. Audio/video commerce application architectural framework
FR2749522B1 (en) 1996-06-06 1998-09-04 Salomon Sa ENERGIZED ONLINE WHEEL SKATE
US6209036B1 (en) 1997-06-06 2001-03-27 International Business Machines Corporation Management of and access to information and other material via the world wide web in an LDAP environment
US7372976B2 (en) * 1998-04-16 2008-05-13 Digimarc Corporation Content indexing and searching using content identifiers and associated metadata
WO2000004483A2 (en) * 1998-07-15 2000-01-27 Imation Corp. Hierarchical data storage management
US6321221B1 (en) * 1998-07-17 2001-11-20 Net Perceptions, Inc. System, method and article of manufacture for increasing the user value of recommendations
US7421723B2 (en) 1999-01-07 2008-09-02 Nielsen Media Research, Inc. Detection of media links in broadcast signals
AUPP868699A0 (en) * 1999-02-15 1999-03-11 Silverbrook Research Pty Ltd A method and apparatus(IJ46P1A)
US7206820B1 (en) * 2000-03-18 2007-04-17 Digimarc Corporation System for linking from object to remote resource
US7543148B1 (en) * 1999-07-13 2009-06-02 Microsoft Corporation Audio watermarking with covert channel and permutations
US7450734B2 (en) * 2000-01-13 2008-11-11 Digimarc Corporation Digital asset management, targeted searching and desktop searching using digital watermarks
JP4785168B2 (en) * 2000-01-13 2011-10-05 ディジマーク コーポレイション Metadata authentication and embedding metadata in watermarks in media signals
EP1117220A1 (en) * 2000-01-14 2001-07-18 Sun Microsystems, Inc. Method and system for protocol conversion
US6834308B1 (en) 2000-02-17 2004-12-21 Audible Magic Corporation Method and apparatus for identifying media content presented on a media playing device
JP2001339358A (en) 2000-05-30 2001-12-07 Netyear Group Corp Information distribution system for mobile communication terminal and information distribution method
EP1249090A1 (en) 2000-07-21 2002-10-16 Koninklijke Philips Electronics N.V. Multimedia monitoring by combining watermarking and characteristic signature of signal
US6990453B2 (en) 2000-07-31 2006-01-24 Landmark Digital Services Llc System and methods for recognizing sound and music signals in high noise and distortion
US8055899B2 (en) 2000-12-18 2011-11-08 Digimarc Corporation Systems and methods using digital watermarking and identifier extraction to provide promotional opportunities
AUPR230700A0 (en) * 2000-12-22 2001-01-25 Canon Kabushiki Kaisha A method for facilitating access to multimedia content
US6839721B2 (en) * 2001-01-12 2005-01-04 Hewlett-Packard Development Company, L.P. Integration of a database into file management software for protecting, tracking, and retrieving data
US20040122741A1 (en) 2002-01-25 2004-06-24 David Sidman Apparatus, method and system for effecting information access in a peer environment
WO2002065782A1 (en) 2001-02-12 2002-08-22 Koninklijke Philips Electronics N.V. Generating and matching hashes of multimedia content
US7359889B2 (en) 2001-03-02 2008-04-15 Landmark Digital Services Llc Method and apparatus for automatically creating database for use in automated media recognition system
US20020143791A1 (en) 2001-03-19 2002-10-03 Dov Levanon Content deployment system, method and network
US20040019658A1 (en) * 2001-03-26 2004-01-29 Microsoft Corporation Metadata retrieval protocols and namespace identifiers
JP2002297656A (en) 2001-04-02 2002-10-11 Nippon Telegr & Teleph Corp <Ntt> Method and device for providing contents, and storage medium storing the same contents providing program.
WO2002082271A1 (en) 2001-04-05 2002-10-17 Audible Magic Corporation Copyright detection and protection system and method
JP2003008117A (en) * 2001-06-27 2003-01-10 Fujitsu Ltd Optical amplifier block and optical amplifier system using the same
US7877438B2 (en) 2001-07-20 2011-01-25 Audible Magic Corporation Method and apparatus for identifying new media content
US6889221B1 (en) * 2001-08-23 2005-05-03 Ncr Corporation Parallel random sampling
US7231419B1 (en) * 2001-10-19 2007-06-12 Outlooksoft Corporation System and method for adaptively selecting and delivering recommendations to a requester
JP2003223590A (en) 2001-11-21 2003-08-08 Matsushita Electric Ind Co Ltd System and device for using attribute information
US7316032B2 (en) 2002-02-27 2008-01-01 Amad Tayebi Method for allowing a customer to preview, acquire and/or pay for information and a system therefor
DE60212195T2 (en) * 2002-01-11 2007-04-19 Koninklijke Philips Electronics N.V. Generation of a watermark that is unique to a recipient of a multicast multimedia broadcast
GB2387085A (en) 2002-03-25 2003-10-01 Sony Uk Ltd System
JP2003288361A (en) 2002-03-27 2003-10-10 Kanazawa Inst Of Technology Content delivery system and content delivery method
US9349411B2 (en) 2002-07-16 2016-05-24 Digimarc Corporation Digital watermarking and fingerprinting applications for copy protection
US7136866B2 (en) * 2002-08-15 2006-11-14 Microsoft Corporation Media identifier registry
JP2004126975A (en) 2002-10-03 2004-04-22 Nippon Telegr & Teleph Corp <Ntt> Method and device for extracting similar user with similar preference tendency, program for the same, and recording medium recording the same
EP2442566A3 (en) * 2002-10-15 2012-08-08 Verance Corporation Media Monitoring, Management and Information System
KR20050061545A (en) * 2002-10-18 2005-06-22 코닌클리케 필립스 일렉트로닉스 엔.브이. Method and system for metadata protection in tv-anytime
US7606790B2 (en) * 2003-03-03 2009-10-20 Digimarc Corporation Integrating and enhancing searching of media content and biometric databases
US7457831B2 (en) * 2003-03-31 2008-11-25 Microsoft Corporation Peripheral device driver maintenance scheme for networked peripheral device clients
KR100493896B1 (en) 2003-04-18 2005-06-10 삼성전자주식회사 Method and Apparatus for Transforming Digital Content Metadata, and Network System Using the Same
GB0315155D0 (en) * 2003-06-28 2003-08-06 Ibm Improvements to hypertext request integrity and user experience
JP2005084625A (en) * 2003-09-11 2005-03-31 Music Gate Inc Electronic watermark composing method and program
US7318216B2 (en) * 2003-09-24 2008-01-08 Tablecode Software Corporation Software application development environment facilitating development of a software application
JP4471737B2 (en) * 2003-10-06 2010-06-02 日本電信電話株式会社 Grouping condition determining device and method, keyword expansion device and method using the same, content search system, content information providing system and method, and program
JP4822663B2 (en) 2003-12-12 2011-11-24 ソニー株式会社 Information processing apparatus and method, and program
US20050198061A1 (en) * 2004-02-17 2005-09-08 David Robinson Process and product for selectively processing data accesses
US20050193016A1 (en) 2004-02-17 2005-09-01 Nicholas Seet Generation of a media content database by correlating repeating media content in media streams
US20050204037A1 (en) 2004-03-09 2005-09-15 Levy Kenneth L. Method and apparatus for content identification/control
US8150825B2 (en) * 2004-03-15 2012-04-03 Yahoo! Inc. Inverse search systems and methods
US8407752B2 (en) 2004-03-18 2013-03-26 Digimarc Corporation Synchronizing broadcast content with corresponding network content
JP2005267171A (en) 2004-03-18 2005-09-29 Ntt Comware Corp Animation content providing system
JP4249673B2 (en) 2004-08-18 2009-04-02 株式会社 サイバー・コミュニケーションズ Providing network information in conjunction with content playback
US8010511B2 (en) 2006-08-29 2011-08-30 Attributor Corporation Content monitoring and compliance enforcement
US9092433B2 (en) 2007-03-30 2015-07-28 Digimarc Corporation Layered abstraction systems and methods for persistent content identity
US9330394B2 (en) * 2013-12-20 2016-05-03 Intel Corporation Content management with hierarchical content rules

Patent Citations (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6505160B1 (en) * 1995-07-27 2003-01-07 Digimarc Corporation Connected audio and other media objects
US6122403A (en) * 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
US20020188841A1 (en) * 1995-07-27 2002-12-12 Jones Kevin C. Digital asset management and linking media signals with related data using watermarks
US5870754A (en) * 1996-04-25 1999-02-09 Philips Electronics North America Corporation Video retrieval of MPEG compressed sequences using DC and motion signatures
EP0853412A2 (en) * 1996-12-02 1998-07-15 International Business Machines Corporation System method for efficiently transferring datastreams in a multimedia system
US6574609B1 (en) * 1998-08-13 2003-06-03 International Business Machines Corporation Secure electronic content management system
WO2000013136A1 (en) * 1998-08-31 2000-03-09 Digital Video Express, L.P. Watermarking system and methodology for digital multimedia content
US20050066187A1 (en) * 1999-03-27 2005-03-24 Microsoft Corporation Encrypting a digital object on a key ID selected therefor
WO2000065536A1 (en) * 1999-04-27 2000-11-02 Massachusetts Institute Of Technology Method for compensating the digital watermarking distortion on a multimedia signal
US7065226B1 (en) * 1999-06-01 2006-06-20 Hitachi, Ltd. Method for embedding information and extracting the same
US7031492B1 (en) * 1999-06-01 2006-04-18 Thomson Licensing Digital data watermarking system using novel watermark insertion and detection methods
US6889211B1 (en) * 1999-07-28 2005-05-03 Hitachi, Ltd. Method and system for distributing multimedia data with management information
US20020067858A1 (en) * 2000-05-17 2002-06-06 Emmanuel Lazaridis System, method and computer program product for extracting quantitative summaries of information from images
US20020099737A1 (en) * 2000-11-21 2002-07-25 Porter Charles A. Metadata quality improvement
US20020186844A1 (en) * 2000-12-18 2002-12-12 Levy Kenneth L. User-friendly rights management systems and methods
US20030012548A1 (en) * 2000-12-21 2003-01-16 Levy Kenneth L. Watermark systems for media
US20020138440A1 (en) * 2001-03-21 2002-09-26 Vijay Vaidyanathan Method and system for automatically distributing fees, including a reseller commission, during a digital file transaction
US20020157005A1 (en) * 2001-04-20 2002-10-24 Brunk Hugh L. Including a metric in a digital watermark for media authentication
US20040249768A1 (en) * 2001-07-06 2004-12-09 Markku Kontio Digital rights management in a mobile communications environment
US20030061490A1 (en) * 2001-09-26 2003-03-27 Abajian Aram Christian Method for identifying copyright infringement violations by fingerprint detection
US20030110163A1 (en) * 2001-12-04 2003-06-12 Compaq Information Technologies Group, L.P. System and method for efficiently finding near-similar images in massive databases
US7020304B2 (en) * 2002-01-22 2006-03-28 Digimarc Corporation Digital watermarking and fingerprinting including synchronization, layering, version control, and compressed embedding
US20060280246A1 (en) * 2002-01-22 2006-12-14 Alattar Adnan M Digital watermarking and fingerprinting including synchronization, layering, version control, and compressed embedding
US20040091111A1 (en) * 2002-07-16 2004-05-13 Levy Kenneth L. Digital watermarking and fingerprinting applications
US20040064537A1 (en) * 2002-09-30 2004-04-01 Anderson Andrew V. Method and apparatus to enable efficient processing and transmission of network communications
US20040243634A1 (en) * 2003-03-05 2004-12-02 Levy Kenneth L. Content identification, personal domain, copyright notification, metadata and e-Commerce
US20050102236A1 (en) * 2003-08-04 2005-05-12 Jean-Philippe Wary Method for the protection of a digital content
US8924412B2 (en) * 2005-12-21 2014-12-30 Digimarc Corporation Rules driven pan ID metadata routing system and network

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Frank hartung et al., Ericsson Research, "digital rights management and watermarking of multimedia content for M-commerce applications", IEEE communications magazine, Nov 2000, pp 78-84 *
Manuel Roman et al., DOCOMo USA Lab "a wireless web for creating and sharing personal content through handsets", pervasive computing, published by IEEE CS and IEEE comsocApril-June 2005, pp 67-73 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10685061B2 (en) 2005-12-21 2020-06-16 Digimarc Corporation Content metadata directory services
US9892206B2 (en) 2005-12-21 2018-02-13 Digimarc Corporation Content metadata directory services
US10191996B2 (en) * 2005-12-21 2019-01-29 Digimarc Corporation Rules driven pan ID metadata routing system and network
US20150074090A1 (en) * 2006-06-21 2015-03-12 Napo Enterprises, Llc Historical Media Recommendation Service
US20190114049A1 (en) * 2016-06-07 2019-04-18 Alibaba Group Holding Limited Method, device, and terminal device for extracting data
US11175820B2 (en) * 2016-06-07 2021-11-16 Advanced New Technologies Co., Ltd. Method, device, and terminal device for extracting data
US20180130096A1 (en) * 2016-11-04 2018-05-10 Dynasign Corporation Global-Scale Wireless ID Marketing Registry System for Mobile Device Proximity Marketing
US10861049B2 (en) * 2016-11-04 2020-12-08 Dynasign Corporation Global-scale wireless ID marketing registry system for mobile device proximity marketing
US20180137174A1 (en) * 2016-11-14 2018-05-17 International Business Machines Corporation Container application execution using image metadata
US10521447B2 (en) * 2016-11-14 2019-12-31 International Business Machines Corporation Container application execution using image metadata
US10567485B2 (en) * 2018-01-27 2020-02-18 Vicente Alexei Mantrana-Exposito Techniques for coordinating the sharing of content among applications
US20220095018A1 (en) * 2020-09-23 2022-03-24 Sony Group Corporation Unified programming guide for content associated with broadcaster and vod applications
US11323778B2 (en) * 2020-09-23 2022-05-03 Sony Group Corporation Unified programming guide for content associated with broadcaster and VOD applications
US20220141312A1 (en) * 2020-10-29 2022-05-05 Comcast Cable Communications, Llc Generating Unique Identifiers

Also Published As

Publication number Publication date
US20070208711A1 (en) 2007-09-06
CA2634489A1 (en) 2007-07-05
US20070156726A1 (en) 2007-07-05
WO2007076459A2 (en) 2007-07-05
US10685061B2 (en) 2020-06-16
US10191996B2 (en) 2019-01-29
US20070192352A1 (en) 2007-08-16
EP1963958A4 (en) 2012-01-25
US20180253505A1 (en) 2018-09-06
US9218429B2 (en) 2015-12-22
EP1963958B1 (en) 2019-04-24
JP5555271B2 (en) 2014-07-23
WO2007076459A3 (en) 2008-04-10
EP1963958A2 (en) 2008-09-03
EP2312470A3 (en) 2012-04-04
US8364720B2 (en) 2013-01-29
EP2312470B1 (en) 2018-09-12
US20170011134A1 (en) 2017-01-12
US9275157B2 (en) 2016-03-01
US8924412B2 (en) 2014-12-30
CN101379464B (en) 2015-05-06
US20130198242A1 (en) 2013-08-01
CN101379464A (en) 2009-03-04
CA2634489C (en) 2016-08-30
EP2312470A2 (en) 2011-04-20
JP5016610B2 (en) 2012-09-05
US20160188639A1 (en) 2016-06-30
JP2012138099A (en) 2012-07-19
JP2009524125A (en) 2009-06-25
US9892206B2 (en) 2018-02-13

Similar Documents

Publication Publication Date Title
US10685061B2 (en) Content metadata directory services
JP6316787B2 (en) Content syndication in web-based media via ad tags
AU2010273920B2 (en) Content provisioning and revenue disbursement
US20150046537A1 (en) Retrieving video annotation metadata using a p2p network and copyright free indexes
US20060184960A1 (en) Method and system for enabling commerce from broadcast content
US20110246471A1 (en) Retrieving video annotation metadata using a p2p network
US20050192871A1 (en) Electronic music/media distribution system
US20070078832A1 (en) Method and system for using smart tags and a recommendation engine using smart tags
KR20120030437A (en) Content delivery systems and methods
WO2003014867A2 (en) Personalized interactive digital catalog profiling
US20150046248A1 (en) Campaign manager
Kirk et al. Efficient workflows for automated rich metadata production
Ben Schofield et al. EFFICIENT WORKFLOWS FOR AUTOMATED RICH METADATA PRODUCTION

Legal Events

Date Code Title Description
AS Assignment

Owner name: DIGIMARC CORPORATION, OREGON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RHOADS, GEOFFREY B.;RODRIGUEZ, TONY F.;LEVY, KENNETH L.;SIGNING DATES FROM 20070313 TO 20070319;REEL/FRAME:039058/0923

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO PAY ISSUE FEE