US20120047020A1 - Contextual advertising with user features - Google Patents

Contextual advertising with user features Download PDF

Info

Publication number
US20120047020A1
US20120047020A1 US12/806,802 US80680210A US2012047020A1 US 20120047020 A1 US20120047020 A1 US 20120047020A1 US 80680210 A US80680210 A US 80680210A US 2012047020 A1 US2012047020 A1 US 2012047020A1
Authority
US
United States
Prior art keywords
user
current
specified
terms
web page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/806,802
Other versions
US9031863B2 (en
Inventor
Abraham H. Bagherjeiran
Andrew O. Hatch
Adwait Ratnaparkhi
Amruta S. Joshi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
R2 Solutions LLC
Altaba Inc
Original Assignee
Yahoo Inc until 2017
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yahoo Inc until 2017 filed Critical Yahoo Inc until 2017
Priority to US12/806,802 priority Critical patent/US9031863B2/en
Assigned to YAHOO! INC. reassignment YAHOO! INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: JOSHI, AMRUTA S., BAGHERJEIRAN, ABRAHAM H., HATCH, ANDREW O., RATNAPARKHI, ADWAIT
Priority to PCT/US2011/045386 priority patent/WO2012024066A2/en
Priority to TW100128320A priority patent/TWI526962B/en
Publication of US20120047020A1 publication Critical patent/US20120047020A1/en
Application granted granted Critical
Publication of US9031863B2 publication Critical patent/US9031863B2/en
Assigned to EXCALIBUR IP, LLC reassignment EXCALIBUR IP, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YAHOO! INC.
Assigned to YAHOO! INC. reassignment YAHOO! INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EXCALIBUR IP, LLC
Assigned to EXCALIBUR IP, LLC reassignment EXCALIBUR IP, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YAHOO! INC.
Assigned to STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT reassignment STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT PATENT SECURITY AGREEMENT Assignors: ACACIA RESEARCH GROUP LLC, AMERICAN VEHICULAR SCIENCES LLC, BONUTTI SKELETAL INNOVATIONS LLC, CELLULAR COMMUNICATIONS EQUIPMENT LLC, INNOVATIVE DISPLAY TECHNOLOGIES LLC, LIFEPORT SCIENCES LLC, LIMESTONE MEMORY SYSTEMS LLC, MERTON ACQUISITION HOLDCO LLC, MOBILE ENHANCEMENT SOLUTIONS LLC, MONARCH NETWORKING SOLUTIONS LLC, NEXUS DISPLAY TECHNOLOGIES LLC, PARTHENON UNIFIED MEMORY ARCHITECTURE LLC, R2 SOLUTIONS LLC, SAINT LAWRENCE COMMUNICATIONS LLC, STINGRAY IP SOLUTIONS LLC, SUPER INTERCONNECT TECHNOLOGIES LLC, TELECONFERENCE SYSTEMS LLC, UNIFICATION TECHNOLOGIES LLC
Assigned to R2 SOLUTIONS LLC reassignment R2 SOLUTIONS LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EXCALIBUR IP, LLC
Assigned to MONARCH NETWORKING SOLUTIONS LLC, CELLULAR COMMUNICATIONS EQUIPMENT LLC, LIMESTONE MEMORY SYSTEMS LLC, TELECONFERENCE SYSTEMS LLC, STINGRAY IP SOLUTIONS LLC, BONUTTI SKELETAL INNOVATIONS LLC, LIFEPORT SCIENCES LLC, SAINT LAWRENCE COMMUNICATIONS LLC, AMERICAN VEHICULAR SCIENCES LLC, ACACIA RESEARCH GROUP LLC, R2 SOLUTIONS LLC, PARTHENON UNIFIED MEMORY ARCHITECTURE LLC, SUPER INTERCONNECT TECHNOLOGIES LLC, NEXUS DISPLAY TECHNOLOGIES LLC, MOBILE ENHANCEMENT SOLUTIONS LLC, UNIFICATION TECHNOLOGIES LLC, INNOVATIVE DISPLAY TECHNOLOGIES LLC reassignment MONARCH NETWORKING SOLUTIONS LLC RELEASE OF SECURITY INTEREST IN PATENTS Assignors: STARBOARD VALUE INTERMEDIATE FUND LP
Assigned to R2 SOLUTIONS LLC reassignment R2 SOLUTIONS LLC CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 053654 FRAME 0254. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST GRANTED PURSUANT TO THE PATENT SECURITY AGREEMENT PREVIOUSLY RECORDED. Assignors: STARBOARD VALUE INTERMEDIATE FUND LP
Assigned to STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT reassignment STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNOR NAME PREVIOUSLY RECORDED AT REEL: 052853 FRAME: 0153. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Assignors: R2 SOLUTIONS LLC
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0255Targeted advertisements based on user history
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0255Targeted advertisements based on user history
    • G06Q30/0256User search
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0269Targeted advertisements based on user profile or attribute
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements

Definitions

  • the present invention relates to online advertising and, in particular, to techniques for selecting advertisements for display in online web pages.
  • Online Advertising relates to the promoting of products and services using the Internet and World Wide Web.
  • Typical online advertisement types include banner ads, floating ads, pop-up ads, and video ads, which are provided through a browser to the user's computer desktop.
  • a large segment of online advertising is untargeted.
  • online advertisement strategy involves placing an advertisement on the computer desktop of as many computer users as possible, in the hopes that at least a few computer users will be interested.
  • Such untargeted advertising tends to be inefficient, and may be annoying to many computer users whose computer desktop may seem cluttered with undesired ads or ads, which are uninteresting to the user.
  • Contextual advertising refers to a form of Internet advertising/marketing where advertisements are selected and served by automated systems based on content of the web page the user is viewing.
  • a contextual advertisement selection system may scan the text of a web page for keywords, and select advertisements based on any keywords located in the text. When the web page is displayed for the user, a contextual advertisement selection system provides the selected advertisements for display on the web page.
  • providers of online advertising services face considerable challenges that relate to the increasing tendency of users to ignore advertisement content.
  • a provider typically strives to achieve a balance between presenting advertisements which are sufficiently eye-catching to result in revenue, but which are not so intrusive that they negatively impact user experience.
  • a contextual advertisement methodology may result in inappropriate advertisements being inadvertently placed with respect to content, such as an airline advertisement that is selected for display with a news article about an airplane crash
  • apparatus and methods for facilitating contextual selection of advertisements for displaying online via a computer network are provided.
  • user features in the form of text are provided in conjunction with web page content for contextual advertisement matching.
  • a request for an advertisement to be displayed in a current web page that has been requested by a current user is received.
  • the current user is associated with one or more current user characteristics from a plurality of different user characteristics, wherein the current web page has an associated content.
  • a mapping model and the one or more current user characteristics are used to obtain a plurality of user-relevant terms for each of the one or more current user characteristics.
  • a combination of the content of the current web page and obtained user-relevant terms are provided for selecting an advertisement for displaying with the current web page based on such combination.
  • the different user characteristics comprise a plurality of different user categories that relate to user interest or expertise in such different user categories and/or a plurality of different user demographics.
  • Each of the plurality of different user characteristics is mapped to a plurality of user-relevant terms that are also relevant for contextual advertisement selection to generate one or more mapping models.
  • the mapping is based on collected user activity information.
  • the user activity information comprises a plurality of specified activity categories for different activities, a plurality of specified web pages that have been selected by a plurality of users, and a plurality of terms from the specified web pages.
  • the mapping comprises learning the mapping model based on the terms from the specified web pages and the specified activity categories. In a further aspect, this learning comprises using a regression technique and one or more topic models. In another aspect, the terms are extracted from the specified web pages that are relevant for advertisement selection. In a specific example, the learning comprises maximizing a likelihood function based on the specified web pages and the specified activity categories.
  • the invention pertains to an apparatus having at least a processor and a memory.
  • the processor and/or memory are configured to perform one or more of the above described operations.
  • the invention pertains to at least one computer readable storage medium having computer program instructions stored thereon that are arranged to perform one or more of the above described operations.
  • FIG. 1 shows advertisements in a contextual advertising environment in accordance with one example embodiment.
  • FIG. 2 illustrates an example network segment in which the present invention may be implemented in accordance with one embodiment of the present invention.
  • FIG. 3 is a flow chart illustrating a procedure for advertisement management in accordance with one embodiment of the present invention.
  • FIG. 4 is a diagrammatic representation of a contextual advertisement system in accordance with one embodiment of the present invention.
  • FIG. 5 is a flow chart illustrating a mapping process in accordance with a specific implementation of the present invention.
  • FIG. 6 illustrates an example computer system in which specific embodiments of the present invention may be implemented.
  • advertising is a major source of revenue.
  • One form of advertising involves showing advertisement banners on web sites as they are being visited by users.
  • a preeminent portal such as Yahoo! displays advertisements on one or more associated web sites that are viewed by users.
  • the advertisers pay a fee for each advertisement or a predefined number of advertisements viewed by web users.
  • Contracts to show advertisements are normally signed several weeks or months before advertisements get delivered and are often expressed in terms of page views. The duration of contracts typically ranges from one day to multiple years.
  • FIG. 1 shows advertisements in a contextual advertising environment 100 in accordance with one example embodiment.
  • a browser window 104 is open within display 102 .
  • the user may cause web page 106 to be displayed in this browser window 104 using any suitable technique, including navigating to web page 106 according to a URL (uniform resource locator) address for web page 106 or selecting the web page as a search result.
  • URL uniform resource locator
  • User features are generally mapped to textual content 108 a and provided along with the web page content 108 of the display web page 106 to a contextual ad system.
  • the web page content 108 may then be analyzed together with user feature content 108 a so as to determine the appropriate one or more advertisements 110 to display with the requested web page 106 .
  • different advertisements can be selected for two different users, who have different user features, requesting the same web page.
  • User feature information is mapped into a format that is usable by a content analyzer for selecting one or more advertisements.
  • the displayed web page 106 may then include any number and arrangement of selected advertisements 110 .
  • Selected advertisements 110 may be displayed according to any suitable format, including banner ads, floating ads, pop-up ads, and video ads.
  • advertisement-relevant text for one or more user features is learned based on historical user activities. This learned advertisement-relevant text for one or more user features may then be analyzed together with the advertisement-relevant text of a particular web page's content so as to select a particular advertisement for displaying with the particular web page's content.
  • the text based on user features may be more relevant to ad selection than the web page's content.
  • text content is not relevant for advertisement selection. For instance, a game playing site will likely have text pertaining to a particular game, and one would not want to select advertisements pertaining to the same game. In this case, only the text for the user features may be analyzed for ad selection. In other cases, it may be preferable to analyze only the text from the web page's content for ad selection.
  • FIG. 2 illustrates an example network segment 200 in which the present invention may be implemented in accordance with one embodiment of the present invention.
  • a plurality of clients 202 a - c may access one or more web property applications, for example, on property servers 207 a and 207 b via network 204 and/or access an advertisement service, for example, on contextual advertisement system 206 .
  • the network may take any suitable form, such as a wide area network or Internet and/or one or more local area networks (LAN's).
  • the network 204 may include any suitable number and type of devices, e.g., routers and switches, for forwarding web property requests from each client to each web property server and forwarding web property results back to the requesting clients, forwarding ad negotiation data between specific clients and contextual ad system 206 , or for forwarding data between various servers or systems.
  • the invention may also be practiced in a wide variety of network environments (represented by network 204 ) including, for example, TCP/IP-based networks, telecommunications networks, wireless networks, etc.
  • network environments represented by network 204
  • the computer program instructions with which embodiments of the invention are implemented may be stored in any type of computer-readable media, and may be executed according to a variety of computing models including a client/server model, a peer-to-peer model, on a stand-alone computing device, or according to a distributed computing model in which various of the functionalities described herein may be effected or employed at different locations.
  • Each web property application may implement any type of web service that is provided by a particular service provider (e.g., Yahoo! Inc. of Sunnyvale, Calif.), such as Yahoo! Answers, Yahoo! Autos, Yahoo! Finance, Yahoo! Games, Yahoo! Groups, Yahoo! HotJobs, Yahoo! Maps, Yahoo! Movies/TV, Yahoo! Music, Yahoo! Personals, Yahoo! Real Estate, Yahoo Shopping, Yahoo! Sports, Yahoo! Travel, Yahoo! Yellow Pages, Yahoo! Local, Yahoo! Search, Yahoo! Email, etc.
  • Each property application may be utilized by a user (human or automated), e.g., on clients 202 a - 202 c.
  • Each web property may facilitate access to any suitable number and type of web pages.
  • a user of client 202 c who desires to view a web page may submit a request to a particular web property 207 a through network 204 .
  • the request may be in any suitable form, such as a clicked link or URL address entered into a web browser.
  • the property server 207 a may receive the request and transmit a web page corresponding to content request back to client 202 c to be viewed by the user at client 202 c.
  • Advertisement salespeople who sell contracts to advertisers may interact with contextual advertisement system 206 (e.g., via client 202 a and through network 204 ).
  • a salesperson may issue a query to contextual advertisement system 206 regarding a specified product or target.
  • the product may be specified by particular content or “advertisement words” or “keywords” that can be found in served web pages.
  • the product may be automatically specified based on ad text.
  • the contextual advertisement system 206 may also be configured to obtain a price for a specified product, obtain inventory availability information, and return the available inventory information and price to a querying salesperson (e.g., to client 202 a via network 204 ). The salesperson may then book a contract accordingly (e.g., via contextual advertisement system 206 via network 204 ). The contextual advertisement system 206 then operates to fill the booking by providing the number of requested impressions (e.g., via a property server) at the negotiated price during the contract period.
  • one or more advertisements may be displayed in a particular web page ( 106 ) based on such web page's content and advertisement contracts for specified content.
  • One or more advertisements may be selected by contextual advertisement system 206 based on contracts with an advertiser for specified contextual content.
  • a property server e.g., 207 a
  • Contextual advertisement system 206 may search or scan the textual content 108 of the selected web page, including the user feature content 108 a, for keywords, and select an advertisement from an advertisement database based on any located keywords and the contracts made with specific advertisers for such keywords. Contextual advertisement system 206 may then select one or more advertisements based on content 108 , including user feature content 108 a. The selected one or more advertisements are then provided to the property server (or directly to the client device) to be included in the web page provided to the client device of the user in response to web page request.
  • the contextual advertisement system 206 may access any number and type of databases (e.g., advertisement database 210 ) for facilitating advertisement functions.
  • advertisement database 210 may be used to store contractual information, advertisement content, advertisement selection models, etc.
  • the network may also include a user feature analyzer 208 for analyzing user feature data, e.g., as stored in user features database 212 .
  • User features data may include user profiles, search information, web page viewing/selection information, advertisement viewing/selection information, etc. as compiled over predetermined time periods.
  • the user feature analyzer 208 may use this historical data to learn mapping models for mapping user profile information to contextual information, click models for selection of advertisements based on contextual information, pricing models for pricing specified products, etc., which may also be stored in user feature database 212 .
  • the advertisement system may perform all of the analysis for selecting advertisements for specific selected web pages; the user feature analyzer 208 may perform all the analysis with respect to user historical activities; and the individual property servers may serve web pages. Alternatively, any number or portion of these processes may be shared by any of these systems. Alternatively, the advertisement, behavior analysis, and serving features may be integrated together. Embodiments of the present invention may be employed with respect to any provider of one or more web property applications and advertisement system, and example providers include Yahoo! Inc., Google Inc., Microsoft Corp., etc. A plurality of web property applications and advertisement system may be implemented on any number of servers although only one advertisement system 206 and two web property servers 207 a and 207 b are illustrated for clarity and simplification of the description.
  • FIG. 3 is a flow chart illustrating a procedure for advertisement management in accordance with one embodiment of the present invention.
  • one or more characteristics of users are mapped to a plurality of user relevant terms that relate to advertisements, for example, to generate a mapping model, in operation 302 .
  • a “term” can refer to any suitable textual feature, such as one or more words or phrases.
  • past user activities and profiles 404 with respect to selected and viewed web pages 402 and a list of advertisement terms or keywords 406 are provided.
  • a mapping between user features or profiles and advertisement terms is then learned ( 410 ) based on analysis of such historical information, and this mapping may result in one or more mapping models (e.g., 412 ).
  • a user's profile indicates one or more specific categories in which the user is deemed to be interested or have expertise, and these categories can be mapped by a mapping model 412 to a set of advertisement terms (e.g., a subset of the predetermined and complete advertisement term list 406 ).
  • Other user feature information such as user demographics, may also be mapped to the ad terms.
  • a request for an advertisement to be displayed in a particular web page that has been requested or selected by a user may then be received in operation 304 .
  • a user may have performed a search with a particular search server and then selected a particular search result.
  • a user may access and view one or more web pages from a particular property.
  • the search server (or other property server) may have sent an advertisement request for the selected search result to a contextual advertisement system.
  • a current web page 416 is being accessed by a particular user.
  • user-relevant terms may be obtained and provide a combination of the user-relevant terms and the current web page's content (e.g., to a contextual advertisement system) in operation 305 .
  • the current user profile may pertain to a user category. Behavior targeting algorithms may be used to output categories that are relevant for specific users. Each category typically represents the particular user's interest or expertise in the category.
  • the current user profile may also include user demographics, such as age, gender, occupation, educational level, salary, etc.
  • one or more mapping models 412 can be used to map the current user profile to a set of user-relevant terms from advertisement list 406 .
  • the combined web page content and user-relevant terms may then be analyzed to select an advertisement (or set of advertisements) in operation 306 .
  • a click model 414 as learned ( 408 ) based on user historical information ( 404 and 402 ), may be used to select the most appropriate advertisement 420 based on the user-relevant terms and current page content 418 .
  • the web page, including its current page content 418 can then be caused to be sent to the user for display with the selected advertisement ( 420 ) in operation 308 .
  • the advertisement management process 300 then ends. However, this process for selecting an advertisement may be repeated for any number and type of web pages and user profiles.
  • FIG. 5 is a flow chart illustrating a mapping process 500 in accordance with a specific implementation of the present invention.
  • mapping is learned over observed features so as to annotate users with text when their text cannot be observed.
  • a simple topic model can be generated for each user.
  • historical user activity information is collected in operation 502 .
  • the user activity information generally relates to user browsing activities. For example, historical user activity may be collected and stored for predefined time periods, and this user activity information may include information on user visits to web pages, user search query information, user search results selection information, page content, advertisement views and clicks, etc.
  • a category is also associated with each search query in any suitable manner, such as manual or semi-supervised, supervised classification.
  • Terms from the content of selected pages may be extracted in operation 504 .
  • Terms may also be extracted from the search queries (or other user activity types) themselves. Additionally, terms may be extracted from web pages or advertisements visited by users, etc. That is, the source of the extracted text may be from any number and type of user events. Text may be extracted using any suitable techniques.
  • One or more feature extraction operators may output textual features, such as any combination of the following types:
  • F corresponds to feature extraction operators for each user (u), which is implemented over n time periods denoted by ⁇ and e ⁇ indicates the set of user events for which user features are extracted during time period ⁇ , such as a search or a visit to a web page.
  • n 30 and is ⁇ one day.
  • is a decay factor that can be chosen to be greater than zero and less than or equal to 1 and that can represent the marginal contribution of one day to the user's history. The smaller the decay, the more the past is discounted.
  • a decayed sum may be implemented by the following recurrence formula, which can be computed incrementally without storing the event-level history of each user:
  • a set of terms may be obtained over time for a number of users and particular event types. These extracted terms are relevant to advertisements. For example, the extracted terms are the same terms that can be extracted from the advertisements or are deemed to be relevant by the advertisers.
  • a count for each extracted term during the search activities (or other type of activities) for each user may be obtained over the predetermined time period (e.g., 1 month) in operation 506 .
  • the number of visited pages that include a particular term visited by the user may be summed.
  • a sequence of records (e.g., user X, category c, terms) for each user may be compiled and stored. That is, each identified user (e.g., X) may be associated and recorded with the search query category and a list of extracted terms and their corresponding counts or weights.
  • a model to find the weights for the terms of each category may be trained so as to maximize a likelihood function based on the obtained counts in operation 508 .
  • a machine learning classifier such as a logistic regression model, is trained to find the weights for the terms for each category. Mapping for each category can then be defined as the set of terms with the highest weights (e.g., top 200 ) in operation 510 .
  • a probability for each category is learned with respect to the terms. For instance, it is determined which category is most likely relevant for a given term.
  • the probability for each category and user can be modeled by the following:
  • Each, ⁇ i,j t j is the contribution of term t j to specific category, c i .
  • the maximum likelihood parameters, ⁇ , for a specific category are those weights that result in a probability function that most closely matches a likelihood determination based on the historical data counts for such category. For example, if a particular term has a large weight for a particular category, any user who issues a search query (or alternatively, another type of activity) in the particular category has been found to likely view a web page having such particular term. In other words, it is determined which term weight values (e.g., top 200 weights) most closely represent the historical data. These terms are then mapped to the particular category.
  • user demographic information may also be mapped to specific terms (and considered by click models to select one or more advertisements).
  • User demographics values are non-textual values, such as male/female, age range as a number, the user location, etc. For each of these, a corresponding text-based feature may be generated. For example, the following text features may be generated:
  • advertising click logs may be mined in any suitable manner to generate text features for user demographics.
  • To generate a first dataset of candidate text features for every advertisement click event in the advertising click log, the user's age, gender, location, and the corresponding advertisement bid phrases that represent the general topic of the advertisement may be recorded.
  • a set of potential mappings from non-textual user demographic features to text-based advertisement bid phrases is obtained.
  • This list of (user feature-text phrases) mappings may then be mined for the strongest associations among them. Support threshold based filtering to remove mappings with low support may then be performed. A point-wise mutual information may then be calculated in every (user feature-ad phrase) combination so as to rank the most strongly associated pairs.
  • Table I shows examples of (user feature-ad phrase) pairs obtained from such association mining.
  • Age sensitive pairs age range (15-25) - animation training age range (15-25)- animation classes age range (25-50) - 1040 child tax credit age range (15-35) - education loans age range (15-40)- rental housing age range (35-55) - refinance your mortgage age range (35-65+) - actively managed ETFs age range (60+) - medical supplies
  • Gender sensitive pairs Female - zucchini bread recipe
  • Female - beauty supplies Female - apparel and jewellery Male - workout bar Male - ford motor co Male - lakers basketball Male - automotives
  • each ad category can be mapped to a set of text phrases that are commonly associated with it, providing an ample textual description of each ad category.
  • a list of the most strongly associated (user feature-ad category) pairs may be obtained.
  • the user categories can be further expanded to text using the text phrases associated with each category and weighted by the strength of the association.
  • a weighted text representation or tag cloud may be created based on the user's gender (F g ), user's age (F a ), and user's location (F 1 ) by way of examples.
  • F g user's gender
  • F a user's age
  • F 1 user's location
  • textual advertisements can be tailored to the specific interests and/or characteristics of the user.
  • user-specific and page-specific ad matching can be controlled.
  • the ad matching may be based on weighted user or page text contributions so as to control the proportion of text types that affect the ad selection process for any suitable purpose.
  • FIG. 6 illustrates a typical computer system that, when appropriately configured or designed, can serve as a contextual advertisement system.
  • the computer system 600 includes any number of processors 602 (also referred to as central processing units, or CPUs) that are coupled to storage devices including primary storage 606 (typically a random access memory, or RAM), primary storage 604 (typically a read only memory, or ROM).
  • processors 602 may be of various types including microcontrollers and microprocessors such as programmable devices (e.g., CPLDs and FPGAs) and unprogrammable devices such as gate array ASICs or general-purpose microprocessors.
  • primary storage 604 acts to transfer data and instructions uni-directionally to the CPU and primary storage 606 is used typically to transfer data and instructions in a bi-directional manner. Both of these primary storage devices may include any suitable computer-readable media such as those described herein.
  • a mass storage device 608 is also coupled bi-directionally to CPU 602 and provides additional data storage capacity and may include any of the computer-readable media described herein. Mass storage device 608 may be used to store programs, data and the like and is typically a secondary storage medium such as a hard disk. It will be appreciated that the information retained within the mass storage device 608 , may, in appropriate cases, be incorporated in standard fashion as part of primary storage 606 as virtual memory.
  • a specific mass storage device such as a CD-ROM 614 may also pass data uni-directionally to the CPU.
  • CPU 602 is also coupled to an interface 610 that connects to one or more input/output devices such as such as video monitors, track balls, mice, keyboards, microphones, touch-sensitive displays, transducer card readers, magnetic or paper tape readers, tablets, styluses, voice or handwriting recognizers, or other well-known input devices such as, of course, other computers.
  • CPU 602 optionally may be coupled to an external device such as a database or a computer or telecommunications network using an external connection as shown generally at 612 . With such a connection, it is contemplated that the CPU might receive information from the network, or might output information to the network in the course of performing the method steps described herein.
  • the system may employ one or more memories or memory modules configured to store data, program instructions for the general-purpose processing operations and/or the inventive techniques described herein.
  • the program instructions may control the operation of an operating system and/or one or more applications, for example.
  • the memory or memories may also be configured to store web page content, historical user information, extracted terms and counts, weights, categories, click models, mapping models, current user profile information, user-relevant terms, advertisements, advertisement content and terms, new impression target information, booking prices, booking duration, number of impressions for each booking, supply and demand information, etc.
  • machine-readable media that include program instructions, state information, etc. for performing various operations described herein.
  • machine-readable media include, but are not limited to, magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as floptical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory devices (ROM) and random access memory (RAM).
  • program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter.
  • mappings between terms and user categories and/or demographics have been described, any suitable user activity or characteristic may be mapped to ad-relevant terms. Therefore, the present embodiments are to be considered as illustrative and not restrictive and the invention is not to be limited to the details given herein, but may be modified within the scope and equivalents of the appended claims.

Abstract

Disclosed are apparatus and methods for apparatus and methods for facilitating contextual selection of advertisements for displaying online via a computer network. In general, user features in the form of text are provided in conjunction with web page content for contextual advertisement matching. In one embodiment, a request for an advertisement to be displayed in a current web page that has been requested by a current user is received. The current user is associated with one or more current user characteristics from a plurality of different user characteristics, and the current web page has an associated content. A mapping model and the one or more current user characteristics are used to obtain a plurality of user-relevant terms for each of the one or more current user characteristics. A combination of the content of the current web page and obtained user-relevant terms are provided for selecting an advertisement for displaying with the current web page based on such combination.

Description

    BACKGROUND OF THE INVENTION
  • The present invention relates to online advertising and, in particular, to techniques for selecting advertisements for display in online web pages.
  • Online Advertising relates to the promoting of products and services using the Internet and World Wide Web. Typical online advertisement types include banner ads, floating ads, pop-up ads, and video ads, which are provided through a browser to the user's computer desktop. A large segment of online advertising is untargeted. Typically, online advertisement strategy involves placing an advertisement on the computer desktop of as many computer users as possible, in the hopes that at least a few computer users will be interested. Such untargeted advertising tends to be inefficient, and may be annoying to many computer users whose computer desktop may seem cluttered with undesired ads or ads, which are uninteresting to the user.
  • “Contextual advertising” refers to a form of Internet advertising/marketing where advertisements are selected and served by automated systems based on content of the web page the user is viewing. For example, a contextual advertisement selection system may scan the text of a web page for keywords, and select advertisements based on any keywords located in the text. When the web page is displayed for the user, a contextual advertisement selection system provides the selected advertisements for display on the web page.
  • Regardless of the specific online advertisement type, providers of online advertising services face considerable challenges that relate to the increasing tendency of users to ignore advertisement content. A provider typically strives to achieve a balance between presenting advertisements which are sufficiently eye-catching to result in revenue, but which are not so intrusive that they negatively impact user experience. For example, a contextual advertisement methodology may result in inappropriate advertisements being inadvertently placed with respect to content, such as an airline advertisement that is selected for display with a news article about an airplane crash
  • SUMMARY OF THE INVENTION
  • Accordingly, apparatus and methods for facilitating contextual selection of advertisements for displaying online via a computer network are provided. In general, user features in the form of text are provided in conjunction with web page content for contextual advertisement matching. In one embodiment, a request for an advertisement to be displayed in a current web page that has been requested by a current user is received. The current user is associated with one or more current user characteristics from a plurality of different user characteristics, wherein the current web page has an associated content. A mapping model and the one or more current user characteristics are used to obtain a plurality of user-relevant terms for each of the one or more current user characteristics. A combination of the content of the current web page and obtained user-relevant terms are provided for selecting an advertisement for displaying with the current web page based on such combination.
  • In a specific implementation, the different user characteristics comprise a plurality of different user categories that relate to user interest or expertise in such different user categories and/or a plurality of different user demographics. In a further aspect. Each of the plurality of different user characteristics is mapped to a plurality of user-relevant terms that are also relevant for contextual advertisement selection to generate one or more mapping models. In one embodiment, the mapping is based on collected user activity information. For example, the user activity information comprises a plurality of specified activity categories for different activities, a plurality of specified web pages that have been selected by a plurality of users, and a plurality of terms from the specified web pages.
  • In one implementation, the mapping comprises learning the mapping model based on the terms from the specified web pages and the specified activity categories. In a further aspect, this learning comprises using a regression technique and one or more topic models. In another aspect, the terms are extracted from the specified web pages that are relevant for advertisement selection. In a specific example, the learning comprises maximizing a likelihood function based on the specified web pages and the specified activity categories.
  • In another embodiment, the invention pertains to an apparatus having at least a processor and a memory. The processor and/or memory are configured to perform one or more of the above described operations. In another embodiment, the invention pertains to at least one computer readable storage medium having computer program instructions stored thereon that are arranged to perform one or more of the above described operations.
  • These and other features of the present invention will be presented in more detail in the following specification of embodiments of the invention and the accompanying figures which illustrate by way of example the principles of the invention.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows advertisements in a contextual advertising environment in accordance with one example embodiment.
  • FIG. 2 illustrates an example network segment in which the present invention may be implemented in accordance with one embodiment of the present invention.
  • FIG. 3 is a flow chart illustrating a procedure for advertisement management in accordance with one embodiment of the present invention.
  • FIG. 4 is a diagrammatic representation of a contextual advertisement system in accordance with one embodiment of the present invention.
  • FIG. 5 is a flow chart illustrating a mapping process in accordance with a specific implementation of the present invention.
  • FIG. 6 illustrates an example computer system in which specific embodiments of the present invention may be implemented.
  • DETAILED DESCRIPTION OF THE SPECIFIC EMBODIMENTS
  • Reference will now be made in detail to specific embodiments of the invention. Examples of these embodiments are illustrated in the accompanying drawings. While the invention will be described in conjunction with these specific embodiments, it will be understood that they are not intended to limit the invention to these specific embodiments. On the contrary, such description is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims. In the following description, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the present invention. Embodiments of the present invention may be practiced without some or all of these specific details. In other instances, well known process operations have not been described in detail in order not to unnecessarily obscure embodiments of the present invention.
  • For many web portals and Internet Service Providers (ISPs), advertising is a major source of revenue. One form of advertising involves showing advertisement banners on web sites as they are being visited by users. For example, a preeminent portal such as Yahoo! displays advertisements on one or more associated web sites that are viewed by users. In return, the advertisers pay a fee for each advertisement or a predefined number of advertisements viewed by web users. Contracts to show advertisements are normally signed several weeks or months before advertisements get delivered and are often expressed in terms of page views. The duration of contracts typically ranges from one day to multiple years.
  • FIG. 1 shows advertisements in a contextual advertising environment 100 in accordance with one example embodiment. In this example, a browser window 104 is open within display 102. The user may cause web page 106 to be displayed in this browser window 104 using any suitable technique, including navigating to web page 106 according to a URL (uniform resource locator) address for web page 106 or selecting the web page as a search result.
  • In general, mechanisms for selecting advertisements based on contextual content of both web pages and user features are provided herein. User features are generally mapped to textual content 108 a and provided along with the web page content 108 of the display web page 106 to a contextual ad system. The web page content 108 may then be analyzed together with user feature content 108 a so as to determine the appropriate one or more advertisements 110 to display with the requested web page 106. In other words, different advertisements can be selected for two different users, who have different user features, requesting the same web page. User feature information is mapped into a format that is usable by a content analyzer for selecting one or more advertisements. After content analysis of the requested web page and user feature content is performed, the displayed web page 106 may then include any number and arrangement of selected advertisements 110. Selected advertisements 110 may be displayed according to any suitable format, including banner ads, floating ads, pop-up ads, and video ads.
  • In one embodiment, advertisement-relevant text for one or more user features is learned based on historical user activities. This learned advertisement-relevant text for one or more user features may then be analyzed together with the advertisement-relevant text of a particular web page's content so as to select a particular advertisement for displaying with the particular web page's content.
  • In certain cases, the text based on user features may be more relevant to ad selection than the web page's content. In certain web pages, text content is not relevant for advertisement selection. For instance, a game playing site will likely have text pertaining to a particular game, and one would not want to select advertisements pertaining to the same game. In this case, only the text for the user features may be analyzed for ad selection. In other cases, it may be preferable to analyze only the text from the web page's content for ad selection.
  • Prior to describing techniques for selecting advertisements for a web page, a computer network architecture will first be briefly described to provide an example context for practicing techniques of the present invention. FIG. 2 illustrates an example network segment 200 in which the present invention may be implemented in accordance with one embodiment of the present invention. As shown, a plurality of clients 202 a-c may access one or more web property applications, for example, on property servers 207 a and 207 b via network 204 and/or access an advertisement service, for example, on contextual advertisement system 206.
  • The network may take any suitable form, such as a wide area network or Internet and/or one or more local area networks (LAN's). The network 204 may include any suitable number and type of devices, e.g., routers and switches, for forwarding web property requests from each client to each web property server and forwarding web property results back to the requesting clients, forwarding ad negotiation data between specific clients and contextual ad system 206, or for forwarding data between various servers or systems.
  • The invention may also be practiced in a wide variety of network environments (represented by network 204) including, for example, TCP/IP-based networks, telecommunications networks, wireless networks, etc. In addition, the computer program instructions with which embodiments of the invention are implemented may be stored in any type of computer-readable media, and may be executed according to a variety of computing models including a client/server model, a peer-to-peer model, on a stand-alone computing device, or according to a distributed computing model in which various of the functionalities described herein may be effected or employed at different locations.
  • Each web property application may implement any type of web service that is provided by a particular service provider (e.g., Yahoo! Inc. of Sunnyvale, Calif.), such as Yahoo! Answers, Yahoo! Autos, Yahoo! Finance, Yahoo! Games, Yahoo! Groups, Yahoo! HotJobs, Yahoo! Maps, Yahoo! Movies/TV, Yahoo! Music, Yahoo! Personals, Yahoo! Real Estate, Yahoo Shopping, Yahoo! Sports, Yahoo! Travel, Yahoo! Yellow Pages, Yahoo! Local, Yahoo! Search, Yahoo! Email, etc. Each property application may be utilized by a user (human or automated), e.g., on clients 202 a-202 c.
  • Each web property may facilitate access to any suitable number and type of web pages. For example, a user of client 202 c who desires to view a web page may submit a request to a particular web property 207 a through network 204. The request may be in any suitable form, such as a clicked link or URL address entered into a web browser. The property server 207 a may receive the request and transmit a web page corresponding to content request back to client 202 c to be viewed by the user at client 202 c.
  • Advertisement salespeople who sell contracts to advertisers may interact with contextual advertisement system 206 (e.g., via client 202 a and through network 204). In one embodiment, a salesperson may issue a query to contextual advertisement system 206 regarding a specified product or target. For example, the product may be specified by particular content or “advertisement words” or “keywords” that can be found in served web pages.
  • Alternatively, the product may be automatically specified based on ad text. Regardless of the origin of the specified product, the contextual advertisement system 206 may also be configured to obtain a price for a specified product, obtain inventory availability information, and return the available inventory information and price to a querying salesperson (e.g., to client 202 a via network 204). The salesperson may then book a contract accordingly (e.g., via contextual advertisement system 206 via network 204). The contextual advertisement system 206 then operates to fill the booking by providing the number of requested impressions (e.g., via a property server) at the negotiated price during the contract period.
  • As described herein, one or more advertisements (e.g., 110) may be displayed in a particular web page (106) based on such web page's content and advertisement contracts for specified content. One or more advertisements may be selected by contextual advertisement system 206 based on contracts with an advertiser for specified contextual content. For instance, a property server (e.g., 207 a) may provide the textual content (108), which includes the content of the selected page and one or more characteristics of the requesting user, to contextual advertisement system 206.
  • Contextual advertisement system 206 may search or scan the textual content 108 of the selected web page, including the user feature content 108 a, for keywords, and select an advertisement from an advertisement database based on any located keywords and the contracts made with specific advertisers for such keywords. Contextual advertisement system 206 may then select one or more advertisements based on content 108, including user feature content 108 a. The selected one or more advertisements are then provided to the property server (or directly to the client device) to be included in the web page provided to the client device of the user in response to web page request.
  • The contextual advertisement system 206 may access any number and type of databases (e.g., advertisement database 210) for facilitating advertisement functions. For instance, advertisement database 210 may be used to store contractual information, advertisement content, advertisement selection models, etc.
  • The network may also include a user feature analyzer 208 for analyzing user feature data, e.g., as stored in user features database 212. User features data may include user profiles, search information, web page viewing/selection information, advertisement viewing/selection information, etc. as compiled over predetermined time periods. The user feature analyzer 208 may use this historical data to learn mapping models for mapping user profile information to contextual information, click models for selection of advertisements based on contextual information, pricing models for pricing specified products, etc., which may also be stored in user feature database 212.
  • The advertisement system may perform all of the analysis for selecting advertisements for specific selected web pages; the user feature analyzer 208 may perform all the analysis with respect to user historical activities; and the individual property servers may serve web pages. Alternatively, any number or portion of these processes may be shared by any of these systems. Alternatively, the advertisement, behavior analysis, and serving features may be integrated together. Embodiments of the present invention may be employed with respect to any provider of one or more web property applications and advertisement system, and example providers include Yahoo! Inc., Google Inc., Microsoft Corp., etc. A plurality of web property applications and advertisement system may be implemented on any number of servers although only one advertisement system 206 and two web property servers 207 a and 207 b are illustrated for clarity and simplification of the description.
  • FIG. 3 is a flow chart illustrating a procedure for advertisement management in accordance with one embodiment of the present invention. Initially, one or more characteristics of users are mapped to a plurality of user relevant terms that relate to advertisements, for example, to generate a mapping model, in operation 302. Throughout this description, a “term” can refer to any suitable textual feature, such as one or more words or phrases. As shown in FIG. 4, past user activities and profiles 404 with respect to selected and viewed web pages 402 and a list of advertisement terms or keywords 406 are provided. A mapping between user features or profiles and advertisement terms is then learned (410) based on analysis of such historical information, and this mapping may result in one or more mapping models (e.g., 412). In a specific implementation, a user's profile indicates one or more specific categories in which the user is deemed to be interested or have expertise, and these categories can be mapped by a mapping model 412 to a set of advertisement terms (e.g., a subset of the predetermined and complete advertisement term list 406). Other user feature information, such as user demographics, may also be mapped to the ad terms.
  • Referring back to the example process of FIG. 3, a request for an advertisement to be displayed in a particular web page that has been requested or selected by a user may then be received in operation 304. For example, a user may have performed a search with a particular search server and then selected a particular search result. In another example, a user may access and view one or more web pages from a particular property. Additionally, the search server (or other property server) may have sent an advertisement request for the selected search result to a contextual advertisement system. As illustrated in FIG. 4, a current web page 416 is being accessed by a particular user.
  • Using one or more mapping models 412 and current user profile, user-relevant terms may be obtained and provide a combination of the user-relevant terms and the current web page's content (e.g., to a contextual advertisement system) in operation 305. The current user profile may pertain to a user category. Behavior targeting algorithms may be used to output categories that are relevant for specific users. Each category typically represents the particular user's interest or expertise in the category. The current user profile may also include user demographics, such as age, gender, occupation, educational level, salary, etc.
  • As shown in FIG. 4, one or more mapping models 412 can be used to map the current user profile to a set of user-relevant terms from advertisement list 406. The combined web page content and user-relevant terms may then be analyzed to select an advertisement (or set of advertisements) in operation 306. For instance, a click model 414, as learned (408) based on user historical information (404 and 402), may be used to select the most appropriate advertisement 420 based on the user-relevant terms and current page content 418. The web page, including its current page content 418, can then be caused to be sent to the user for display with the selected advertisement (420) in operation 308. The advertisement management process 300 then ends. However, this process for selecting an advertisement may be repeated for any number and type of web pages and user profiles.
  • FIG. 5 is a flow chart illustrating a mapping process 500 in accordance with a specific implementation of the present invention. In general, mapping is learned over observed features so as to annotate users with text when their text cannot be observed. In one implementation, a simple topic model can be generated for each user. Initially, historical user activity information is collected in operation 502. The user activity information generally relates to user browsing activities. For example, historical user activity may be collected and stored for predefined time periods, and this user activity information may include information on user visits to web pages, user search query information, user search results selection information, page content, advertisement views and clicks, etc. A category is also associated with each search query in any suitable manner, such as manual or semi-supervised, supervised classification.
  • Terms from the content of selected pages may be extracted in operation 504. Terms may also be extracted from the search queries (or other user activity types) themselves. Additionally, terms may be extracted from web pages or advertisements visited by users, etc. That is, the source of the extracted text may be from any number and type of user events. Text may be extracted using any suitable techniques. One or more feature extraction operators may output textual features, such as any combination of the following types:
      • Stemmed unigrams, using porter stemming.
      • Phrases that match search queries in the past.
      • Phrases that match a phrase that is bidded on by some advertiser in the past.
      • Features of the web page URL (uniform resource locator), in the case of pages such as the hostname of the page.
  • Terms may then be aggregated with a decayed sum resulting in the tag cloud representation as follows:
  • F u ( u ) = τ = 1 n F u ( u ; τ ) δ τ F ( u ; τ ) = e e τ F Type ( e ) ( e )
  • F corresponds to feature extraction operators for each user (u), which is implemented over n time periods denoted by Γ and eΓ indicates the set of user events for which user features are extracted during time period Γ, such as a search or a visit to a web page. For example, n=30 and is Γ one day. Additionally, δ is a decay factor that can be chosen to be greater than zero and less than or equal to 1 and that can represent the marginal contribution of one day to the user's history. The smaller the decay, the more the past is discounted. A decayed sum may be implemented by the following recurrence formula, which can be computed incrementally without storing the event-level history of each user:

  • F u(u)=F u(u;)+δF(u;π−1)
  • Thus, a set of terms may be obtained over time for a number of users and particular event types. These extracted terms are relevant to advertisements. For example, the extracted terms are the same terms that can be extracted from the advertisements or are deemed to be relevant by the advertisers.
  • A count for each extracted term during the search activities (or other type of activities) for each user may be obtained over the predetermined time period (e.g., 1 month) in operation 506. For example, the number of visited pages that include a particular term visited by the user may be summed. A sequence of records (e.g., user X, category c, terms) for each user may be compiled and stored. That is, each identified user (e.g., X) may be associated and recorded with the search query category and a list of extracted terms and their corresponding counts or weights.
  • A model to find the weights for the terms of each category may be trained so as to maximize a likelihood function based on the obtained counts in operation 508. In a specific implementation, a machine learning classifier, such as a logistic regression model, is trained to find the weights for the terms for each category. Mapping for each category can then be defined as the set of terms with the highest weights (e.g., top 200) in operation 510.
  • In one specific implementation, a probability for each category is learned with respect to the terms. For instance, it is determined which category is most likely relevant for a given term. The probability for each category and user can be modeled by the following:
  • P ( c i u ) = 1 Z j α i , j t j Z = k j α i , j t j
  • Each, αi,j t j , is the contribution of term tj to specific category, ci. There are a total of advertisement-relevant terms, j. The maximum likelihood parameters, α, for a specific category are those weights that result in a probability function that most closely matches a likelihood determination based on the historical data counts for such category. For example, if a particular term has a large weight for a particular category, any user who issues a search query (or alternatively, another type of activity) in the particular category has been found to likely view a web page having such particular term. In other words, it is determined which term weight values (e.g., top 200 weights) most closely represent the historical data. These terms are then mapped to the particular category.
  • These semi-supervised topic model can be extremely simple to implement at large scale. It is very easy to interpret because the topics have already been defined. For example, for the category “Motorcycles”, the most likely terms can be brands, such as “kawaski” and “yamaha”.
  • In addition (or alternatively) to mapping user categories to specific terms, user demographic information may also be mapped to specific terms (and considered by click models to select one or more advertisements). User demographics values are non-textual values, such as male/female, age range as a number, the user location, etc. For each of these, a corresponding text-based feature may be generated. For example, the following text features may be generated:
      • Text features for user gender, Fg
      • Text features for user age, Fa
      • Text features for user location, F1
  • In one embodiment, advertising click logs may be mined in any suitable manner to generate text features for user demographics. To generate a first dataset of candidate text features, for every advertisement click event in the advertising click log, the user's age, gender, location, and the corresponding advertisement bid phrases that represent the general topic of the advertisement may be recorded. Thus, a set of potential mappings from non-textual user demographic features to text-based advertisement bid phrases is obtained.
  • This list of (user feature-text phrases) mappings may then be mined for the strongest associations among them. Support threshold based filtering to remove mappings with low support may then be performed. A point-wise mutual information may then be calculated in every (user feature-ad phrase) combination so as to rank the most strongly associated pairs. The following Table I shows examples of (user feature-ad phrase) pairs obtained from such association mining.
  • TABLE I
    EXAMPLES OF USER FEATURES
    ASSOCIATED WITH AD PHRASES.
    Age sensitive pairs
    age range (15-25) - animation training
    age range (15-25)- animation classes
    age range (25-50) - 1040 child tax credit
    age range (15-35) - education loans
    age range (15-40)- rental housing
    age range (35-55) - refinance your mortgage
    age range (35-65+) - actively managed ETFs
    age range (60+) - medical supplies
    Gender sensitive pairs
    Female - zucchini bread recipe
    Female - neostrata skin product
    Female - beauty supplies
    Female - apparel and jewellery
    Male - workout bar
    Male - ford motor co
    Male - lakers basketball
    Male - automotives
  • To generate a second dataset of text phrases, for every ad click event in the advertising click log, the user's age, gender, location, and the corresponding ad category specified as a node in the ad taxonomy may be recorded. Each ad category can be mapped to a set of text phrases that are commonly associated with it, providing an ample textual description of each ad category.
  • Using similar association mining for ad categories, a list of the most strongly associated (user feature-ad category) pairs may be obtained. The user categories can be further expanded to text using the text phrases associated with each category and weighted by the strength of the association.
  • Using these text phrase associations for user demographics, for each user u, a weighted text representation or tag cloud may be created based on the user's gender (Fg), user's age (Fa), and user's location (F1) by way of examples. These text features for demographics may be combined with text features for a category.
  • Using the above described user mappings, textual advertisements can be tailored to the specific interests and/or characteristics of the user. Additionally, user-specific and page-specific ad matching can be controlled. For instance, the ad matching may be based on weighted user or page text contributions so as to control the proportion of text types that affect the ad selection process for any suitable purpose.
  • FIG. 6 illustrates a typical computer system that, when appropriately configured or designed, can serve as a contextual advertisement system. The computer system 600 includes any number of processors 602 (also referred to as central processing units, or CPUs) that are coupled to storage devices including primary storage 606 (typically a random access memory, or RAM), primary storage 604 (typically a read only memory, or ROM). CPU 602 may be of various types including microcontrollers and microprocessors such as programmable devices (e.g., CPLDs and FPGAs) and unprogrammable devices such as gate array ASICs or general-purpose microprocessors. As is well known in the art, primary storage 604 acts to transfer data and instructions uni-directionally to the CPU and primary storage 606 is used typically to transfer data and instructions in a bi-directional manner. Both of these primary storage devices may include any suitable computer-readable media such as those described herein. A mass storage device 608 is also coupled bi-directionally to CPU 602 and provides additional data storage capacity and may include any of the computer-readable media described herein. Mass storage device 608 may be used to store programs, data and the like and is typically a secondary storage medium such as a hard disk. It will be appreciated that the information retained within the mass storage device 608, may, in appropriate cases, be incorporated in standard fashion as part of primary storage 606 as virtual memory. A specific mass storage device such as a CD-ROM 614 may also pass data uni-directionally to the CPU.
  • CPU 602 is also coupled to an interface 610 that connects to one or more input/output devices such as such as video monitors, track balls, mice, keyboards, microphones, touch-sensitive displays, transducer card readers, magnetic or paper tape readers, tablets, styluses, voice or handwriting recognizers, or other well-known input devices such as, of course, other computers. Finally, CPU 602 optionally may be coupled to an external device such as a database or a computer or telecommunications network using an external connection as shown generally at 612. With such a connection, it is contemplated that the CPU might receive information from the network, or might output information to the network in the course of performing the method steps described herein.
  • Regardless of the system's configuration, it may employ one or more memories or memory modules configured to store data, program instructions for the general-purpose processing operations and/or the inventive techniques described herein. The program instructions may control the operation of an operating system and/or one or more applications, for example. The memory or memories may also be configured to store web page content, historical user information, extracted terms and counts, weights, categories, click models, mapping models, current user profile information, user-relevant terms, advertisements, advertisement content and terms, new impression target information, booking prices, booking duration, number of impressions for each booking, supply and demand information, etc.
  • Because such information and program instructions may be employed to implement the systems/methods described herein, the present invention relates to machine-readable media that include program instructions, state information, etc. for performing various operations described herein. Examples of machine-readable media include, but are not limited to, magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as floptical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory devices (ROM) and random access memory (RAM). Examples of program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter.
  • Although the foregoing invention has been described in some detail for purposes of clarity of understanding, it will be apparent that certain changes and modifications may be practiced within the scope of the appended claims. Although mappings between terms and user categories and/or demographics have been described, any suitable user activity or characteristic may be mapped to ad-relevant terms. Therefore, the present embodiments are to be considered as illustrative and not restrictive and the invention is not to be limited to the details given herein, but may be modified within the scope and equivalents of the appended claims.

Claims (20)

What is claimed is:
1. A method for facilitating contextual selection of advertisements for displaying online via a computer network, comprising:
receiving a request for an advertisement to be displayed in a current web page that has been requested by a current user, wherein the current user is associated with one or more current user characteristics from a plurality of different user characteristics, wherein the current web page has an associated content;
using a mapping model and the one or more current user characteristics, obtaining a plurality of user-relevant terms for each of the one or more current user characteristics; and
providing a combination of the content of the current web page and obtained user-relevant terms for selecting an advertisement for displaying with the current web page based on such combination.
2. The method as recited in claim 1, wherein the different user characteristics comprise a plurality of different user categories that relate to user interest or expertise in such different user categories and/or a plurality of different user demographics.
3. The method as recited in claim 1, further comprising:
mapping each of the plurality of different user characteristics to a plurality of user-relevant terms that are also relevant for contextual advertisement selection to generate one or more mapping models.
4. The method of claim 3, wherein the mapping is based on collected user activity information.
5. The method of claim 4, wherein the user activity information comprises a plurality of specified activity categories for different activities, a plurality of specified web pages that have been selected by a plurality of users, and a plurality of terms from the specified web pages.
6. The method of claim 5, wherein the mapping comprises learning the mapping model based on the terms from the specified web pages and the specified activity categories.
7. The method of claim 6, wherein the learning comprises using a regression technique and one or more topic models.
8. The method of claim 5, further comprising extracting the terms from the specified web pages that are relevant for advertisement selection.
9. The method of claim 6, wherein the learning comprises maximizing a likelihood function based on the specified web pages and the specified activity categories.
10. An apparatus comprising at least a processor and a memory, wherein the processor and/or memory are configured to perform the following operations:
receiving a request for an advertisement to be displayed in a current web page that has been requested by a current user, wherein the current user is associated with one or more current user characteristics from a plurality of different user characteristics, wherein the current web page has an associated content;
using a mapping model and the one or more current user characteristics, obtaining a plurality of user-relevant terms for each of the one or more current user characteristics; and
providing a combination of the content of the current web page and obtained user-relevant terms for selecting an advertisement for displaying with the current web page based on such combination.
11. The apparatus as recited in claim 10, wherein the different user characteristics comprise a plurality of different user categories that relate to user interest or expertise in such different user categories and/or a plurality of different user demographics.
12. The apparatus as recited in claim 10, wherein the processor and/or memory are further configured to perform the following operation:
mapping each of the plurality of different user characteristics to a plurality of user-relevant terms that are also relevant for contextual advertisement selection to generate one or more mapping models, wherein the mapping is based on collected user activity information.
13. The apparatus of claim 12, wherein the user activity information comprises a plurality of specified activity categories for different activities, a plurality of specified web pages that have been selected by a plurality of users, and a plurality of terms from the specified web pages and wherein the mapping comprises learning the mapping model based on the terms from the specified web pages and the specified activity categories.
14. The apparatus of claim 13, wherein the learning comprises maximizing a likelihood function based on the specified web pages and the specified activity categories.
15. At least one computer readable storage medium having computer program instructions stored thereon that are arranged to perform the following operations:
receiving a request for an advertisement to be displayed in a current web page that has been requested by a current user, wherein the current user is associated with one or more current user characteristics from a plurality of different user characteristics, wherein the current web page has an associated content;
using a mapping model and the one or more current user characteristics, obtaining a plurality of user-relevant terms for each of the one or more current user characteristics; and
providing a combination of the content of the current web page and obtained user-relevant terms for selecting an advertisement for displaying with the current web page based on such combination.
16. The at least one computer readable storage medium as recited in claim 15, wherein the different user characteristics comprise a plurality of different user categories that relate to user interest or expertise in such different user categories and/or a plurality of different user demographics.
17. The at least one computer readable storage medium as recited in claim 16, wherein the computer program instructions stored thereon that are further arranged to perform the following operation:
mapping each of the plurality of different user characteristics to a plurality of user-relevant terms that are also relevant for contextual advertisement selection to generate one or more mapping models, wherein the mapping is based on collected user activity information.
18. The at least one computer readable storage medium of claim 17, wherein the user activity information comprises a plurality of specified activity categories for different activities, a plurality of specified web pages that have been selected by a plurality of users, and a plurality of terms from the specified web pages and wherein the mapping comprises learning the mapping model based on the terms from the specified web pages and the specified activity categories.
19. The at least one computer readable storage medium of claim 18, wherein the learning comprises maximizing a likelihood function based on the specified web pages and the specified activity categories.
20. The at least one computer readable storage medium of claim 19, wherein the computer program instructions stored thereon that are further arranged to perform the following operation:
extracting the terms from the specified web pages that are relevant for advertisement selection.
US12/806,802 2010-08-19 2010-08-19 Contextual advertising with user features Active 2031-07-21 US9031863B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US12/806,802 US9031863B2 (en) 2010-08-19 2010-08-19 Contextual advertising with user features
PCT/US2011/045386 WO2012024066A2 (en) 2010-08-19 2011-07-26 Contextual advertising with user features
TW100128320A TWI526962B (en) 2010-08-19 2011-08-09 Contextual advertising with user features for providing user-relevant terms for selecting an advertisement for method, apparatus and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/806,802 US9031863B2 (en) 2010-08-19 2010-08-19 Contextual advertising with user features

Publications (2)

Publication Number Publication Date
US20120047020A1 true US20120047020A1 (en) 2012-02-23
US9031863B2 US9031863B2 (en) 2015-05-12

Family

ID=45594814

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/806,802 Active 2031-07-21 US9031863B2 (en) 2010-08-19 2010-08-19 Contextual advertising with user features

Country Status (3)

Country Link
US (1) US9031863B2 (en)
TW (1) TWI526962B (en)
WO (1) WO2012024066A2 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150278376A1 (en) * 2014-04-01 2015-10-01 Baidu (China) Co., Ltd. Method and apparatus for presenting search result
CN106575407A (en) * 2014-07-08 2017-04-19 埃克斯凯利博Ip有限责任公司 Browsing context based advertisement selection
TWI587179B (en) * 2016-05-20 2017-06-11 zheng-hong Lin Associated ad input method
US9842353B1 (en) 2013-12-17 2017-12-12 American Megatrends, Inc. Techniques of claiming all available timeslots in media content management and deployment system
US9858598B1 (en) 2013-10-23 2018-01-02 American Megatrends, Inc. Media content management and deployment system
US9886697B1 (en) 2013-12-12 2018-02-06 American Megatrends, Inc. Systems and methods for distributing segmented media content to signage devices in private networks
US10740774B2 (en) 2015-07-15 2020-08-11 The Nielsen Company (Us), Llc Reducing processing requirements to correct for bias in ratings data having interdependencies among demographic statistics
US20210294712A1 (en) * 2017-07-28 2021-09-23 Groupon, Inc. System and apparatus for automated evaluation of compatibility of data structures and user devices based on explicit user feedback
US11348143B2 (en) * 2019-06-27 2022-05-31 Capital One Services, Llc Dynamic selection of advertisements using deep learning models on client devices

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9396179B2 (en) * 2012-08-30 2016-07-19 Xerox Corporation Methods and systems for acquiring user related information using natural language processing techniques
US9626692B2 (en) 2012-10-08 2017-04-18 Facebook, Inc. On-line advertising with social pay
CN107943825A (en) * 2017-10-19 2018-04-20 阿里巴巴集团控股有限公司 Data processing method, device and the electronic equipment of page access

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5848396A (en) * 1996-04-26 1998-12-08 Freedom Of Information, Inc. Method and apparatus for determining behavioral profile of a computer user
US6182097B1 (en) * 1998-05-21 2001-01-30 Lucent Technologies Inc. Method for characterizing and visualizing patterns of usage of a web site by network users
US6757661B1 (en) * 2000-04-07 2004-06-29 Netzero High volume targeting of advertisements to user of online service
US6778807B1 (en) * 2000-09-15 2004-08-17 Documus, Llc Method and apparatus for market research using education courses and related information
US7047242B1 (en) * 1999-03-31 2006-05-16 Verizon Laboratories Inc. Weighted term ranking for on-line query tool
US20070078822A1 (en) * 2005-09-30 2007-04-05 Microsoft Corporation Arbitration of specialized content using search results
US20080243821A1 (en) * 2007-03-28 2008-10-02 Yahoo! Inc. System for providing geographically relevant content to a search query with local intent
US7577665B2 (en) * 2005-09-14 2009-08-18 Jumptap, Inc. User characteristic influenced search results

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10510043B2 (en) 2005-06-13 2019-12-17 Skyword Inc. Computer method and apparatus for targeting advertising
US7734632B2 (en) 2005-10-28 2010-06-08 Disney Enterprises, Inc. System and method for targeted ad delivery
JP2007164710A (en) 2005-12-16 2007-06-28 Bb Mobile Corp Banner distribution system and banner distribution method
JP2007286833A (en) 2006-04-14 2007-11-01 Nippon Telegr & Teleph Corp <Ntt> Advertisement distribution system and advertisement distribution program
US7680786B2 (en) 2006-10-30 2010-03-16 Yahoo! Inc. Optimization of targeted advertisements based on user profile information
US9710817B2 (en) 2008-09-30 2017-07-18 Microsoft Technology Licensing, Llc Adaptive run-time advertisements

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5848396A (en) * 1996-04-26 1998-12-08 Freedom Of Information, Inc. Method and apparatus for determining behavioral profile of a computer user
US6182097B1 (en) * 1998-05-21 2001-01-30 Lucent Technologies Inc. Method for characterizing and visualizing patterns of usage of a web site by network users
US7047242B1 (en) * 1999-03-31 2006-05-16 Verizon Laboratories Inc. Weighted term ranking for on-line query tool
US6757661B1 (en) * 2000-04-07 2004-06-29 Netzero High volume targeting of advertisements to user of online service
US6778807B1 (en) * 2000-09-15 2004-08-17 Documus, Llc Method and apparatus for market research using education courses and related information
US7577665B2 (en) * 2005-09-14 2009-08-18 Jumptap, Inc. User characteristic influenced search results
US20070078822A1 (en) * 2005-09-30 2007-04-05 Microsoft Corporation Arbitration of specialized content using search results
US20080243821A1 (en) * 2007-03-28 2008-10-02 Yahoo! Inc. System for providing geographically relevant content to a search query with local intent

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Mimno et al., "Topic Models Conditioned on Arbitrary Features with Dirichlet-multinomial Regression", Conference of the Association for Uncertainty in Artificial Intelligence (UAI) 2008, Helsinki, Finland *
Tsurumi, "Likelihood", lecture for Econometrics Section 2 course (Econ. 322), Rutgers, The State University of New Jersey, Fall 2005, pp. 1-5. Found on line at econweb.rutgers.edu/tsurumi *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9858598B1 (en) 2013-10-23 2018-01-02 American Megatrends, Inc. Media content management and deployment system
US9886697B1 (en) 2013-12-12 2018-02-06 American Megatrends, Inc. Systems and methods for distributing segmented media content to signage devices in private networks
US9842353B1 (en) 2013-12-17 2017-12-12 American Megatrends, Inc. Techniques of claiming all available timeslots in media content management and deployment system
US9916386B2 (en) * 2014-04-01 2018-03-13 Baidu (China) Co., Ltd. Method and apparatus for presenting search result
US20150278376A1 (en) * 2014-04-01 2015-10-01 Baidu (China) Co., Ltd. Method and apparatus for presenting search result
EP3146486A4 (en) * 2014-07-08 2017-11-15 Excalibur IP, LLC Browsing context based advertisement selection
CN106575407A (en) * 2014-07-08 2017-04-19 埃克斯凯利博Ip有限责任公司 Browsing context based advertisement selection
US10740774B2 (en) 2015-07-15 2020-08-11 The Nielsen Company (Us), Llc Reducing processing requirements to correct for bias in ratings data having interdependencies among demographic statistics
US11645665B2 (en) 2015-07-15 2023-05-09 The Nielsen Company (Us), Llc Reducing processing requirements to correct for bias in ratings data having interdependencies among demographic statistics
TWI587179B (en) * 2016-05-20 2017-06-11 zheng-hong Lin Associated ad input method
US20210294712A1 (en) * 2017-07-28 2021-09-23 Groupon, Inc. System and apparatus for automated evaluation of compatibility of data structures and user devices based on explicit user feedback
US11669424B2 (en) * 2017-07-28 2023-06-06 Groupon, Inc. System and apparatus for automated evaluation of compatibility of data structures and user devices based on explicit user feedback
US11348143B2 (en) * 2019-06-27 2022-05-31 Capital One Services, Llc Dynamic selection of advertisements using deep learning models on client devices

Also Published As

Publication number Publication date
WO2012024066A4 (en) 2012-07-12
TW201229941A (en) 2012-07-16
WO2012024066A2 (en) 2012-02-23
WO2012024066A3 (en) 2012-05-24
US9031863B2 (en) 2015-05-12
TWI526962B (en) 2016-03-21

Similar Documents

Publication Publication Date Title
US9031863B2 (en) Contextual advertising with user features
Ghose et al. Toward a digital attribution model
US8533043B2 (en) Clickable terms for contextual advertising
US8346607B1 (en) Automatic adjustment of advertiser bids to equalize cost-per-conversion among publishers for an advertisement
US8583482B2 (en) Automated monitoring and verification of internet based advertising
US10037543B2 (en) Estimating conversion rate in display advertising from past performance data
US10134053B2 (en) User engagement-based contextually-dependent automated pricing for non-guaranteed delivery
TWI419068B (en) Computer readable media,method and system for displaying correlated advertisements to internet users
US8538809B2 (en) Estimating on-line advertising inventory value based on contract eligibility information
US8645205B2 (en) System for optimizing ad performance at campaign running time
US20100257022A1 (en) Finding Similar Campaigns for Internet Advertisement Targeting
US20150006286A1 (en) Targeting users based on categorical content interactions
US20100262456A1 (en) System and Method for Deep Targeting Advertisement Based on Social Behaviors
US20150006294A1 (en) Targeting rules based on previous recommendations
US20150006295A1 (en) Targeting users based on previous advertising campaigns
US20120059713A1 (en) Matching Advertisers and Users Based on Their Respective Intents
US20110196733A1 (en) Optimizing Advertisement Selection in Contextual Advertising Systems
US20110264522A1 (en) Direct targeting of advertisements to social connections in a social network environment
US20110093331A1 (en) Term Weighting for Contextual Advertising
US20110264519A1 (en) Social behavioral targeting of advertisements in a social networking environment
US20110166942A1 (en) Contract auctions for sponsored search
JP5882454B2 (en) Identify languages that are missing from the campaign
US20100217668A1 (en) Optimizing Delivery of Online Advertisements
US10217132B1 (en) Content evaluation based on users browsing history
US10417286B1 (en) Content Selection

Legal Events

Date Code Title Description
AS Assignment

Owner name: YAHOO! INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BAGHERJEIRAN, ABRAHAM H.;HATCH, ANDREW O.;RATNAPARKHI, ADWAIT;AND OTHERS;SIGNING DATES FROM 20100816 TO 20100818;REEL/FRAME:024956/0830

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: EXCALIBUR IP, LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO! INC.;REEL/FRAME:038383/0466

Effective date: 20160418

AS Assignment

Owner name: YAHOO! INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EXCALIBUR IP, LLC;REEL/FRAME:038951/0295

Effective date: 20160531

AS Assignment

Owner name: EXCALIBUR IP, LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO! INC.;REEL/FRAME:038950/0592

Effective date: 20160531

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

AS Assignment

Owner name: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT, NEW YORK

Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:ACACIA RESEARCH GROUP LLC;AMERICAN VEHICULAR SCIENCES LLC;BONUTTI SKELETAL INNOVATIONS LLC;AND OTHERS;REEL/FRAME:052853/0153

Effective date: 20200604

AS Assignment

Owner name: R2 SOLUTIONS LLC, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EXCALIBUR IP, LLC;REEL/FRAME:053459/0059

Effective date: 20200428

AS Assignment

Owner name: SAINT LAWRENCE COMMUNICATIONS LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: STINGRAY IP SOLUTIONS LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: BONUTTI SKELETAL INNOVATIONS LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: ACACIA RESEARCH GROUP LLC, NEW YORK

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: AMERICAN VEHICULAR SCIENCES LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: SUPER INTERCONNECT TECHNOLOGIES LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: LIMESTONE MEMORY SYSTEMS LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: UNIFICATION TECHNOLOGIES LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: INNOVATIVE DISPLAY TECHNOLOGIES LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: PARTHENON UNIFIED MEMORY ARCHITECTURE LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: R2 SOLUTIONS LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: MONARCH NETWORKING SOLUTIONS LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: CELLULAR COMMUNICATIONS EQUIPMENT LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: TELECONFERENCE SYSTEMS LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: MOBILE ENHANCEMENT SOLUTIONS LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: NEXUS DISPLAY TECHNOLOGIES LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

Owner name: LIFEPORT SCIENCES LLC, TEXAS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:053654/0254

Effective date: 20200630

AS Assignment

Owner name: R2 SOLUTIONS LLC, TEXAS

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 053654 FRAME 0254. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST GRANTED PURSUANT TO THE PATENT SECURITY AGREEMENT PREVIOUSLY RECORDED;ASSIGNOR:STARBOARD VALUE INTERMEDIATE FUND LP;REEL/FRAME:054981/0377

Effective date: 20200630

AS Assignment

Owner name: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT, NEW YORK

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNOR NAME PREVIOUSLY RECORDED AT REEL: 052853 FRAME: 0153. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:R2 SOLUTIONS LLC;REEL/FRAME:056832/0001

Effective date: 20200604

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8