WO2007104487A1 - Context enriched communication system and method - Google Patents

Context enriched communication system and method Download PDF

Info

Publication number
WO2007104487A1
WO2007104487A1 PCT/EP2007/002070 EP2007002070W WO2007104487A1 WO 2007104487 A1 WO2007104487 A1 WO 2007104487A1 EP 2007002070 W EP2007002070 W EP 2007002070W WO 2007104487 A1 WO2007104487 A1 WO 2007104487A1
Authority
WO
WIPO (PCT)
Prior art keywords
context
user
communication
communication system
information
Prior art date
Application number
PCT/EP2007/002070
Other languages
French (fr)
Inventor
Toon Coppens
Bart Karel Hemmeryckx-Deleersnijder
Hans De Mondt
Geert Arthur Edith Van Wonterghem
Original Assignee
Alcatel Lucent
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alcatel Lucent filed Critical Alcatel Lucent
Publication of WO2007104487A1 publication Critical patent/WO2007104487A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1083In-session procedures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1101Session protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/52Network services specially adapted for the location of the user terminal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/2866Architectures; Arrangements
    • H04L67/30Profiles
    • H04L67/306User profiles

Definitions

  • the present invention generally relates to enriching communication sessions with contextual information, for example information related to the location, time zone or calendar of a person participating to the communication session, live or non- live content such as video streams, pictures, text documents, presentations, drawings, audio fragments, multimedia content, passed activities, etc. that a person participating to the communication session desires to share with the other participants during the communication session.
  • contextual information for example information related to the location, time zone or calendar of a person participating to the communication session, live or non- live content such as video streams, pictures, text documents, presentations, drawings, audio fragments, multimedia content, passed activities, etc. that a person participating to the communication session desires to share with the other participants during the communication session.
  • communication session must be interpreted broadly to cover any voice-, video-, text-, etc. based conversation or conference between two or more persons.
  • Examples of communication sessions are fixed or mobile telephone calls, telephone conferences, video conferences, chat sessions, virtual meetings, etc., typically through end-user devices or terminals like telephone sets, IP phones, cellular or mobile phones, TV sets, set-top boxes (STBs), personal computers (PCs), etc. that connect over a communication network via a communication server.
  • end-user devices or terminals like telephone sets, IP phones, cellular or mobile phones, TV sets, set-top boxes (STBs), personal computers (PCs), etc. that connect over a communication network via a communication server.
  • This conferencing application enables users of MS Windows based PCs to set-up multi-point text conferences (real-time text chatting), as well as point-to-point audio en video communication sessions. Netmeeting supports white boarding functionalities, as well as transfer of files, slides, media, etc. during the communication session.
  • Another audio- and videoconferencing solution with context sharing facilities is the SunForum software suite. It has a file transfer utility enabling users to transfer files to other conference participants, a shared whiteboard utility enabling users to share a whiteboard with other PC users running a whiteboard application, a clipboard utility to cut and paste context information from and to the whiteboard, and a chat utility enabling instant text messaging between conference participants. More details on the SunForum software suite can be found in the datasheet downloadable from the Internet via the following URL: http://www.sun.com/desktop/products/software/sunforum/datasheet.pdf
  • Apple's iChat AV videoconferencing application advertised at: http://www.apple.com/macosx/features/ichat/ iCHAT AV enables multi-user audio and video conferencing. It is possible with this application to setup an own personalized composition of the screen (graphical representation or skin) but there is no or only very limited (accidental) context information provided, e.g. only background noise indicative for the location of the user but no content is available to the other party.
  • a communication system comprising a communication network for interconnecting a plurality of users and a communication server for establishing a communication session between at least a first user and a second user, the communication system further comprising: a. a context vault for maintaining context information and/or context locators in relation to one or more users; and b. a community context manager for maintaining access rights in relation to the context information; and c. the communication server being adapted to retrieve context information and/or context locators in relation to the first user from the context vault and to provide the context information or parts thereof during the communication session to the second user in accordance with the access rights, and vice versa for provisioning context information and/or context locators relating to the second user.
  • a context vault for maintaining context information and/or context locators in relation to one or more users
  • a community context manager for maintaining access rights in relation to the context information
  • the communication server being adapted to retrieve context information and/or context locators in relation to the first user from the context vault and to provide the context information or parts thereof during the communication
  • the basic idea according to the current invention is to provide users involved in a communication session automatic access to context information and/or context locators related to the other user(s) involved in this communication session depending on the access rights granted by the other user(s) in the communication session.
  • the context information and/or context locators corresponding to the other user(s) is/are maintained in a central or distributed, dedicated media vault, whilst the access rights granted to other user(s) are maintained and checked in a central or distributed, dedicated community context manager.
  • the context vault is a central or distributed database that contains media content and/or context collectors such as a URL or locator pointing to a context device such as a webcam, a calendar application, a whether station, a locator (GPS), a blog, sensors, sensor managers and interpreters, etc. that stores or produces the context information.
  • the context vault can be a separate network element, located somewhere in the network where it is easily accessible to other network elements, in particular to the communication server. Also the community context manager needs to be reachable for the other network elements.
  • the access rights are predefined therein, i.e. prior to establishing the communication session. The access right definition can for instance be realized through profiling.
  • the current invention further relates to a context vault for use in the above communication system, as defined by claim 7, a community context manager for use in the above communication system, as defined by claim 8, a communication server for use in the above communication system, as defined by claim 9, and a context enriched communication method as defined by claim 14.
  • the context vault might be a location context vault for maintaining location context information and/or location context information locators in relation to locations, e. the community context manager might be a location context manager adapted to determine the location of a user; and further that: f. the communication server might be adapted to retrieve location context information in relation to the location of the first user from the location context vault and provide the location context information or parts thereof during the communication session to the second user, and vice versa.
  • the context vault might be a location context vault for maintaining location context information and/or location context information locators in relation to locations
  • the community context manager might be a location context manager adapted to determine the location of a user
  • the communication server might be adapted to retrieve location context information in relation to the location of the first user from the location context vault and provide the location context information or parts thereof during the communication session to the second user, and vice versa. This option is defined by claim 2.
  • This optional feature is in particular advantageous for communication sessions between a fixed user with a terminal that supports graphical representation (e.g. a TV- or PC-screen used in a video conference or IPTV application) and a mobile user.
  • graphical representation e.g. a TV- or PC-screen used in a video conference or IPTV application
  • prior art solutions share only limited information with respect to the mobile user, like for instance the name and phone number.
  • the fixed user involved for instance in a video conference session with a mobile phone user can be provided with location based, live or non-live, context information that is inserted in the TV/PC-to-mobile phone call.
  • the location context information may for example be streaming video provided by one or several webcams in close vicinity to the mobile user, local news, near relatives or friends, close by events (e.g. festivals), etc.
  • the current invention further relates to a communication server for use in the above communication system, as defined by claim 9, a location context vault for use in the above communication system, as defined by claim 10, and a location context manager for use in the above communication system, as defined by claim 11.
  • a context skin vault for maintaining a plurality of context skins, a context skin being a set of rules for graphical representation of context information
  • a context composition engine for composing during the communication session the context information in relation to the first user in accordance with a context skin selected by the second user, and vice versa for context information related to the second user. This option is specified in claim 3.
  • an additional advantage of the current invention is that the video or context information stream of the other party in the communication session, eventually coming from different context sources like media servers, webcams, etc., can be presented graphically on the basis of a selectable graphical skin.
  • the current invention overcomes the lack of attraction of existing video chat applications that typically have an unchanging screen composition over time by supporting format triggered context composition and presentation. The option is particularly useful in video call, video chat or video conference sessions.
  • the current invention further relates to a context skin vault for use in the above communication system, as defined by claim 12, and a context composition engine for use in the above communication system, as defined by claim 13.
  • a context skin vault for use in the above communication system, as defined by claim 12
  • a context composition engine for use in the above communication system, as defined by claim 13.
  • An optional implementation choice, defined by claim 4, is that the context composition engine might be integrated in the communication server.
  • composition engine is typically a software application, responsible for the final composition of the graphical image or representation of the context information. Since the final image might be composed from information received from various sources, the composition engine must be located somewhere in the network.
  • the context information may comprises one or more of the following:
  • a communication session in the context of the current invention may correspond to one of the following: - a voice communication session between fixed and/or mobile phone users;
  • Fig. 1 illustrates a first embodiment of the context enriched communication system and method according to the present invention
  • Fig. 2 illustrates a second embodiment of the context enriched communication system and method according to the present invention, wherein the context information is location related information coming from webcams in the vicinity of a mobile user that participates to a communication session; and
  • Fig. 3 illustrates a third embodiment of the context enriched communication system and method according to the present invention, wherein a context skin vault and composition engine are used to enable format controlled presentation of video streams in video chats or video conference calls.
  • Fig. 1 shows a system wherein a first user 101 equipped with a TV set and set- top box establishes a video chat session with a second user 102 through a communication server 103.
  • the network in Fig. 1 further includes a context vault 104 and a community context manager 105 that will enrich the video chat session with context information, such that for instance the first user 101 can browse on his/her TV through context information that has been set accessible by the second user 102 and vice versa.
  • the first user 101 and second user 102 are given the possibility to browse through the other ones context, depending on the access rights that have been granted by the context owner. These access rights are defined upfront through profiles, stored and managed by the community context manager 105.
  • Fig. 1 further illustrates the scenario followed to enrich the video chat session between the first user 101 and second user 102 with context information kept in the context vault 104.
  • a communication session is requested by the first user 101 and the request is handled by the communication server 103.
  • the communication server 103 polls the availability of the second user 102 in step 112 and if successful will connect both peers.
  • the video chat session is setup between the two users 101 and 102 in step 113.
  • the communication server 103 now verifies with the community context manager 105 which context information associated with the second user 102 can be made available to the first user 101 , depending on the rights that the second user 102 has granted to the first user 101.
  • the communication server 103 checks with the community context manager 105 what context information related to the first user 101 can be made available to the second user 102 according to the access right pre-defined by the first user 101 in the community context manager 105. This verification process is referenced by 114 in Fig. 1.
  • the list of context information that can be accessed by the first user 101 is then made available to the preferred terminal of the first user 101 in step 115.
  • the preferred terminal e.g. a PC
  • the communication terminal e.g. the TV set with set-top box.
  • the second user 102 gets a list of context information related to the first user 101 that can be accessed during the video chat session.
  • the first user 101 can browse through the list of available context information associated with the second user 102 and select a category or item to be shown, for instance a particular collection of holiday pictures of the second user 102.
  • This request is sent to the community context manager 105, as is indicated by the arrow 116 in Fig. 1.
  • the community context manager 105 maps the request to the right context item inside the context vault 104 and requests the context vault 104 to send the item to the first user 101.
  • This request is referenced by 117 in Fig. 1.
  • the context vault 104 provides the requested context item to the preferred terminal (e.g. the PC) of the first user 101 in step 118 such that the first user 101 can watch the holiday pictures of the second user 102 on his PC monitor while both users are having a video chat session through their respective TV sets and set-top boxes.
  • step 116 i.e. the selection of a context item
  • step 117 i.e. the mapping of the selection to a context item in the context vault and instructing of the context vault
  • step 118 i.e. the delivery of the selected context item
  • the second user 102 who desires to access certain context information associated with the first user 101 during the video chat session.
  • Fig. 2 shows a second instantiation of the system according to the present invention wherein a first, fixed user 201 establishes a video conference session with a second, mobile phone user 202 through a communication server 203.
  • the video conference session is enriched with location based live content information that is inserted in the mixed TV/PC-to-mobile (or mobile PC) call by the webcam vault 204 and the location context manager 205 that provide the fixed user 201 with location information on the location of the mobile user 202.
  • the fixed user 201 thus retrieves context information of the mobile user 202 which is location information.
  • the context information in the example of Fig. 2 may be streaming video provided by one or more web-cams in the close vicinity of the mobile user 202.
  • the fixed user 201 can browse on his TV or on another, preferred terminal through a list of webcams available in the mobile user's environment. Thereupon, one or more webcams will be displayed on the TV- or PC-monitor of the fixed user 201.
  • the location based live content makes the communication session between the fixed user 201 and mobile user 202 more interesting, relevant and attractive.
  • Fig. 2 illustrates the sequence of steps in the fixed-to-mobile scenario enriched with location based context information.
  • a first step 211 the communication session is requested by the fixed user 201 and the request is handled by the communication server 203.
  • the communication server 203 polls the availability of the mobile user 202 in step 212. It is assumed that the second user 202 only happens to have his mobile handset. Both peers are connected and the communication session is setup between the two users 201 and 202 in step 213.
  • the communication server 203 now verifies with the location context manager 205 where the mobile user 202 is located and which live content sources are available in his/her neighbourhood. This is indicated by arrow 214 in Fig. 2.
  • the location context manager 205 is able to determine the location of the mobile user 202 for instance from a GPS (Global Positioning System) like system, from triangulation via GSM or another cellular system or may have obtained the information from manual insertions, etc.
  • the location context manager 205 maps the location of the second user 202 to certain content.
  • the list of live location context sources in the neighbourhood of the second user 202 is made available to the TV terminal of the first user 201 in step 215.
  • the first user 201 can then browse through the list of available live context sources and select one or more sources. The selection is communicated to the location context manager 205 in step 216.
  • the webcam closest to the mobile user 202 might be selected automatically.
  • the location context manager 205 maps the received request to the right live content source(s) and requests the webcam vault 204 to send the selected stream(s) to the first user 201. At last, the webcam vault 204 provides the requested live content item(s) to the TV or preferred terminal of the first user 201. This is indicated by reference 218 in Fig. 2.
  • Fig. 3 illustrates a third embodiment of the current invention wherein graphically and contextually enriched video calls are made between a first user 301 and a second user 302.
  • the system depicted in Fig. 3 contains a context skin vault 306 and a context composition engine 307.
  • the latter two network elements assist in presenting the video stream of the other party in the call or chat based on a selectable, graphical skin.
  • the system of Fig. 3 provides people participating in a video call the possibility to select a graphical skin in which the other party's webcam stream and context information are combined in a graphical rich way on TV using for instance composition techniques like blue screen filtering, picture in picture, etc.
  • the graphical skin triggers the community context manager 305 for the needed context type and the communication server 303 triggers the community context manager 305 for the accessible contexts, which are then combined with the communication streams via rules imposed via the graphical skin.
  • a context skin is a set of rules for graphical representation of context information, eventually including changing graphical layouts over time.
  • a full screen webcam vision will be provided initially, followed by a picture-in-picture screen showing content in the background and the webcam vision as a foreground picture-in-picture, followed by an image of a reporter on site with space for location inputs of the other party, his content, the time zones, etc.
  • Fig. 3 shows the sequence of steps followed to establish a graphical and context enriched video chat session between the first user 301 and the second user 302.
  • a communication session is requested by the first user 301 and the request is handled by the communication server 303.
  • the communication server 303 polls the availability of the second user 302 in step 312 and, if successful, connects both peers.
  • the video communication session is setup. This is represented by reference 313 in Fig. 3 indicating that the second user 302 starts to receive video streams from the composition engine 307.
  • the first user 301 now selects a skin amongst the graphical skins that are available in the context skin vault 306. This is indicated by 314 in Fig. 3.
  • the selected skin is provided to the composition engine 307 by the context skin vault 306.
  • the selected skin is loaded in the composition engine 307 and depending on the time and the required context type (e.g. the "News" skin given as an example here above requires at time T a background picture), the right context type is requested to the community context manager 305.
  • This step is referenced by 316 in Fig. 3.
  • the communication server 303 verifies with the community context manager 305 which context information associated with the second user 302 can be made available to the first user 301 , depending on the access rights that the second user 302 has granted to the first user 301.
  • the communication server 303 verifies which context information relating to the first user 301 can be made accessible to the second user 302 during the video communication session.
  • the context type requirement triggered by the graphical skin (step 316), and the accessible context information selection of the second user 302 (step 317) are then combined and a selection of suitable context items is requested to be sent from the context vault 304 to the first user 301 by the community context manager 305.
  • This request is labelled 318 in Fig. 3.
  • the requested context item(s) is/are provided to the composition engine 307 in step 319.
  • the composition engine 307 combines the graphical layout of the selected skin (received in step 315) at time T with the inputs for the video communication session (received in step 313) and the inputs of the context vault 306 (received in step 319) to provide a complete graphical enriched composition, which is shown on a terminal of the first user 301.
  • the provisioning of the graphical enriched composition is indicated by arrow 320 in Fig. 3.
  • Step 316, step 317, step 318, step 319 and step 320 are repeated during the execution of the skin until the video communication session is ended.
  • the invention is not restricted to certain implementation choices made in relation to the described embodiments.
  • the means used to determine the location of a user in a fixed to mobile or mobile-to-mobile communication session are only given as examples. It will be understood by the skilled person that the nature of the means to locate the mobile user are not essential to the invention, so any variant technology could replace the above examples.

Abstract

A communication system according to the current invention contains a context vault (104) and context community manager (105) for enriching a communication session between a first user (101 ) and second user (102) with context information. The context vault (104) maintains context information, e.g. location or agenda information, and/or context information locators in relation to users. The community context manager (105) maintains access rights in relation to the context information. During the communication session between the first user (101) and a second user (102), the communication server (103) retrieves context information in relation to the first user (101) from the context vault (104) and provides that context information or parts thereof to the second user (102) in accordance with the access rights kept in the community context manager (105), and vice versa.

Description

CONTEXT ENRICHED COMMUNICATION SYSTEM AND METHOD
Field of the Invention
The present invention generally relates to enriching communication sessions with contextual information, for example information related to the location, time zone or calendar of a person participating to the communication session, live or non- live content such as video streams, pictures, text documents, presentations, drawings, audio fragments, multimedia content, passed activities, etc. that a person participating to the communication session desires to share with the other participants during the communication session. In the context of the patent application, communication session must be interpreted broadly to cover any voice-, video-, text-, etc. based conversation or conference between two or more persons. Examples of communication sessions are fixed or mobile telephone calls, telephone conferences, video conferences, chat sessions, virtual meetings, etc., typically through end-user devices or terminals like telephone sets, IP phones, cellular or mobile phones, TV sets, set-top boxes (STBs), personal computers (PCs), etc. that connect over a communication network via a communication server.
Background of the Invention
An existing solution that enables enriching communication sessions with context information is Microsoft's Netmeeting application, whose features are described at the following URL: http://www.microsoft.com/windows/netmeeting
This conferencing application enables users of MS Windows based PCs to set-up multi-point text conferences (real-time text chatting), as well as point-to-point audio en video communication sessions. Netmeeting supports white boarding functionalities, as well as transfer of files, slides, media, etc. during the communication session. Another audio- and videoconferencing solution with context sharing facilities is the SunForum software suite. It has a file transfer utility enabling users to transfer files to other conference participants, a shared whiteboard utility enabling users to share a whiteboard with other PC users running a whiteboard application, a clipboard utility to cut and paste context information from and to the whiteboard, and a chat utility enabling instant text messaging between conference participants. More details on the SunForum software suite can be found in the datasheet downloadable from the Internet via the following URL: http://www.sun.com/desktop/products/software/sunforum/datasheet.pdf
The major problem with existing applications like Netmeeting and SunForum is that the transfer of contextual information (contextual information being a limited, fixed list, and not discovered), requires one or more explicit actions or manipulations from the context owner in order to share the context information. Enriching communication sessions with contextual information is not automated, also no automated context discovery is done and there is no association of contextual data with different parties participating to communication sessions.
Another prior art solution is Apple's iChat AV videoconferencing application advertised at: http://www.apple.com/macosx/features/ichat/ iCHAT AV enables multi-user audio and video conferencing. It is possible with this application to setup an own personalized composition of the screen (graphical representation or skin) but there is no or only very limited (accidental) context information provided, e.g. only background noise indicative for the location of the user but no content is available to the other party.
It is an object of the current invention to provide a system and method for communication sessions between two or more users, that overcomes the above highlighted disadvantages of the existing solutions. In particular, it is the objective to enable automated context enriched communication sessions. Summary of the invention
According to the current invention, the above defined objective is realised through a communication system comprising a communication network for interconnecting a plurality of users and a communication server for establishing a communication session between at least a first user and a second user, the communication system further comprising: a. a context vault for maintaining context information and/or context locators in relation to one or more users; and b. a community context manager for maintaining access rights in relation to the context information; and c. the communication server being adapted to retrieve context information and/or context locators in relation to the first user from the context vault and to provide the context information or parts thereof during the communication session to the second user in accordance with the access rights, and vice versa for provisioning context information and/or context locators relating to the second user. This is defined by claim 1.
Thus, the basic idea according to the current invention is to provide users involved in a communication session automatic access to context information and/or context locators related to the other user(s) involved in this communication session depending on the access rights granted by the other user(s) in the communication session. The context information and/or context locators corresponding to the other user(s) is/are maintained in a central or distributed, dedicated media vault, whilst the access rights granted to other user(s) are maintained and checked in a central or distributed, dedicated community context manager. The context vault is a central or distributed database that contains media content and/or context collectors such as a URL or locator pointing to a context device such as a webcam, a calendar application, a whether station, a locator (GPS), a blog, sensors, sensor managers and interpreters, etc. that stores or produces the context information. The context vault can be a separate network element, located somewhere in the network where it is easily accessible to other network elements, in particular to the communication server. Also the community context manager needs to be reachable for the other network elements. The access rights are predefined therein, i.e. prior to establishing the communication session. The access right definition can for instance be realized through profiling.
The current invention further relates to a context vault for use in the above communication system, as defined by claim 7, a community context manager for use in the above communication system, as defined by claim 8, a communication server for use in the above communication system, as defined by claim 9, and a context enriched communication method as defined by claim 14.
An optional feature of the communication system according to the current invention is that: d. the context vault might be a location context vault for maintaining location context information and/or location context information locators in relation to locations, e. the community context manager might be a location context manager adapted to determine the location of a user; and further that: f. the communication server might be adapted to retrieve location context information in relation to the location of the first user from the location context vault and provide the location context information or parts thereof during the communication session to the second user, and vice versa. This option is defined by claim 2.
This optional feature is in particular advantageous for communication sessions between a fixed user with a terminal that supports graphical representation (e.g. a TV- or PC-screen used in a video conference or IPTV application) and a mobile user. During such TV-to-mobile communication sessions, prior art solutions share only limited information with respect to the mobile user, like for instance the name and phone number. Thanks to the current invention, the fixed user involved for instance in a video conference session with a mobile phone user can be provided with location based, live or non-live, context information that is inserted in the TV/PC-to-mobile phone call. The location context information may for example be streaming video provided by one or several webcams in close vicinity to the mobile user, local news, near relatives or friends, close by events (e.g. festivals), etc.
The current invention further relates to a communication server for use in the above communication system, as defined by claim 9, a location context vault for use in the above communication system, as defined by claim 10, and a location context manager for use in the above communication system, as defined by claim 11.
Another optional feature of the communication system according to the present invention is that it may comprise: g. a context skin vault for maintaining a plurality of context skins, a context skin being a set of rules for graphical representation of context information; and h. a context composition engine for composing during the communication session the context information in relation to the first user in accordance with a context skin selected by the second user, and vice versa for context information related to the second user. This option is specified in claim 3.
Thus, an additional advantage of the current invention is that the video or context information stream of the other party in the communication session, eventually coming from different context sources like media servers, webcams, etc., can be presented graphically on the basis of a selectable graphical skin. This way, the current invention overcomes the lack of attraction of existing video chat applications that typically have an unchanging screen composition over time by supporting format triggered context composition and presentation. The option is particularly useful in video call, video chat or video conference sessions.
The current invention further relates to a context skin vault for use in the above communication system, as defined by claim 12, and a context composition engine for use in the above communication system, as defined by claim 13. An optional implementation choice, defined by claim 4, is that the context composition engine might be integrated in the communication server.
Indeed, the composition engine is typically a software application, responsible for the final composition of the graphical image or representation of the context information. Since the final image might be composed from information received from various sources, the composition engine must be located somewhere in the network.
As indicated by claim 5, the context information may comprises one or more of the following:
- location information;
- calendar information; - electronic programming guide information;
- multimedia content;
- webcam streaming (networked cameras, like home cameras, etc.);
- sensor information.
Obviously, this list is not exhaustive, as will be appreciated by any person skilled in the art of telecommunications.
As indicated by claim 6, a communication session in the context of the current invention may correspond to one of the following: - a voice communication session between fixed and/or mobile phone users;
- a video communication session between fixed and/or mobile phone users;
- a text communication session between fixed and/or mobile phone users; - a chat communication session between fixed and/or mobile phone users.
Again, this list is not exhaustive, as will be appreciated by the skilled person. Brief Description of the Drawings
Fig. 1 illustrates a first embodiment of the context enriched communication system and method according to the present invention;
Fig. 2 illustrates a second embodiment of the context enriched communication system and method according to the present invention, wherein the context information is location related information coming from webcams in the vicinity of a mobile user that participates to a communication session; and Fig. 3 illustrates a third embodiment of the context enriched communication system and method according to the present invention, wherein a context skin vault and composition engine are used to enable format controlled presentation of video streams in video chats or video conference calls.
Detailed Description of Embodiment(s)
Fig. 1 shows a system wherein a first user 101 equipped with a TV set and set- top box establishes a video chat session with a second user 102 through a communication server 103. The network in Fig. 1 further includes a context vault 104 and a community context manager 105 that will enrich the video chat session with context information, such that for instance the first user 101 can browse on his/her TV through context information that has been set accessible by the second user 102 and vice versa. During the video chat communication session, the first user 101 and second user 102 are given the possibility to browse through the other ones context, depending on the access rights that have been granted by the context owner. These access rights are defined upfront through profiles, stored and managed by the community context manager 105. The first user 101 will for instance be able to select vacation photos of the second user 102 and watch them during the video chat session with the second user 102. In the meantime, the second user 102 is for instance able to check the calendar of the first user 101 , but not the photos thereof because these haven't been made available for the second user 102. Fig. 1 further illustrates the scenario followed to enrich the video chat session between the first user 101 and second user 102 with context information kept in the context vault 104. In a first step 111 , a communication session is requested by the first user 101 and the request is handled by the communication server 103.
The communication server 103 polls the availability of the second user 102 in step 112 and if successful will connect both peers. The video chat session is setup between the two users 101 and 102 in step 113. The communication server 103 now verifies with the community context manager 105 which context information associated with the second user 102 can be made available to the first user 101 , depending on the rights that the second user 102 has granted to the first user 101. Vice versa, the communication server 103 checks with the community context manager 105 what context information related to the first user 101 can be made available to the second user 102 according to the access right pre-defined by the first user 101 in the community context manager 105. This verification process is referenced by 114 in Fig. 1. The list of context information that can be accessed by the first user 101 is then made available to the preferred terminal of the first user 101 in step 115. It is noticed that the preferred terminal (e.g. a PC) can be different from the communication terminal (e.g. the TV set with set-top box). Similarly, the second user 102 gets a list of context information related to the first user 101 that can be accessed during the video chat session. The first user 101 can browse through the list of available context information associated with the second user 102 and select a category or item to be shown, for instance a particular collection of holiday pictures of the second user 102. This request is sent to the community context manager 105, as is indicated by the arrow 116 in Fig. 1. The community context manager 105 maps the request to the right context item inside the context vault 104 and requests the context vault 104 to send the item to the first user 101. This request is referenced by 117 in Fig. 1. At last, the context vault 104 provides the requested context item to the preferred terminal (e.g. the PC) of the first user 101 in step 118 such that the first user 101 can watch the holiday pictures of the second user 102 on his PC monitor while both users are having a video chat session through their respective TV sets and set-top boxes. Although not indicated in Fig. 1 , step 116 (i.e. the selection of a context item), step 117 (i.e. the mapping of the selection to a context item in the context vault and instructing of the context vault), and step 118 (i.e. the delivery of the selected context item) are simultaneously carried out for the second user 102 who desires to access certain context information associated with the first user 101 during the video chat session.
Fig. 2 shows a second instantiation of the system according to the present invention wherein a first, fixed user 201 establishes a video conference session with a second, mobile phone user 202 through a communication server 203. The video conference session is enriched with location based live content information that is inserted in the mixed TV/PC-to-mobile (or mobile PC) call by the webcam vault 204 and the location context manager 205 that provide the fixed user 201 with location information on the location of the mobile user 202. The fixed user 201 thus retrieves context information of the mobile user 202 which is location information. The context information in the example of Fig. 2 may be streaming video provided by one or more web-cams in the close vicinity of the mobile user 202. During the TV/video chat session, the fixed user 201 can browse on his TV or on another, preferred terminal through a list of webcams available in the mobile user's environment. Thereupon, one or more webcams will be displayed on the TV- or PC-monitor of the fixed user 201. The location based live content makes the communication session between the fixed user 201 and mobile user 202 more interesting, relevant and attractive.
Fig. 2 illustrates the sequence of steps in the fixed-to-mobile scenario enriched with location based context information. In a first step 211 , the communication session is requested by the fixed user 201 and the request is handled by the communication server 203. The communication server 203 polls the availability of the mobile user 202 in step 212. It is assumed that the second user 202 only happens to have his mobile handset. Both peers are connected and the communication session is setup between the two users 201 and 202 in step 213. The communication server 203 now verifies with the location context manager 205 where the mobile user 202 is located and which live content sources are available in his/her neighbourhood. This is indicated by arrow 214 in Fig. 2. The location context manager 205 is able to determine the location of the mobile user 202 for instance from a GPS (Global Positioning System) like system, from triangulation via GSM or another cellular system or may have obtained the information from manual insertions, etc. The location context manager 205 maps the location of the second user 202 to certain content. The list of live location context sources in the neighbourhood of the second user 202 is made available to the TV terminal of the first user 201 in step 215. The first user 201 can then browse through the list of available live context sources and select one or more sources. The selection is communicated to the location context manager 205 in step 216. Alternatively, the webcam closest to the mobile user 202 might be selected automatically. The location context manager 205 maps the received request to the right live content source(s) and requests the webcam vault 204 to send the selected stream(s) to the first user 201. At last, the webcam vault 204 provides the requested live content item(s) to the TV or preferred terminal of the first user 201. This is indicated by reference 218 in Fig. 2.
Fig. 3 illustrates a third embodiment of the current invention wherein graphically and contextually enriched video calls are made between a first user 301 and a second user 302. In addition to a context vault 304 and community context manager 305, the system depicted in Fig. 3 contains a context skin vault 306 and a context composition engine 307. The latter two network elements assist in presenting the video stream of the other party in the call or chat based on a selectable, graphical skin. Thus, the system of Fig. 3 provides people participating in a video call the possibility to select a graphical skin in which the other party's webcam stream and context information are combined in a graphical rich way on TV using for instance composition techniques like blue screen filtering, picture in picture, etc. The graphical skin triggers the community context manager 305 for the needed context type and the communication server 303 triggers the community context manager 305 for the accessible contexts, which are then combined with the communication streams via rules imposed via the graphical skin.
A context skin is a set of rules for graphical representation of context information, eventually including changing graphical layouts over time. When for instance a user selects a "News" skin, a full screen webcam vision will be provided initially, followed by a picture-in-picture screen showing content in the background and the webcam vision as a foreground picture-in-picture, followed by an image of a reporter on site with space for location inputs of the other party, his content, the time zones, etc.
Fig. 3 shows the sequence of steps followed to establish a graphical and context enriched video chat session between the first user 301 and the second user 302. Firstly, a communication session is requested by the first user 301 and the request is handled by the communication server 303. This is indicated by reference 311 in Fig. 3. The communication server 303 polls the availability of the second user 302 in step 312 and, if successful, connects both peers. The video communication session is setup. This is represented by reference 313 in Fig. 3 indicating that the second user 302 starts to receive video streams from the composition engine 307. The first user 301 now selects a skin amongst the graphical skins that are available in the context skin vault 306. This is indicated by 314 in Fig. 3. In the next step, 315, the selected skin is provided to the composition engine 307 by the context skin vault 306. The selected skin is loaded in the composition engine 307 and depending on the time and the required context type (e.g. the "News" skin given as an example here above requires at time T a background picture), the right context type is requested to the community context manager 305. This step is referenced by 316 in Fig. 3. In step 317, the communication server 303 verifies with the community context manager 305 which context information associated with the second user 302 can be made available to the first user 301 , depending on the access rights that the second user 302 has granted to the first user 301. Vice versa, the communication server 303 verifies which context information relating to the first user 301 can be made accessible to the second user 302 during the video communication session. The context type requirement triggered by the graphical skin (step 316), and the accessible context information selection of the second user 302 (step 317) are then combined and a selection of suitable context items is requested to be sent from the context vault 304 to the first user 301 by the community context manager 305. This request is labelled 318 in Fig. 3. Thereupon, the requested context item(s) is/are provided to the composition engine 307 in step 319. Lastly, the composition engine 307 combines the graphical layout of the selected skin (received in step 315) at time T with the inputs for the video communication session (received in step 313) and the inputs of the context vault 306 (received in step 319) to provide a complete graphical enriched composition, which is shown on a terminal of the first user 301. The provisioning of the graphical enriched composition is indicated by arrow 320 in Fig. 3. Step 316, step 317, step 318, step 319 and step 320 are repeated during the execution of the skin until the video communication session is ended.
Although the present invention has been illustrated by reference to specific embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made within the spirit and scope of the invention. It is therefore contemplated to cover any and all modifications, variations or equivalents that fall within the spirit and scope of the basic underlying principles disclosed and claimed in this patent application. For example, it is noticed that the above scenario's have been depicted for two users whereas the mechanisms for context enriched communication according to the present invention are obviously equally applicable to communication sessions wherein more than 2 users are participating. Further, it is remarked that the context information that is inserted to enrich the communication session can be extended to include non-user related context information like news headlines, world webcam streams, etc. that is offered by a generic context manager to all communicating parties during a communication session. Further, it is noticed that the invention is not restricted to certain implementation choices made in relation to the described embodiments. For instance, the means used to determine the location of a user in a fixed to mobile or mobile-to-mobile communication session (GPS, GSM, ...) are only given as examples. It will be understood by the skilled person that the nature of the means to locate the mobile user are not essential to the invention, so any variant technology could replace the above examples.

Claims

1. A communication system comprising a communication network for interconnecting a plurality of users and a communication server (103; 203; 303) for establishing a communication session between at least a first user (101 ; 201 ;
301) and a second user (102; 202; 302) of said plurality of users,
CHARACTERIZED IN THAT said communication system further comprises: a. a context vault (104; 204; 304) for maintaining context information and/or context locators in relation to one or more of said plurality of users; and b. a community context manager (105; 205; 305) for maintaining access rights in relation to said context information; and further in that: c. said communication server (103; 203; 303) is adapted to retrieve context information in relation to said first user (101 ; 201 ; 301) from said context vault (104; 304) and provide said context information or parts thereof during said communication session to said second user (102; 202; 302) in accordance with said access rights, and vice versa.
2. A communication system according to claim 1 , CHARACTERISED IN THAT said communication system further comprises: d. said context vault is a location context vault (204) for maintaining location context information and/or location context locators in relation to locations; and e. said community context manager is a location context manager (205) further adapted to determine the location of a user; and further in that: f. said communication server (203) is adapted to retrieve location context information in relation to the location of said first user (201) from said location context vault (204) and provide said location context information or parts thereof during said communication session to said second user (202), and vice versa.
3. A communication system according to claim 1 or claim 2, CHARACTERISED IN THAT said communication system further comprises: g. a context skin vault (306) for maintaining a plurality of context skins, a context skin being a set of rules for graphical representation of context information; and h. a context composition engine (307) for composing during said communication session said context information in relation to said first user (301) in accordance with a context skin selected by said second user (302), and vice versa.
4. A communication system according to claim 3,
CHARACTERIZED IN THAT said context composition engine (307) is integrated in said communication server (303).
5. A communication system according to claim 1 ,
CHARACTERIZED IN THAT said context information comprises one or more of the following:
- location information;
- calendar information; - electronic programming guide information;
- multimedia content;
- sensor information.
6. A communication system according to claim 1 , CHARACTERIZED IN THAT said communication session corresponds to one of the following:
- a voice communication session between fixed and/or mobile phone users;
- a video communication session between fixed and/or mobile phone users;
- a text communication session between fixed and/or mobile phone users;
- a chat communication session between fixed and/or mobile phone users.
7. A context vault (104; 304) for use in the communication system of claim 1.
8. A community context manager (105; 305) for use in the communication system of claim 1.
9. A communication server (103; 203; 303) for use in the communication system of claim 1 or claim 2.
10. A location context vault (204) for use in the communication system of claim 2.
11. A location context manager (205) for use in the communication system of claim 2.
12. A context skin vault (306) for use in the communication system of claim 3.
13. A context composition engine (307) for use in the communication system of claim 3.
14. A communication method in a communication network having a plurality of users, said communication method comprising establishing a communication session between at least a first user (101 ; 201 ; 301) and a second user (102; 202; 302) through a communication server (103; 203; 303),
CHARACTERIZED IN THAT said communication method further comprises: a. retrieving context information related to said first user (101 ; 201 ; 301) through a context vault (104; 204; 304) that maintains context information and/or context information locators related to one or more of said plurality of users; and b. retrieving access rights to said context information related to said first user (101 ; 201 ; 301) from a context community manager (105; 305) that maintains access rights in relation to said context information related to one or more of said plurality of users; and c. providing said context information related to said first user (101 ; 201 ; 301) or parts thereof during said communication session to said second user (102; 202; 302) in accordance with said access rights; and vice versa.
PCT/EP2007/002070 2006-03-13 2007-03-02 Context enriched communication system and method WO2007104487A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP06290408.1A EP1835689B1 (en) 2006-03-13 2006-03-13 Context enriched communication system and method
EP06290408.1 2006-03-13

Publications (1)

Publication Number Publication Date
WO2007104487A1 true WO2007104487A1 (en) 2007-09-20

Family

ID=36645710

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2007/002070 WO2007104487A1 (en) 2006-03-13 2007-03-02 Context enriched communication system and method

Country Status (4)

Country Link
US (1) US20070214238A1 (en)
EP (1) EP1835689B1 (en)
CN (1) CN100550754C (en)
WO (1) WO2007104487A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2400751A1 (en) * 2010-06-03 2011-12-28 France Telecom Method for establishing communication between users of audiovisual devices automatically identified as members of a same community
US8489132B2 (en) 2005-09-21 2013-07-16 Buckyball Mobile Inc. Context-enriched microblog posting
US8509826B2 (en) 2005-09-21 2013-08-13 Buckyball Mobile Inc Biosensor measurements included in the association of context data with a text message
US8509827B2 (en) 2005-09-21 2013-08-13 Buckyball Mobile Inc. Methods and apparatus of context-data acquisition and ranking
US9042921B2 (en) 2005-09-21 2015-05-26 Buckyball Mobile Inc. Association of context data with a voice-message component
US9166823B2 (en) 2005-09-21 2015-10-20 U Owe Me, Inc. Generation of a context-enriched message including a message component and a contextual attribute

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9477940B2 (en) 2007-07-23 2016-10-25 International Business Machines Corporation Relationship-centric portals for communication sessions
US8352371B2 (en) * 2008-04-30 2013-01-08 General Instrument Corporation Limiting access to shared media content
US11265510B2 (en) 2010-10-22 2022-03-01 Litl Llc Video integration
US8928725B2 (en) * 2010-10-22 2015-01-06 Litl Llc Video integration
US8914485B2 (en) * 2011-09-30 2014-12-16 General Electric Company Methods and apparatus for in-process client-side context managers
US8650308B2 (en) 2011-09-30 2014-02-11 General Electric Company Methods and apparatus for client-side context managers
US20140244737A1 (en) * 2013-02-22 2014-08-28 Nokia Corporation Methods, apparatuses, and computer program products for enhancing a communication session
CN106201161B (en) * 2014-09-23 2021-09-03 北京三星通信技术研究有限公司 Display method and system of electronic equipment
JP6578742B2 (en) * 2015-05-28 2019-09-25 沖電気工業株式会社 Business System
PL3261320T3 (en) 2016-06-24 2020-08-10 Deutsche Telekom Ag System and method for communication with the involvement of a digital aura of a user
CN108259810A (en) * 2018-03-29 2018-07-06 上海掌门科技有限公司 A kind of method of video calling, equipment and computer storage media
CN112751749B (en) * 2020-12-30 2022-10-11 上海掌门科技有限公司 Method and equipment for presenting information in audio and video calling process

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6317777B1 (en) * 1999-04-26 2001-11-13 Intel Corporation Method for web based storage and retrieval of documents
US20040230651A1 (en) * 2003-05-16 2004-11-18 Victor Ivashin Method and system for delivering produced content to passive participants of a videoconference
US20050004985A1 (en) * 2003-07-01 2005-01-06 Michael Stochosky Peer-to-peer identity-based activity sharing

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6714987B1 (en) * 1999-11-05 2004-03-30 Nortel Networks Limited Architecture for an IP centric distributed network
US20010051876A1 (en) * 2000-04-03 2001-12-13 Seigel Ronald E. System and method for personalizing, customizing and distributing geographically distinctive products and travel information over the internet
US8060389B2 (en) * 2000-06-07 2011-11-15 Apple Inc. System and method for anonymous location based services
US7426730B2 (en) * 2001-04-19 2008-09-16 Wre-Hol Llc Method and system for generalized and adaptive transaction processing between uniform information services and applications
US20040143630A1 (en) * 2002-11-21 2004-07-22 Roy Kaufmann Method and system for sending questions, answers and files synchronously and asynchronously in a system for enhancing collaboration using computers and networking
US7373383B2 (en) * 2002-12-06 2008-05-13 International Business Machines Corporation Location messaging method for delivering messages in a global virtual space
US20050187368A1 (en) * 2004-02-19 2005-08-25 International Business Machines Corporation Methods and apparatus for complementing user entries associated with events of interest through context

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6317777B1 (en) * 1999-04-26 2001-11-13 Intel Corporation Method for web based storage and retrieval of documents
US20040230651A1 (en) * 2003-05-16 2004-11-18 Victor Ivashin Method and system for delivering produced content to passive participants of a videoconference
US20050004985A1 (en) * 2003-07-01 2005-01-06 Michael Stochosky Peer-to-peer identity-based activity sharing

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8489132B2 (en) 2005-09-21 2013-07-16 Buckyball Mobile Inc. Context-enriched microblog posting
US8509826B2 (en) 2005-09-21 2013-08-13 Buckyball Mobile Inc Biosensor measurements included in the association of context data with a text message
US8509827B2 (en) 2005-09-21 2013-08-13 Buckyball Mobile Inc. Methods and apparatus of context-data acquisition and ranking
US9042921B2 (en) 2005-09-21 2015-05-26 Buckyball Mobile Inc. Association of context data with a voice-message component
US9166823B2 (en) 2005-09-21 2015-10-20 U Owe Me, Inc. Generation of a context-enriched message including a message component and a contextual attribute
EP2400751A1 (en) * 2010-06-03 2011-12-28 France Telecom Method for establishing communication between users of audiovisual devices automatically identified as members of a same community

Also Published As

Publication number Publication date
CN100550754C (en) 2009-10-14
CN101039200A (en) 2007-09-19
EP1835689B1 (en) 2014-06-04
EP1835689A1 (en) 2007-09-19
US20070214238A1 (en) 2007-09-13

Similar Documents

Publication Publication Date Title
EP1835689B1 (en) Context enriched communication system and method
US10687021B2 (en) User interface with a hierarchical presentation of selection options for selecting a sharing mode of a video conference
US9686512B2 (en) Multi-user interactive virtual environment including broadcast content and enhanced social layer content
US9246917B2 (en) Live representation of users within online systems
CN103238317B (en) The system and method for scalable distributed universal infrastructure in real-time multimedia communication
US9369673B2 (en) Methods and systems for using a mobile device to join a video conference endpoint into a video conference
US8863185B2 (en) Social television
US9344681B2 (en) Systems and methods of incorporating live streaming sources into a video conference
US8751572B1 (en) Multi-user chat search and access to chat archive
US20160330258A1 (en) Broadcasts among electronic devices of registered users via internet protocol
US20170048286A1 (en) Live broadcast system
US20130155169A1 (en) Method and system for providing virtual conferencing
WO2013097950A1 (en) Combined data streams for group calls
KR101188926B1 (en) Method of real-time interactive sharing of multimedia data real-time interactive server and communication network
US10523899B2 (en) System and method for providing and interacting with coordinated presentations
US9740378B2 (en) Collaboration content sharing
WO2022007618A1 (en) Video call method and display device
US9071681B1 (en) Inbound telephony orchestrator for hangout-based contact center platform
US8755310B1 (en) Conferencing system
KR101492007B1 (en) Method and System for Sharing Information using IPTV with SIP Based Calling and Digital Multimedia Share Function
WO2018031438A1 (en) Method, system, software, engine, and a mobile application platform for video chat

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07711876

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07711876

Country of ref document: EP

Kind code of ref document: A1