WO2009150682A2 - Real time saving techniques of photographs taken by means of the cell phone camera - Google Patents

Real time saving techniques of photographs taken by means of the cell phone camera Download PDF

Info

Publication number
WO2009150682A2
WO2009150682A2 PCT/IT2009/000242 IT2009000242W WO2009150682A2 WO 2009150682 A2 WO2009150682 A2 WO 2009150682A2 IT 2009000242 W IT2009000242 W IT 2009000242W WO 2009150682 A2 WO2009150682 A2 WO 2009150682A2
Authority
WO
WIPO (PCT)
Prior art keywords
photographs
cell phone
photograph
real time
time saving
Prior art date
Application number
PCT/IT2009/000242
Other languages
French (fr)
Other versions
WO2009150682A3 (en
Inventor
Ugo Nevi
Original Assignee
Ugo Nevi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ugo Nevi filed Critical Ugo Nevi
Priority to JP2011513116A priority Critical patent/JP2011525734A/en
Publication of WO2009150682A2 publication Critical patent/WO2009150682A2/en
Publication of WO2009150682A3 publication Critical patent/WO2009150682A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00281Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal
    • H04N1/00307Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a telecommunication apparatus, e.g. a switched network of teleprinters for the distribution of text-based information, a selective call terminal with a mobile telephone apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00204Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
    • H04N1/00244Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server with a server, e.g. an internet server

Definitions

  • the present invention generally refers to the field of new services for mobile use on cell phones, more in particular it refers to an application which allows saving (uploading) data in an immediate but secure manner. Still more specifically, this data is constituted by the photographs which are taken with a portable/cell phone.
  • the mobile telephone technologies advance so as to provide increasingly diversified multimedia settings and to enrich the mobile devices (cell phones) with new services.
  • a fundamental, distinguishing event of such evolution is the close connection between the mobile device and the Internet network, along with the arrival of mobile devices (cell phones or PDA) with multimedia functionalities.
  • the interaction models for the network operators with reference to cellular phones enabled for the services of the third generation (3G) by means of servers and other devices provide for increased connection speed, a wider band for the mobile services based on various technologies which refer to GPRS, GSM, EDGE, UMTS.
  • the MMS multimedia message service should also be indicated.
  • the MMS services for example, are Store and Forward message type services capable of adding multimedia elements to the SMS, such as images, texts and audio.
  • the new generation of the M-Services overcomes the paradigm and the limitations of traditional messaging, since it is possible - with the MMS telephones - to send a multimedia message which can arrive in sizes on the order of tens or hundreds of Kbytes.
  • the principle on which the MMS is currently based is that of sending the message both to a cell number and to an email address; a suitable server inserted in the operator network (called MMS-C or Multimedia Messaging Service Centre) deals with properly transcoding the sent message, so to make it comprehensible both to the electronic mail server and to the mobile telephone user.
  • MMS-C Multimedia Messaging Service Centre
  • the sending and delivery of a MMS message provides for the following steps: a) the user writes his message by putting together texts, sounds and images - hence also a photograph - with the composer of the mobile terminal; b) he then inserts the recipients and sends the messages; c) the cell phone automatically carries out a WAP connection towards the operator service center (MMS-C) and the message is transferred from the telephone to the central server only in this step; d) the MMS-C server, interpreting the list of recipients of the message, provides for carrying out the appropriate transcoding (conversion into e-mail) and to signal the recipient (cell phone) with a "push" message (this is not the original message, but a notice which informs of the presence of a new message MMS); even if specifically dedicated to the sending of images by a mobile cell phone user, the MMS tool is
  • the patent US 20050102381 deals with the problem of saving data on a dedicated server through the Internet network, in particular considering the problem of security on the basis of pre-established user access rights and based on a series of preset parameters established by the user himself. It is clear that the problem is complex and does not have a quick solution, but what results extremely difficult and ineffective here is the fact that such "secure" saving of the photographs taken by means of the cell phone camera would depend on the particular cell phone or even on the relative keyboard. At the same time, there arises the need to manage such acquisition activity of such photographs in a quick and effective manner.
  • a potentially effective tool is certainly the sending to a Web server of an email with the related attachment composed of the just-shot photograph. But here too path is extremely tortuous and difficult for a user who has little experience with electronic devices.
  • the typical example can be the following, taken from the manual of a
  • the fundamental object of the invention is that of carrying out the storage in real time, in an interactive manner, with the remote memory constituted by the data server.
  • the image, which was taken at a certain instant, is by default sent to and stored at such data server through a minimized path, in a top down menu on the cell phone screen.
  • a further object of this invention is that of providing a network architecture in which registration means are comprised in order to implement the immediate arid effective interactive upload principle.
  • registration means are comprised in order to implement the immediate arid effective interactive upload principle.
  • the problem of the subsequent, effective retrieval of that stored will also be solved, linked to the randomness with which such savings are carried out.
  • the saving technique is implemented in a manner such that the immediate content sharing occurs without restrictions being set, such as the number of continuously saved photographs.
  • object of the present invention is that of providing real time saving techniques of the photographs taken by means of the cell phone camera, which employs network protocols and standard devices in the sphere of telecommunications, in order to provide a general and easy-to-use applicability solution.
  • the sender uses emails as transport mechanism of the content to be saved.
  • the sender identifies, at the server, the account to which the upload message is intended, indicating it in the email address.
  • the server correlates the email address of the sender with the account associated with the user himself.
  • the relative implementations regard a server which is in communication with a plurality of mobile devices.
  • the mobile devices are usually cell phones provided with cameras and the "content" to be saved is a photograph or even a short film.
  • the cell phone identification is the telephone number itself (the SIM card) assigned by the operator of the network services.
  • the IP address is combined with the cell phone identification (or relative
  • the photographs can still be optionally saved on an identification card, such as SIM (Subscriber Interface Module) or any other type of smart card or integrated chip or on a mobile device memory.
  • SIM Subscriber Interface Module
  • the automatic saving mechanism (more in general automatic downloading) is activated at the very moment when the photograph is taken by the mobile phone or by other devices immediately after the actual shot, so that the user in possession of the cell phone is immediately asked if he would like to send the acquired image to a storage system. If the user chose to take advantage of such service, the photograph is automatically sent to a receiving server on the basis of the modes prearranged at the time of the definition of the real time saving and cataloguing service. For this reason, a typical embodiment of the invention comprises:
  • a SIM is essentially associated with such cell phone for accessing a GSM, GPRS, or UMTS service
  • a data server configured for being interfaced with said first device, user side, on a mobile telephone network
  • - a procedural application configured, server side, for enabling the data server to: - i) receive and store the photographs in dedicated folders,
  • the achievement of the invention also provides systems, procedures and devices which allow automatically saving and organizing the photographs taken by means of cell phone in predefined concatenated lists.
  • FIGURE 1 shows a schematic representation of the telephone network architecture which achieves the finding according to the present invention
  • FIGURE 2 is a schematic representation of the photograph send menu with the plurality of selectable email addresses.
  • a system which provides the saving of the data in real time comprises the server 10, a plurality of mobile devices 8, a mobile telephone network 6, the Internet services 7, and a series of gateways 9 through which the data server communicates with the mobile devices.
  • the server-side program 10 comprises the codes which ensure that the operations are executed for identifying, accessing and setting of the parameters so that the user can conduct an effective search for the photograph, in addition to ensuring the interactivity in response to the situations in which the server receives the email with the photograph to be saved from the cell phone.
  • the camera of the cell phone when the user captures an image, for example by pressing the key set on the cell phone, the camera of the cell phone itself sends the image in real time through the wireless connection to the data server, so that it is stored as an image file.
  • the telecamera of the cell phone can alternatively locally store the image and send it to the data server at a later time, on the basis of a selection on the menu and due to a subsequent command.
  • the default operation provides that the priority procedure automatically sends the photograph according to that provided below.
  • the telecamera of the cell phone can code the data relative to the image, for example in JPEG format, or the data server can itself decode the data of the image after reception, or the data of the image can remain in the original format even in the data server.
  • the use is provided of complementary reverse processes, in which the cell phone which has per se a display allows the user to see the photograph on the display. In this manner, the user can see the image which was previously stored, or see the image before the latter is sent to storage (i.e. the image is stored by the cell phone but has not yet been selected for being stored by the user).
  • the user wishes to review an image that was stored on the server, with the cell phone, he connects to the server and requests the available image files.
  • the cell phone then shows the server's response to the user, in fact in response to a user selection the cell phone transmits the image file request to the data server and the server - having retrieved the requested data - sends the relative file to the cell phone by means of the mobile connection.
  • the cell phone receives the file requested from the server and shows the image stored in the file, decoding the file and showing the image on the display.
  • the search of one's photograph archive is carried out by the user by means of indices, i.e. trees/directories which by starting from macro-classifications (such as the date - DDMMYY hour minute and second -, site, subject of the photograph etc.) allow carrying out advanced searches until the photograph is retrieved.
  • indices i.e. trees/directories which by starting from macro-classifications (such as the date - DDMMYY hour minute and second -, site, subject of the photograph etc.) allow carrying out advanced searches until the photograph is retrieved.
  • macro-classifications such as the date - DDMMYY hour minute and second -, site, subject of the photograph etc.
  • an initialization operation of the cell phone is in any case necessary, which comprises the setup of the acceptance parameters during saving step. Then, on the cell phone side it is ensured that the user has a prompt for inserting arrival identifications, emitted by the provider, for the photograph saving service with reference to the cell phone (the related SIM) which subscribed a contract for said photograph saving service on the data server.
  • Each message with attached photograph is identified by the particular user account which identifies, at the data server, a dedicated file-saving directory. This email address has the form of a string, such as dir dataserver@gestoredelsermulo.it. It is then supposed that, as in Fig.
  • the destination must be for example Paolo Rossi, so then the e-mail is structured as "A: paolorossi@gestoredelsermulo.it" and the server related to the loading of the emails identifies the directory in which such photograph must be allocated, on the basis of the sub-string Paolo Rossi.
  • the user is then placed in a condition, as in Fig. 2, to send the photographs to one or more email addresses, for example francesco.rossi@tiscal ⁇ carloimprota@tiscali, rosanna.paoletti@ tiscali.it, etc. or still other emails towards which the photographs related to the user account are loaded.
  • the photograph immediately reappears on the video of the cell phone together with the menu of Fig. 2, in an intermittent manner with the photographs just captured, and after a user-settable ⁇ t for the intermittent display of the photograph/recipient email list, in which the photograph is visible, the photograph itself is sent to the first electronic mail account on the list.
  • the user can otherwise - by means of pressing one of the provided keys - interrupt and prearrange the sending to another recipient or to several recipients (accounts) at the same time.
  • the mail send procedure will have a recipient field which comprises a jpg attachment, by means of the function: function mail_attachment ($from, $to, Ssubject, Smessage, $attachment) ⁇ ? include "mail_attachment.php”; mail_attachment ("utente@gestoreservizio.com”, “customer@aol.com”, “Your Attachment”, "Here is the file to be transmitted”, 7var/www/images/my_file.jpg”); ?>
  • the photographs contained in the emails are catalogued in a series of suitable lists or separate folders, for example by date (DDMMYY hour minute and second) or by place and/or by subject of the photograph.
  • the user can confirm the choice for placing each photograph in a specific folder, before each of these is automatically configured in the relative directory for future references.
  • the same photograph by means of a plurality of links, is allocated in a series of multiple lists.
  • an information group is certainly chosen which is already per se associated with the photographs, so that the user does not have to lose time and interactivity in the sending and saving operation.
  • the send date (DDMMYY hour minute and second) of the photograph should of course be considered - such date already present in the same sent email -, so that all the photographs taken on a certain date will form a base organization type.
  • Another list which can be linked is a folder which subdivides the various photographs on the basis of standard criteria for a camera, which can be the "subject" characteristic with the portrait, landscape, micro- photography extensions, etc.
  • an analyzer of the photograph content is essentially present at the data server 10. Such analyzer scans the content of each photograph, i.e. it evaluates if there is the physiognomy of a face in the photograph, thus an oval perimeter structure in which eyes, eyebrows etc. are contained so to be able to classify such photograph as a portrait.
  • the relative steps provide the following: - the identification of ovoid contours (front portraits) or trapezoid contours (side portraits) in the photograph,
  • the dedicated application software can identify, in the scope of the photographs, the fact that reliefs are present with projections such as mountains, or the sea, or clouds, and these elements can substantially configure the classification of the photograph as a landscape.
  • Such choice does not at all lie outside of reality, since it is supported by a series of recent solutions which are even capable of "adjusting" a portrait or a landscape.
  • Such photograph manipulation type is clearly indicative of the feasibility of procedures which identify the photograph type, the subject type and on the basis of such identification define a classification by key/multiple list.
  • classification is also provided based on other parameters which can be the site from which the photograph was taken and at the same time sent.
  • the cell in which the same user-owner of the cell phone and relative SIM is operating is present at the HLR of the network operator (at which the owner of the cell phone SIM is subscribed).
  • the network operator at which the owner of the cell phone SIM is subscribed.
  • This solution type finally allows allocating at the data server 10 - automatically, without the user having to type anything - a possible multiple list 11 linked to the send site.
  • the user a resident of Milan: the fact that he is on vacation in Sardinia and takes pictures today at Stintino, another day at Porto Cervo, and on another day at Olbia will ensure that from the logic standpoint, multiple lists are created at the data server on the basis of the site at which such photographs were taken.
  • the principle is that of logically linking, in several concatenated lists, all the registered photographs which have the same value in the secondary key. Every record is then extended with an additional field (for example Linksito) intended to contain the pointer having the same value as the secondary key. So that if on one hand a real, physical archive of the photographs is in any case present, on the other hand for carrying out searches one can utilize a pointer logic structure.
  • the effectiveness of the query of the following type is clear: "Display all the landscapes taken at Stintino from 12 - 20 August 2008". The query will be immediately met by means of the intersection of the corresponding three sets of the primary key (Photograph save date) and of the secondary keys ("Site" where the photographic shot was taken and "subject” captured in the photograph itself).
  • the transportation protocol of the emails is well-known to be SMTP, which is used for the transfer of the mail in the PC sphere.
  • SMTP protocol is in fact a server to server protocol so that other applications are used for the delivery and access to the messages.
  • the local host 8 (of the sender) must in any case be identified by an IP address at the time of the sending. As stated, when a mail is sent to the server saving the photographs, the mobile telephone number and the domain which belong to the sender are automatically part of the field "From:" of the IP address which accompanies the loading message.
  • the email is sent by the cell phone 18 to the server 10, i.e. to the photograph service of the data server.
  • the email with the photograph is transported by means of the operator network and is first transmitted to a user-side server 12 which constitutes a SMTP interface.
  • the SMTP interface then sends the messages to the server 10 set for the actual saving of the photographs.
  • the identification is extracted, i.e. Paolo Rossi, from the destination email address.
  • the telephone number of the sender is simultaneously acquired as source identification of the photograph- message.
  • the telephone number and the mail address of the recipient are then used for evaluating if the user has the permission to load the incoming photographs.
  • other information is acquired from the network manager, such as the date (DDMMYY hour minute and second) of the mail sending and the site VLR from which the sending arrives.
  • the finding thus resolves the problems pertaining to the onsite storage and processing of the photographs.
  • the system according to the invention can assist in the integration related to the services provided by the generic mobile network operator.
  • the information exchange between users on the network is in fact automated.
  • the updates referred to the data stored on a movable device can be obtained in an automatic manner or with a manual input based on the menu choices.

Abstract

Real time saving techniques of photographs taken by means of the cell phone camera which comprises the functionalities relative to the sending of the captured photographs - upon procedure activated by the mobile telephone itself - to a management system of the storage service, such as a data bank, remotely situated and securely organized, where such photographs are stored; and to the recovery of the photographs from said storage system - upon request coming from the mobile telephone itself - towards the mobile telephone by means of transmission and visualization on the display of the mobile phone.

Description

Description
Real time saving techniques of photographs taken by means of the cell phone camera
Technical field
The present invention generally refers to the field of new services for mobile use on cell phones, more in particular it refers to an application which allows saving (uploading) data in an immediate but secure manner. Still more specifically, this data is constituted by the photographs which are taken with a portable/cell phone.
Background art
Key
BSC Base Station Controller GMSC Gateway Mobile Switching Center
GSM Global System For Mobile Communications
GPRS General Packet Radio Service
HLR Home Location Register
MSC Mobile Switching Center PDA Personal Digital Assistants
SIM Subscriber Interface Module
VLR Visitor Location Register
UMTS Universal Mobile Telecommunication System
The mobile telephone technologies advance so as to provide increasingly diversified multimedia settings and to enrich the mobile devices (cell phones) with new services.
A fundamental, distinguishing event of such evolution is the close connection between the mobile device and the Internet network, along with the arrival of mobile devices (cell phones or PDA) with multimedia functionalities.
The most recent versions of mobile devices (such as cell phones, PDA, portable computers and another other type of portable terminal) operate with the most standard multimedia functions, including the capacity to receive email and acquire or forward information by means of the Internet. Among these services, that of storing content such as photographs and photographic shots should certainly be noted.
On one hand, the interaction models for the network operators with reference to cellular phones enabled for the services of the third generation (3G) by means of servers and other devices provide for increased connection speed, a wider band for the mobile services based on various technologies which refer to GPRS, GSM, EDGE, UMTS.
Among the multiple services which are supported by such protocols, in addition to the presence of the SMS, the MMS multimedia message service should also be indicated. The MMS services, for example, are Store and Forward message type services capable of adding multimedia elements to the SMS, such as images, texts and audio.
The new generation of the M-Services overcomes the paradigm and the limitations of traditional messaging, since it is possible - with the MMS telephones - to send a multimedia message which can arrive in sizes on the order of tens or hundreds of Kbytes. The principle on which the MMS is currently based is that of sending the message both to a cell number and to an email address; a suitable server inserted in the operator network (called MMS-C or Multimedia Messaging Service Centre) deals with properly transcoding the sent message, so to make it comprehensible both to the electronic mail server and to the mobile telephone user. The MMS can be seen as a new message type defined at the "border" between
Internet and telecommunications, since on one hand the users are connected to the cellular telephone network while on the other hand the servers are interconnected with the Internet. In summary, it can be considered that the sending and delivery of a MMS message provides for the following steps: a) the user writes his message by putting together texts, sounds and images - hence also a photograph - with the composer of the mobile terminal; b) he then inserts the recipients and sends the messages; c) the cell phone automatically carries out a WAP connection towards the operator service center (MMS-C) and the message is transferred from the telephone to the central server only in this step; d) the MMS-C server, interpreting the list of recipients of the message, provides for carrying out the appropriate transcoding (conversion into e-mail) and to signal the recipient (cell phone) with a "push" message (this is not the original message, but a notice which informs of the presence of a new message MMS); even if specifically dedicated to the sending of images by a mobile cell phone user, the MMS tool is clearly not very practical for operating an interactive saving of the photograph just captured on a virtual disc on the web.
In order to have the cell phone world work together with the Internet network, a series of solutions have been proposed - in any case characterized by being rather complicated and not immediate - with regard to the mode with which domain names are attributed to the service centers for the related transit and saving of a photograph on the www.
For example, the patent US 20050102381 deals with the problem of saving data on a dedicated server through the Internet network, in particular considering the problem of security on the basis of pre-established user access rights and based on a series of preset parameters established by the user himself. It is clear that the problem is complex and does not have a quick solution, but what results extremely difficult and ineffective here is the fact that such "secure" saving of the photographs taken by means of the cell phone camera would depend on the particular cell phone or even on the relative keyboard. At the same time, there arises the need to manage such acquisition activity of such photographs in a quick and effective manner.
In fact, in the current PDA, rather complex paths are usually present for sending a mail by means of the cellular network, through cascade menus with selections that in reality are not interactive, and which in any case delay the saving of the photographic shot after the taking thereof.
A potentially effective tool is certainly the sending to a Web server of an email with the related attachment composed of the just-shot photograph. But here too path is extremely tortuous and difficult for a user who has little experience with electronic devices. The typical example can be the following, taken from the manual of a
Mitsubishi cell phone model.
From the Mail submenu:
Composition of an e-mail
Select "write mail" or press cc. Choose Subject.
Press OK and insert text in the message header (maximum 30 characters).
Press OK
Choose A: 1.
Press OK and select one of the names available from the displayed list or select other , then type the mail address or the telephone number required.
Press OK
Choose Message
Press OK and insert message text (maximum 10 Kb). Press OK.
Choose II attached field if it is desired to add a musical melody or an image to the message.
Press OK.
Then select images or ringer melodies for choosing one of the available files.
Press OK. Slide downward until choosing SEND (for sending the message) or SAVE (for storing the message in the draft folder) and select OK to confirm the selection. During the writing of the message, it is possible to access the Edit menu at any moment by selecting an icon (press the call key).
Figure imgf000006_0001
The complexity of execution and the consequent loss of interactivity in sending photographs are quite clear from the above example.
The fundamental object of the invention is that of carrying out the storage in real time, in an interactive manner, with the remote memory constituted by the data server. The image, which was taken at a certain instant, is by default sent to and stored at such data server through a minimized path, in a top down menu on the cell phone screen.
A further object of this invention, as fully described below, is that of providing a network architecture in which registration means are comprised in order to implement the immediate arid effective interactive upload principle. In case of content sharing, the problem of the subsequent, effective retrieval of that stored will also be solved, linked to the randomness with which such savings are carried out. This keeping in mind that the invention is based on the observation that there is the clear need to carry out an immediate and interactive saving, and that described below simultaneously refers to such two objectives. On such basis, the saving technique is implemented in a manner such that the immediate content sharing occurs without restrictions being set, such as the number of continuously saved photographs. Finally, object of the present invention is that of providing real time saving techniques of the photographs taken by means of the cell phone camera, which employs network protocols and standard devices in the sphere of telecommunications, in order to provide a general and easy-to-use applicability solution. These and other objects which will be clearer during the description are obtained by means of the real time saving procedures of the photographs taken by means of the cell phone camera, whose essential functioning principles are set forth in claim 1.
Disclosure of invention
According to the finding of the present invention, the sender uses emails as transport mechanism of the content to be saved. The sender identifies, at the server, the account to which the upload message is intended, indicating it in the email address. Then, the server correlates the email address of the sender with the account associated with the user himself.
The relative implementations regard a server which is in communication with a plurality of mobile devices. In the following example, the mobile devices are usually cell phones provided with cameras and the "content" to be saved is a photograph or even a short film.
The cell phone identification is the telephone number itself (the SIM card) assigned by the operator of the network services. In such case, the IP address is combined with the cell phone identification (or relative
SIM) in the message which is sent for the saving, such that the set procedures carry out the extraction of the header identifications of the sent message so to obtain both the IP address and the cell phone identification. As is usually expected from all cell phones with telecamera, the photographs can still be optionally saved on an identification card, such as SIM (Subscriber Interface Module) or any other type of smart card or integrated chip or on a mobile device memory. But according to the new functionality, the automatic saving mechanism (more in general automatic downloading) is activated at the very moment when the photograph is taken by the mobile phone or by other devices immediately after the actual shot, so that the user in possession of the cell phone is immediately asked if he would like to send the acquired image to a storage system. If the user chose to take advantage of such service, the photograph is automatically sent to a receiving server on the basis of the modes prearranged at the time of the definition of the real time saving and cataloguing service. For this reason, a typical embodiment of the invention comprises:
- management procedures of the original information (the photograph situated on the cell phone with the telecamera) in order to prearrange its sending (a SIM is essentially associated with such cell phone for accessing a GSM, GPRS, or UMTS service);
- a data server configured for being interfaced with said first device, user side, on a mobile telephone network, and
- a procedural application configured, server side, for enabling the data server to: - i) receive and store the photographs in dedicated folders,
- ii) retrieve information/photographs stored in the archives of the data server, through the mobile network following the interconnection between the user device and the data server.
The achievement of the invention also provides systems, procedures and devices which allow automatically saving and organizing the photographs taken by means of cell phone in predefined concatenated lists.
Brief description of drawings For mere exemplifying purposes and without wishing to limit the generality and possible fields of application, a preferred embodiment of the invention is described below with reference to the attached Figures, in which:
FIGURE 1 shows a schematic representation of the telephone network architecture which achieves the finding according to the present invention;
FIGURE 2 is a schematic representation of the photograph send menu with the plurality of selectable email addresses.
Best mode for carrying out the invention
The approach described above can be implemented with a data processing system (a computer) 10 provided with storage means, on which a program is active with a code dedicated to the effective and structured saving operations. In this implementation, the application is divided into three sections, one part arranged on the server side, a second part which is operative on the client side - the cell phone - and a third part which is active on the mobile telephone network. A system which provides the saving of the data in real time comprises the server 10, a plurality of mobile devices 8, a mobile telephone network 6, the Internet services 7, and a series of gateways 9 through which the data server communicates with the mobile devices. The server-side program 10 comprises the codes which ensure that the operations are executed for identifying, accessing and setting of the parameters so that the user can conduct an effective search for the photograph, in addition to ensuring the interactivity in response to the situations in which the server receives the email with the photograph to be saved from the cell phone.
According to the present invention, when the user captures an image, for example by pressing the key set on the cell phone, the camera of the cell phone itself sends the image in real time through the wireless connection to the data server, so that it is stored as an image file. Of course, it is still provided that the telecamera of the cell phone can alternatively locally store the image and send it to the data server at a later time, on the basis of a selection on the menu and due to a subsequent command. However, the default operation provides that the priority procedure automatically sends the photograph according to that provided below.
The telecamera of the cell phone can code the data relative to the image, for example in JPEG format, or the data server can itself decode the data of the image after reception, or the data of the image can remain in the original format even in the data server. The use is provided of complementary reverse processes, in which the cell phone which has per se a display allows the user to see the photograph on the display. In this manner, the user can see the image which was previously stored, or see the image before the latter is sent to storage (i.e. the image is stored by the cell phone but has not yet been selected for being stored by the user). When the user wishes to review an image that was stored on the server, with the cell phone, he connects to the server and requests the available image files. The cell phone then shows the server's response to the user, in fact in response to a user selection the cell phone transmits the image file request to the data server and the server - having retrieved the requested data - sends the relative file to the cell phone by means of the mobile connection. The cell phone receives the file requested from the server and shows the image stored in the file, decoding the file and showing the image on the display.
Whether one once again accesses through mobile telephones, or one accesses through Internet, for example from home with the PC, the search of one's photograph archive is carried out by the user by means of indices, i.e. trees/directories which by starting from macro-classifications (such as the date - DDMMYY hour minute and second -, site, subject of the photograph etc.) allow carrying out advanced searches until the photograph is retrieved. Indeed, by providing for the presence of about ten general categories (configurable by the user), one can pass to a list of sub-categories, arriving at a narrowed-down list which contains a number of photographs on the order of about ten, displayable with the navigation by means of the normal cell phone keys. In order to implement the interactivity of the saving operations, an initialization operation of the cell phone is in any case necessary, which comprises the setup of the acceptance parameters during saving step. Then, on the cell phone side it is ensured that the user has a prompt for inserting arrival identifications, emitted by the provider, for the photograph saving service with reference to the cell phone (the related SIM) which subscribed a contract for said photograph saving service on the data server. Each message with attached photograph is identified by the particular user account which identifies, at the data server, a dedicated file-saving directory. This email address has the form of a string, such as dir dataserver@gestoredelservizio.it. It is then supposed that, as in Fig. 2, the destination must be for example Paolo Rossi, so then the e-mail is structured as "A: paolorossi@gestoredelservizio.it" and the server related to the loading of the emails identifies the directory in which such photograph must be allocated, on the basis of the sub-string Paolo Rossi. The user is then placed in a condition, as in Fig. 2, to send the photographs to one or more email addresses, for example francesco.rossi@tiscalύ carloimprota@tiscali, rosanna.paoletti@ tiscali.it, etc. or still other emails towards which the photographs related to the user account are loaded.
Once captured, the photograph immediately reappears on the video of the cell phone together with the menu of Fig. 2, in an intermittent manner with the photographs just captured, and after a user-settable Δt for the intermittent display of the photograph/recipient email list, in which the photograph is visible, the photograph itself is sent to the first electronic mail account on the list. In other words, the user can otherwise - by means of pressing one of the provided keys - interrupt and prearrange the sending to another recipient or to several recipients (accounts) at the same time.
Schematizing with a series of essential instructions, by means of a Php code fragment, the mail send procedure will have a recipient field which comprises a jpg attachment, by means of the function: function mail_attachment ($from, $to, Ssubject, Smessage, $attachment) <? include "mail_attachment.php"; mail_attachment ("utente@gestoreservizio.com", "customer@aol.com", "Your Attachment", "Here is the file to be transmitted", 7var/www/images/my_file.jpg"); ?>
As stated, such functionality in the form of a graphical window would be translated into a choice box of the type reported in Fig. 2. Since the roles of the system components will be established below, we can at the moment discuss the cataloguing procedure of the arriving photographs. Once again, a new saving mode can be macroscopically established by the same user who defines N saving folders of the type Francesco Rossi automobili@ gestoreservizio.it, or Francesco_Rossi_lavoro@gestoreservizio.it or Francesco_Rossi_famiglia@gestore servizio.it etc. On the other hand, the photographs contained in the emails are catalogued in a series of suitable lists or separate folders, for example by date (DDMMYY hour minute and second) or by place and/or by subject of the photograph. In a further embodiment, at the end of the selection process, the user can confirm the choice for placing each photograph in a specific folder, before each of these is automatically configured in the relative directory for future references.
As already noted above, even if that described may appear to be the use of a standard email address for the server data, this is certainly not the normal sending and receiving operation of only ordinary mail. Rather, the email only constitutes a transport tool, since it is sent to a particular server which then has the essential task of classifying and storing the photographs.
Afterwards, the same photograph, by means of a plurality of links, is allocated in a series of multiple lists. Among such lists, as primary keys, an information group is certainly chosen which is already per se associated with the photographs, so that the user does not have to lose time and interactivity in the sending and saving operation. Among this information, the send date (DDMMYY hour minute and second) of the photograph should of course be considered - such date already present in the same sent email -, so that all the photographs taken on a certain date will form a base organization type.
Another list which can be linked (by the original list of the dates) is a folder which subdivides the various photographs on the basis of standard criteria for a camera, which can be the "subject" characteristic with the portrait, landscape, micro- photography extensions, etc. On the basis of this solution, an analyzer of the photograph content is essentially present at the data server 10. Such analyzer scans the content of each photograph, i.e. it evaluates if there is the physiognomy of a face in the photograph, thus an oval perimeter structure in which eyes, eyebrows etc. are contained so to be able to classify such photograph as a portrait. The relative steps provide the following: - the identification of ovoid contours (front portraits) or trapezoid contours (side portraits) in the photograph,
- the selection of N predefined points characteristic of the human face on the basis of the increased chromatic evidence with respect to others,
- the correlation of a specific group of correlated measurements between the aforesaid identified points, such measurements normalized with respect to a measurement executed between two pre-selected points that are characteristic of the face. Analogously, the dedicated application software can identify, in the scope of the photographs, the fact that reliefs are present with projections such as mountains, or the sea, or clouds, and these elements can substantially configure the classification of the photograph as a landscape. Such choice does not at all lie outside of reality, since it is supported by a series of recent solutions which are even capable of "adjusting" a portrait or a landscape. In other words, once a person's portrait is recognized in a photograph, it is possible to operate by arranging a facial expression of the person portrayed with a smile, instead of without a smile, or it is possible to operate by removing the red eye effect, etc.
Such photograph manipulation type is clearly indicative of the feasibility of procedures which identify the photograph type, the subject type and on the basis of such identification define a classification by key/multiple list.
In addition to date-based, classification is also provided based on other parameters which can be the site from which the photograph was taken and at the same time sent. In fact, it is known that at the time when the photograph is sent, by means of email, the cell in which the same user-owner of the cell phone and relative SIM is operating is present at the HLR of the network operator (at which the owner of the cell phone SIM is subscribed). Essentially, then, at the moment when a photograph is sent by means of email, as a parameter that is implicitly registered and inserted by the network operator (due to the communication between VLR / HLR) there is the site of the VLR cell from which the photograph itself was sent by means of email. This solution type finally allows allocating at the data server 10 - automatically, without the user having to type anything - a possible multiple list 11 linked to the send site. Suppose that the user, a resident of Milan, is on vacation for example in Sardinia: the fact that he is on vacation in Sardinia and takes pictures today at Stintino, another day at Porto Cervo, and on another day at Olbia will ensure that from the logic standpoint, multiple lists are created at the data server on the basis of the site at which such photographs were taken.
The principle is that of logically linking, in several concatenated lists, all the registered photographs which have the same value in the secondary key. Every record is then extended with an additional field (for example Linksito) intended to contain the pointer having the same value as the secondary key. So that if on one hand a real, physical archive of the photographs is in any case present, on the other hand for carrying out searches one can utilize a pointer logic structure. The effectiveness of the query of the following type is clear: "Display all the landscapes taken at Stintino from 12 - 20 August 2008". The query will be immediately met by means of the intersection of the corresponding three sets of the primary key (Photograph save date) and of the secondary keys ("Site" where the photographic shot was taken and "subject" captured in the photograph itself). The importance of the effective classification should be pointed out: anyone is capable of keeping a desk ordered or without piles of paper, setting aside the documents which arrive one after the other - the problem will then be effectively and thus quickly retrieving such documents when they are requested. The transportation protocol of the emails is well-known to be SMTP, which is used for the transfer of the mail in the PC sphere. The SMTP protocol is in fact a server to server protocol so that other applications are used for the delivery and access to the messages.
The local host 8 (of the sender) must in any case be identified by an IP address at the time of the sending. As stated, when a mail is sent to the server saving the photographs, the mobile telephone number and the domain which belong to the sender are automatically part of the field "From:" of the IP address which accompanies the loading message.
Since the destination is then known, the email is sent by the cell phone 18 to the server 10, i.e. to the photograph service of the data server. On this path to the server 10, the email with the photograph is transported by means of the operator network and is first transmitted to a user-side server 12 which constitutes a SMTP interface. The SMTP interface then sends the messages to the server 10 set for the actual saving of the photographs. After the message with photograph arrives on the server, the identification is extracted, i.e. Paolo Rossi, from the destination email address. The telephone number of the sender is simultaneously acquired as source identification of the photograph- message. The telephone number and the mail address of the recipient are then used for evaluating if the user has the permission to load the incoming photographs. As described, other information is acquired from the network manager, such as the date (DDMMYY hour minute and second) of the mail sending and the site VLR from which the sending arrives.
Industrial applicability
The principle is clear according to which an event is activated on the cell phone in a simple and interactive - or "user-friendly" - manner starting from the choice/option which provides for the taking of the photograph, in the sense that the user in order to carry out the saving does not have to be connected to a telephone number, activate a connection, exchange voice messages or type online selections on the keyboard, request password or access codes, respond with password or access codes known to him as subscriber of the SIM contract etc.
The specification that the two photograph taking and sending steps automatically take place on request coming from the mobile telephone should be intended as a definition of a process executed without user control. Once the photograph is taken, in fact, the user does not intervene for modifying the sequence of the steps or the progress of the saving or restoring process. Such procedure definition is characterized by considerable simplicity and quick functioning; moreover, such characteristic is extremely advantageous in applications in which, for example, direct storage is provided of the photograph exceeding that which can be stored in the telephone (investigative or judicial research).
The clear advantage will be noted for storing images on the data server, as the user does not have to worry about physically allocating the photographic shots or the locally removable means for storing the images.
The finding thus resolves the problems pertaining to the onsite storage and processing of the photographs. The system according to the invention can assist in the integration related to the services provided by the generic mobile network operator. The information exchange between users on the network is in fact automated. The updates referred to the data stored on a movable device can be obtained in an automatic manner or with a manual input based on the menu choices.
There is also the advantage deriving from the fact that the saved photographs can be recovered even if the cell phone is lost by the user owning such phone. Further configurations of the invention can easily provide the implementations for the auto-exchange of photographs between two mobile telephones with a call which automatically activates the sending of the photographs to a data server or to another telephone.

Claims

Claims
1. A real time saving technique of the photographs taken by means of the cell phone camera, characterized in that it comprises the related functionalities:
- sending of the captured photographs - upon procedure activated by the mobile telephone itself - to a management system of the storage service, such as a data bank, remotely situated and securely organized, where such photographs are stored; and
- recovery of the photographs from said storage system - upon request coming from the mobile telephone itself - towards the mobile telephone, by means of transmission and visualization on the display of the mobile telephone.
2. A real time saving technique of the photographs taken by means of the cell phone camera according to claim 1 , characterized in that once the photograph is captured it immediately reappears on the menu, in an interactive manner with the photographs just captured, and after a user-settable Δt for the intermittent display of the photograph/recipient email list, in which the photograph is visible, the photograph itself is sent to the default electronic mail account.
3. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that the user is allowed to interrupt the intermittent display and to send to another recipient or to several recipient accounts at the same time.
4. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that it manages the saving mode, the user defining N folders for the macroscopic classification of the stored photographs.
5. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that it logically links in several concatenated lists all the registered photographs which have the same values in the secondary key, from here structuring the subsequent search operations based on pointer logic.
6. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that the same photograph, by means of a plurality of links, is allocated in a series of multiple lists, the keys on which the selection is activated being selected from an information group already per se associated with the photographs.
7. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that one key on which the organization of the archive is based is the sending date (DDMMYY hour minute and second) of the photographs - already present in the same email that is sent.
8. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that it bases the organization of the archive on the "photograph subject" characteristic, with the relative extensions of portrait, landscape and microphotography type.
9. A real time saving technique of the photographs taken by means of the cell phone camera according to the preceding claim, characterized in that it employs an application which analyzes the content of the photographs and evaluates if typical elements are comprised in the photographs for identifying the same photograph's belonging to a specific category, such as portrait, landscape and microphotography.
10. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that the steps relative to the classification of a photograph as a portrait provide for:
- the identification of ovoid contours (front portraits) or trapezoid contours (side portraits) in the photographs,
- the selection of N predefined points, characteristic of the human face, on the basis of the greater chromatic evidence with respect to other points,
- the correlation of a specific group of correlated measurements between the aforesaid identified points, such measurements normalized with respect to a measurement executed between two pre-selected points that are characteristic of the face.
11. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that the application for the classification of the photographs as landscape is based on identifying, in the image, the presence of geometric figures of significant area, obtainable from the contours associated with sharp color variations traceable to contrasts such as sea/sand or mountain/sky.
12. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that it carries out the classification of the photograph based on the site at which such photograph was taken and simultaneously sent.
13. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that at the moment when the photograph is sent, the cell in which the same user-owner of the cell phone and the related SIM is operating is acquired at the HLR of the network operator, such information being continuously registered by the network operator in the HLR with regard to the site of the VLR cell most recently visited by the cell phone, by the detection and sending of such information together with the photograph, a concatenated list being automatically allocated on the basis of the send site.
14. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that the user uses the emails as a tool for transporting the loading messages, and in which the sender identifies, at a data server, the account to which the loading message is intended, indicating the recipient email address.
15. A real time saving technique of the photographs taken by means of the cell phone camera according to each of the preceding claims, characterized in that it places the email addresses of the user in relation with the account associated with the user himself and with the identification of the SIM related to the sender cell phone, in order to define the secure access to the relative data on the data bank.
16. A telecommunications network architecture set for saving, in real time, the photographs taken by means of the cell phone camera according to each of the previous claims, characterized in that it comprises: I - a plurality of mobile devices (8), a mobile telephone network (6), the Internet services (7), and a series of gateways (9) through which a data server (10) communicates with the mobile devices (8);
II - original information management procedures operative on the cell phone (8) with the telecamera, in order to prearrange the sending of the photograph, a SIM being associated with such cell phone for accessing a GSM, GPRS, or UMTS service,
- a procedural application configured on the server side (10) for enabling the data server (10) to:
- i) receive and store photographs in dedicated folders, - ii) retrieve information/photographs stored in the archives of the data server, through the mobile network and following the interconnection between the user device (8) and the data server (10).
PCT/IT2009/000242 2008-06-09 2009-06-05 Real time saving techniques of photographs taken by means of the cell phone camera WO2009150682A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2011513116A JP2011525734A (en) 2008-06-09 2009-06-05 Real-time storage technology for photos taken with a mobile phone camera

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
ITRM20080296 ITRM20080296A1 (en) 2008-06-09 2008-06-09 REAL TIME RESCUE TECHNIQUES OF THE PHOTOS TAKEN BY MEANS OF THE PHONE CAMERA.
ITRM2008A000296 2008-06-09

Publications (2)

Publication Number Publication Date
WO2009150682A2 true WO2009150682A2 (en) 2009-12-17
WO2009150682A3 WO2009150682A3 (en) 2010-02-25

Family

ID=40302041

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IT2009/000242 WO2009150682A2 (en) 2008-06-09 2009-06-05 Real time saving techniques of photographs taken by means of the cell phone camera

Country Status (3)

Country Link
JP (1) JP2011525734A (en)
IT (1) ITRM20080296A1 (en)
WO (1) WO2009150682A2 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040092250A1 (en) * 2002-11-08 2004-05-13 Openwave Systems Inc. MMS based photo album publishing system
EP1513080A2 (en) * 2003-08-29 2005-03-09 Nokia Corporation Organization and maintenance using metadata
WO2005114476A1 (en) * 2004-05-13 2005-12-01 Nevengineering, Inc. Mobile image-based information retrieval system
WO2008067380A1 (en) * 2006-11-29 2008-06-05 Google Inc. Digital image archiving and retrieval using a mobile device system

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003134258A (en) * 2001-10-25 2003-05-09 Matsushita Electric Ind Co Ltd Digital camera mount type mobile phone, image information service system, and emergency notice system
JP2003169287A (en) * 2001-11-29 2003-06-13 Matsushita Electric Ind Co Ltd Recording method of photographed image
US7432954B2 (en) * 2002-08-12 2008-10-07 Sanyo Electric Co., Ltd. Communications terminal having image shooting function and program for the communications terminal
JP4411948B2 (en) * 2003-12-01 2010-02-10 日本電気株式会社 Image management system, mobile phone terminal used in the system, image management method, and image management control program
JP2006157886A (en) * 2004-10-29 2006-06-15 Junichi Fukuda Information processing device, portable terminal device, server computer, data storing method, and program
JP2007041987A (en) * 2005-08-05 2007-02-15 Sony Corp Image processing apparatus and method, and program
JP4478093B2 (en) * 2005-10-17 2010-06-09 富士フイルム株式会社 Object image retrieval apparatus, digital camera, and control method thereof
JP2007336125A (en) * 2006-06-14 2007-12-27 Fujifilm Corp Imaging device and its controlling method
JP4883355B2 (en) * 2006-10-03 2012-02-22 日本電気株式会社 Mobile terminal with camera and image data transmission method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040092250A1 (en) * 2002-11-08 2004-05-13 Openwave Systems Inc. MMS based photo album publishing system
EP1513080A2 (en) * 2003-08-29 2005-03-09 Nokia Corporation Organization and maintenance using metadata
WO2005114476A1 (en) * 2004-05-13 2005-12-01 Nevengineering, Inc. Mobile image-based information retrieval system
WO2008067380A1 (en) * 2006-11-29 2008-06-05 Google Inc. Digital image archiving and retrieval using a mobile device system

Also Published As

Publication number Publication date
ITRM20080296A1 (en) 2009-12-10
JP2011525734A (en) 2011-09-22
WO2009150682A3 (en) 2010-02-25

Similar Documents

Publication Publication Date Title
EP2891296B1 (en) Systems and methods for sharing data among multiple end user devices
CN101185007B (en) Upload security scheme
US8315607B2 (en) Method and system for filtering incoming messages to a mobile device
US8909810B2 (en) Systems and methods for multimedia content sharing
US20140351356A1 (en) Enhanced privacy and control features for an electronic message
US6230187B1 (en) Data transmission/reception apparatus and computer program product
US20110183651A1 (en) System and method for requesting, retrieving and/or associating contact images on a mobile device
US20050289216A1 (en) Providing personalized services for mobile users
JP6143973B2 (en) Reply method, apparatus, terminal, program, and recording medium for incoming call
US20080263168A1 (en) Information processing apparatus, information processing method, and computer readable information recording medium
US20110025858A1 (en) Method, apparatus, and system for adding functionality to a digital camera
US20110019007A1 (en) Method, apparatus and method for adding functionality to a digital camera
WO2016023378A1 (en) Method and device for storing information about contact person
CN107071143A (en) Management method and device, the terminal of a kind of image
EP1372327A1 (en) System and method for transferring information between telecommunications equipments
WO2009150682A2 (en) Real time saving techniques of photographs taken by means of the cell phone camera
CN107566247B (en) Method, device and storage device for publishing friend circle on electronic map
JP2008193197A (en) Moving picture distribution server
JP2003198627A (en) Method for processing notification and notification processing program
CN106027383A (en) Portable electronic device and content release method for portable electronic device
WO2012041216A1 (en) Portable electronic device, content publishing method, and prompting method
CA2805786C (en) Tagging instant message content for retrieval using mobile communication devices
EP2120420B1 (en) Method, device and communication system for managing adress data
CN103841214B (en) Portable electronic equipment
KR100601571B1 (en) Method For Received Message Managing In The Mobile Communication Terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09762189

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2011513116

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02/05/11)

122 Ep: pct application non-entry in european phase

Ref document number: 09762189

Country of ref document: EP

Kind code of ref document: A2