Description
Real time saving techniques of photographs taken by means of the cell phone camera
Technical field
The present invention generally refers to the field of new services for mobile use on cell phones, more in particular it refers to an application which allows saving (uploading) data in an immediate but secure manner. Still more specifically, this data is constituted by the photographs which are taken with a portable/cell phone.
Background art
Key
BSC Base Station Controller GMSC Gateway Mobile Switching Center
GSM Global System For Mobile Communications
GPRS General Packet Radio Service
HLR Home Location Register
MSC Mobile Switching Center PDA Personal Digital Assistants
SIM Subscriber Interface Module
VLR Visitor Location Register
UMTS Universal Mobile Telecommunication System
The mobile telephone technologies advance so as to provide increasingly diversified multimedia settings and to enrich the mobile devices (cell phones) with new services.
A fundamental, distinguishing event of such evolution is the close connection between the mobile device and the Internet network, along with the arrival of mobile devices (cell phones or PDA) with multimedia functionalities.
The most recent versions of mobile devices (such as cell phones, PDA, portable
computers and another other type of portable terminal) operate with the most standard multimedia functions, including the capacity to receive email and acquire or forward information by means of the Internet. Among these services, that of storing content such as photographs and photographic shots should certainly be noted.
On one hand, the interaction models for the network operators with reference to cellular phones enabled for the services of the third generation (3G) by means of servers and other devices provide for increased connection speed, a wider band for the mobile services based on various technologies which refer to GPRS, GSM, EDGE, UMTS.
Among the multiple services which are supported by such protocols, in addition to the presence of the SMS, the MMS multimedia message service should also be indicated. The MMS services, for example, are Store and Forward message type services capable of adding multimedia elements to the SMS, such as images, texts and audio.
The new generation of the M-Services overcomes the paradigm and the limitations of traditional messaging, since it is possible - with the MMS telephones - to send a multimedia message which can arrive in sizes on the order of tens or hundreds of Kbytes. The principle on which the MMS is currently based is that of sending the message both to a cell number and to an email address; a suitable server inserted in the operator network (called MMS-C or Multimedia Messaging Service Centre) deals with properly transcoding the sent message, so to make it comprehensible both to the electronic mail server and to the mobile telephone user. The MMS can be seen as a new message type defined at the "border" between
Internet and telecommunications, since on one hand the users are connected to the cellular telephone network while on the other hand the servers are interconnected with the Internet.
In summary, it can be considered that the sending and delivery of a MMS message provides for the following steps: a) the user writes his message by putting together texts, sounds and images - hence also a photograph - with the composer of the mobile terminal; b) he then inserts the recipients and sends the messages; c) the cell phone automatically carries out a WAP connection towards the operator service center (MMS-C) and the message is transferred from the telephone to the central server only in this step; d) the MMS-C server, interpreting the list of recipients of the message, provides for carrying out the appropriate transcoding (conversion into e-mail) and to signal the recipient (cell phone) with a "push" message (this is not the original message, but a notice which informs of the presence of a new message MMS); even if specifically dedicated to the sending of images by a mobile cell phone user, the MMS tool is clearly not very practical for operating an interactive saving of the photograph just captured on a virtual disc on the web.
In order to have the cell phone world work together with the Internet network, a series of solutions have been proposed - in any case characterized by being rather complicated and not immediate - with regard to the mode with which domain names are attributed to the service centers for the related transit and saving of a photograph on the www.
For example, the patent US 20050102381 deals with the problem of saving data on a dedicated server through the Internet network, in particular considering the problem of security on the basis of pre-established user access rights and based on a series of preset parameters established by the user himself. It is clear that the problem is complex and does not have a quick solution, but what results extremely difficult and ineffective here is the fact that such "secure" saving of the photographs taken by means of the cell phone camera would depend on the particular cell phone or even on the relative keyboard.
At the same time, there arises the need to manage such acquisition activity of such photographs in a quick and effective manner.
In fact, in the current PDA, rather complex paths are usually present for sending a mail by means of the cellular network, through cascade menus with selections that in reality are not interactive, and which in any case delay the saving of the photographic shot after the taking thereof.
A potentially effective tool is certainly the sending to a Web server of an email with the related attachment composed of the just-shot photograph. But here too path is extremely tortuous and difficult for a user who has little experience with electronic devices. The typical example can be the following, taken from the manual of a
Mitsubishi cell phone model.
From the Mail submenu:
Composition of an e-mail
Select "write mail" or press cc. Choose Subject.
Press OK and insert text in the message header (maximum 30 characters).
Press OK
Choose A: 1.
Press OK and select one of the names available from the displayed list or select other , then type the mail address or the telephone number required.
Press OK
Choose Message
Press OK and insert message text (maximum 10 Kb). Press OK.
Choose II attached field if it is desired to add a musical melody or an image to the message.
Press OK.
Then select images or ringer melodies for choosing one of the available files.
Press OK.
Slide downward until choosing SEND (for sending the message) or SAVE (for storing the message in the draft folder) and select OK to confirm the selection. During the writing of the message, it is possible to access the Edit menu at any moment by selecting an icon (press the call key).
The complexity of execution and the consequent loss of interactivity in sending photographs are quite clear from the above example.
The fundamental object of the invention is that of carrying out the storage in real time, in an interactive manner, with the remote memory constituted by the data server. The image, which was taken at a certain instant, is by default sent to and stored at such data server through a minimized path, in a top down menu on the cell phone screen.
A further object of this invention, as fully described below, is that of providing a network architecture in which registration means are comprised in order to implement the immediate arid effective interactive upload principle. In case of content sharing, the problem of the subsequent, effective retrieval of that stored will also be solved, linked to the randomness with which such savings are carried out. This keeping in mind that the invention is based on the observation that there is the clear need to carry out an immediate and interactive saving, and that
described below simultaneously refers to such two objectives. On such basis, the saving technique is implemented in a manner such that the immediate content sharing occurs without restrictions being set, such as the number of continuously saved photographs. Finally, object of the present invention is that of providing real time saving techniques of the photographs taken by means of the cell phone camera, which employs network protocols and standard devices in the sphere of telecommunications, in order to provide a general and easy-to-use applicability solution. These and other objects which will be clearer during the description are obtained by means of the real time saving procedures of the photographs taken by means of the cell phone camera, whose essential functioning principles are set forth in claim 1.
Disclosure of invention
According to the finding of the present invention, the sender uses emails as transport mechanism of the content to be saved. The sender identifies, at the server, the account to which the upload message is intended, indicating it in the email address. Then, the server correlates the email address of the sender with the account associated with the user himself.
The relative implementations regard a server which is in communication with a plurality of mobile devices. In the following example, the mobile devices are usually cell phones provided with cameras and the "content" to be saved is a photograph or even a short film.
The cell phone identification is the telephone number itself (the SIM card) assigned by the operator of the network services. In such case, the IP address is combined with the cell phone identification (or relative
SIM) in the message which is sent for the saving, such that the set procedures carry out the extraction of the header identifications of the sent message so to obtain both the IP address and the cell phone identification.
As is usually expected from all cell phones with telecamera, the photographs can still be optionally saved on an identification card, such as SIM (Subscriber Interface Module) or any other type of smart card or integrated chip or on a mobile device memory. But according to the new functionality, the automatic saving mechanism (more in general automatic downloading) is activated at the very moment when the photograph is taken by the mobile phone or by other devices immediately after the actual shot, so that the user in possession of the cell phone is immediately asked if he would like to send the acquired image to a storage system. If the user chose to take advantage of such service, the photograph is automatically sent to a receiving server on the basis of the modes prearranged at the time of the definition of the real time saving and cataloguing service. For this reason, a typical embodiment of the invention comprises:
- management procedures of the original information (the photograph situated on the cell phone with the telecamera) in order to prearrange its sending (a SIM is essentially associated with such cell phone for accessing a GSM, GPRS, or UMTS service);
- a data server configured for being interfaced with said first device, user side, on a mobile telephone network, and
- a procedural application configured, server side, for enabling the data server to: - i) receive and store the photographs in dedicated folders,
- ii) retrieve information/photographs stored in the archives of the data server, through the mobile network following the interconnection between the user device and the data server.
The achievement of the invention also provides systems, procedures and devices which allow automatically saving and organizing the photographs taken by means of cell phone in predefined concatenated lists.
Brief description of drawings
For mere exemplifying purposes and without wishing to limit the generality and possible fields of application, a preferred embodiment of the invention is described below with reference to the attached Figures, in which:
FIGURE 1 shows a schematic representation of the telephone network architecture which achieves the finding according to the present invention;
FIGURE 2 is a schematic representation of the photograph send menu with the plurality of selectable email addresses.
Best mode for carrying out the invention
The approach described above can be implemented with a data processing system (a computer) 10 provided with storage means, on which a program is active with a code dedicated to the effective and structured saving operations. In this implementation, the application is divided into three sections, one part arranged on the server side, a second part which is operative on the client side - the cell phone - and a third part which is active on the mobile telephone network. A system which provides the saving of the data in real time comprises the server 10, a plurality of mobile devices 8, a mobile telephone network 6, the Internet services 7, and a series of gateways 9 through which the data server communicates with the mobile devices. The server-side program 10 comprises the codes which ensure that the operations are executed for identifying, accessing and setting of the parameters so that the user can conduct an effective search for the photograph, in addition to ensuring the interactivity in response to the situations in which the server receives the email with the photograph to be saved from the cell phone.
According to the present invention, when the user captures an image, for example by pressing the key set on the cell phone, the camera of the cell phone itself sends the image in real time through the wireless connection to the data server, so that it is
stored as an image file. Of course, it is still provided that the telecamera of the cell phone can alternatively locally store the image and send it to the data server at a later time, on the basis of a selection on the menu and due to a subsequent command. However, the default operation provides that the priority procedure automatically sends the photograph according to that provided below.
The telecamera of the cell phone can code the data relative to the image, for example in JPEG format, or the data server can itself decode the data of the image after reception, or the data of the image can remain in the original format even in the data server. The use is provided of complementary reverse processes, in which the cell phone which has per se a display allows the user to see the photograph on the display. In this manner, the user can see the image which was previously stored, or see the image before the latter is sent to storage (i.e. the image is stored by the cell phone but has not yet been selected for being stored by the user). When the user wishes to review an image that was stored on the server, with the cell phone, he connects to the server and requests the available image files. The cell phone then shows the server's response to the user, in fact in response to a user selection the cell phone transmits the image file request to the data server and the server - having retrieved the requested data - sends the relative file to the cell phone by means of the mobile connection. The cell phone receives the file requested from the server and shows the image stored in the file, decoding the file and showing the image on the display.
Whether one once again accesses through mobile telephones, or one accesses through Internet, for example from home with the PC, the search of one's photograph archive is carried out by the user by means of indices, i.e. trees/directories which by starting from macro-classifications (such as the date - DDMMYY hour minute and second -, site, subject of the photograph etc.) allow carrying out advanced searches until the photograph is retrieved.
Indeed, by providing for the presence of about ten general categories (configurable by the user), one can pass to a list of sub-categories, arriving at a narrowed-down list which contains a number of photographs on the order of about ten, displayable with the navigation by means of the normal cell phone keys. In order to implement the interactivity of the saving operations, an initialization operation of the cell phone is in any case necessary, which comprises the setup of the acceptance parameters during saving step. Then, on the cell phone side it is ensured that the user has a prompt for inserting arrival identifications, emitted by the provider, for the photograph saving service with reference to the cell phone (the related SIM) which subscribed a contract for said photograph saving service on the data server. Each message with attached photograph is identified by the particular user account which identifies, at the data server, a dedicated file-saving directory. This email address has the form of a string, such as dir dataserver@gestoredelservizio.it. It is then supposed that, as in Fig. 2, the destination must be for example Paolo Rossi, so then the e-mail is structured as "A: paolorossi@gestoredelservizio.it" and the server related to the loading of the emails identifies the directory in which such photograph must be allocated, on the basis of the sub-string Paolo Rossi. The user is then placed in a condition, as in Fig. 2, to send the photographs to one or more email addresses, for example francesco.rossi@tiscalύ carloimprota@tiscali, rosanna.paoletti@ tiscali.it, etc. or still other emails towards which the photographs related to the user account are loaded.
Once captured, the photograph immediately reappears on the video of the cell phone together with the menu of Fig. 2, in an intermittent manner with the photographs just captured, and after a user-settable Δt for the intermittent display of the photograph/recipient email list, in which the photograph is visible, the photograph itself is sent to the first electronic mail account on the list. In other words, the user can otherwise - by means of pressing one of the provided keys - interrupt and prearrange the sending to another recipient or to several recipients (accounts) at the
same time.
Schematizing with a series of essential instructions, by means of a Php code fragment, the mail send procedure will have a recipient field which comprises a jpg attachment, by means of the function: function mail_attachment ($from, $to, Ssubject, Smessage, $attachment) <? include "mail_attachment.php"; mail_attachment ("utente@gestoreservizio.com", "customer@aol.com", "Your Attachment", "Here is the file to be transmitted", 7var/www/images/my_file.jpg"); ?>
As stated, such functionality in the form of a graphical window would be translated into a choice box of the type reported in Fig. 2. Since the roles of the system components will be established below, we can at the moment discuss the cataloguing procedure of the arriving photographs. Once again, a new saving mode can be macroscopically established by the same user who defines N saving folders of the type Francesco Rossi automobili@ gestoreservizio.it, or Francesco_Rossi_lavoro@gestoreservizio.it or Francesco_Rossi_famiglia@gestore servizio.it etc. On the other hand, the photographs contained in the emails are catalogued in a series of suitable lists or separate folders, for example by date (DDMMYY hour minute and second) or by place and/or by subject of the photograph. In a further embodiment, at the end of the selection process, the user can confirm the choice for placing each photograph in a specific folder, before each of these is automatically configured in the relative directory for future references.
As already noted above, even if that described may appear to be the use of a standard email address for the server data, this is certainly not the normal sending and receiving operation of only ordinary mail. Rather, the email only constitutes a
transport tool, since it is sent to a particular server which then has the essential task of classifying and storing the photographs.
Afterwards, the same photograph, by means of a plurality of links, is allocated in a series of multiple lists. Among such lists, as primary keys, an information group is certainly chosen which is already per se associated with the photographs, so that the user does not have to lose time and interactivity in the sending and saving operation. Among this information, the send date (DDMMYY hour minute and second) of the photograph should of course be considered - such date already present in the same sent email -, so that all the photographs taken on a certain date will form a base organization type.
Another list which can be linked (by the original list of the dates) is a folder which subdivides the various photographs on the basis of standard criteria for a camera, which can be the "subject" characteristic with the portrait, landscape, micro- photography extensions, etc. On the basis of this solution, an analyzer of the photograph content is essentially present at the data server 10. Such analyzer scans the content of each photograph, i.e. it evaluates if there is the physiognomy of a face in the photograph, thus an oval perimeter structure in which eyes, eyebrows etc. are contained so to be able to classify such photograph as a portrait. The relative steps provide the following: - the identification of ovoid contours (front portraits) or trapezoid contours (side portraits) in the photograph,
- the selection of N predefined points characteristic of the human face on the basis of the increased chromatic evidence with respect to others,
- the correlation of a specific group of correlated measurements between the aforesaid identified points, such measurements normalized with respect to a measurement executed between two pre-selected points that are characteristic of the face. Analogously, the dedicated application software can identify, in the scope of the photographs, the fact that reliefs are present with projections such as mountains, or
the sea, or clouds, and these elements can substantially configure the classification of the photograph as a landscape. Such choice does not at all lie outside of reality, since it is supported by a series of recent solutions which are even capable of "adjusting" a portrait or a landscape. In other words, once a person's portrait is recognized in a photograph, it is possible to operate by arranging a facial expression of the person portrayed with a smile, instead of without a smile, or it is possible to operate by removing the red eye effect, etc.
Such photograph manipulation type is clearly indicative of the feasibility of procedures which identify the photograph type, the subject type and on the basis of such identification define a classification by key/multiple list.
In addition to date-based, classification is also provided based on other parameters which can be the site from which the photograph was taken and at the same time sent. In fact, it is known that at the time when the photograph is sent, by means of email, the cell in which the same user-owner of the cell phone and relative SIM is operating is present at the HLR of the network operator (at which the owner of the cell phone SIM is subscribed). Essentially, then, at the moment when a photograph is sent by means of email, as a parameter that is implicitly registered and inserted by the network operator (due to the communication between VLR / HLR) there is the site of the VLR cell from which the photograph itself was sent by means of email. This solution type finally allows allocating at the data server 10 - automatically, without the user having to type anything - a possible multiple list 11 linked to the send site. Suppose that the user, a resident of Milan, is on vacation for example in Sardinia: the fact that he is on vacation in Sardinia and takes pictures today at Stintino, another day at Porto Cervo, and on another day at Olbia will ensure that from the logic standpoint, multiple lists are created at the data server on the basis of the site at which such photographs were taken.
The principle is that of logically linking, in several concatenated lists, all the registered photographs which have the same value in the secondary key. Every record
is then extended with an additional field (for example Linksito) intended to contain the pointer having the same value as the secondary key. So that if on one hand a real, physical archive of the photographs is in any case present, on the other hand for carrying out searches one can utilize a pointer logic structure. The effectiveness of the query of the following type is clear: "Display all the landscapes taken at Stintino from 12 - 20 August 2008". The query will be immediately met by means of the intersection of the corresponding three sets of the primary key (Photograph save date) and of the secondary keys ("Site" where the photographic shot was taken and "subject" captured in the photograph itself). The importance of the effective classification should be pointed out: anyone is capable of keeping a desk ordered or without piles of paper, setting aside the documents which arrive one after the other - the problem will then be effectively and thus quickly retrieving such documents when they are requested. The transportation protocol of the emails is well-known to be SMTP, which is used for the transfer of the mail in the PC sphere. The SMTP protocol is in fact a server to server protocol so that other applications are used for the delivery and access to the messages.
The local host 8 (of the sender) must in any case be identified by an IP address at the time of the sending. As stated, when a mail is sent to the server saving the photographs, the mobile telephone number and the domain which belong to the sender are automatically part of the field "From:" of the IP address which accompanies the loading message.
Since the destination is then known, the email is sent by the cell phone 18 to the server 10, i.e. to the photograph service of the data server. On this path to the server 10, the email with the photograph is transported by means of the operator network and is first transmitted to a user-side server 12 which constitutes a SMTP interface. The SMTP interface then sends the messages to the server 10 set for the actual saving of the photographs.
After the message with photograph arrives on the server, the identification is extracted, i.e. Paolo Rossi, from the destination email address. The telephone number of the sender is simultaneously acquired as source identification of the photograph- message. The telephone number and the mail address of the recipient are then used for evaluating if the user has the permission to load the incoming photographs. As described, other information is acquired from the network manager, such as the date (DDMMYY hour minute and second) of the mail sending and the site VLR from which the sending arrives.
Industrial applicability
The principle is clear according to which an event is activated on the cell phone in a simple and interactive - or "user-friendly" - manner starting from the choice/option which provides for the taking of the photograph, in the sense that the user in order to carry out the saving does not have to be connected to a telephone number, activate a connection, exchange voice messages or type online selections on the keyboard, request password or access codes, respond with password or access codes known to him as subscriber of the SIM contract etc.
The specification that the two photograph taking and sending steps automatically take place on request coming from the mobile telephone should be intended as a definition of a process executed without user control. Once the photograph is taken, in fact, the user does not intervene for modifying the sequence of the steps or the progress of the saving or restoring process. Such procedure definition is characterized by considerable simplicity and quick functioning; moreover, such characteristic is extremely advantageous in applications in which, for example, direct storage is provided of the photograph exceeding that which can be stored in the telephone (investigative or judicial research).
The clear advantage will be noted for storing images on the data server, as the user does not have to worry about physically allocating the photographic shots or the
locally removable means for storing the images.
The finding thus resolves the problems pertaining to the onsite storage and processing of the photographs. The system according to the invention can assist in the integration related to the services provided by the generic mobile network operator. The information exchange between users on the network is in fact automated. The updates referred to the data stored on a movable device can be obtained in an automatic manner or with a manual input based on the menu choices.
There is also the advantage deriving from the fact that the saved photographs can be recovered even if the cell phone is lost by the user owning such phone. Further configurations of the invention can easily provide the implementations for the auto-exchange of photographs between two mobile telephones with a call which automatically activates the sending of the photographs to a data server or to another telephone.