WO2004008308A2 - Editing image for delivery over a network - Google Patents

Editing image for delivery over a network Download PDF

Info

Publication number
WO2004008308A2
WO2004008308A2 PCT/US2003/022017 US0322017W WO2004008308A2 WO 2004008308 A2 WO2004008308 A2 WO 2004008308A2 US 0322017 W US0322017 W US 0322017W WO 2004008308 A2 WO2004008308 A2 WO 2004008308A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
maximum
area
metadata
presentation
Prior art date
Application number
PCT/US2003/022017
Other languages
French (fr)
Other versions
WO2004008308A3 (en
Inventor
Einar Breen
Original Assignee
Device Independent Software, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Device Independent Software, Inc. filed Critical Device Independent Software, Inc.
Priority to AU2003249237A priority Critical patent/AU2003249237A1/en
Publication of WO2004008308A2 publication Critical patent/WO2004008308A2/en
Publication of WO2004008308A3 publication Critical patent/WO2004008308A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577Optimising the visualization of content, e.g. distillation of HTML documents

Definitions

  • the present invention relates to methods and systems for prepa ⁇ ng, adapting and delivering data over a network More specifically, pieferred embodiments of the invention relates to piepa ⁇ ng, adapting and delivering presentation pages containing text, images, video, or other media data to devices over a network based at least in part on media content, delivery context and presentation context
  • transcoder software can detect some of the characteristics of the delivery context The content is then transformed and adapted to these characteristics
  • One advantage with transcoder software is that adding support for new devices often is less resource demanding than compared to solutions with multiple scripts supporting different channels All implementations of a transcoder can usually use the same softwaie upgrade
  • transcoders often lack important information about the content
  • Some transcoders detect some information about how the content should be adapted, often referred to as transcoding hints, but if the content is created for one media-channel, there is limited data and alternatives available necessary for a high quality adaptation to very different media-channels
  • the aspect of the presentation context is not handled efficiently
  • Some tianscoders only handle merged input data where content and design (the presentation context) are mixed, 1 e HTML pages designed for a desktop computer The problem with this solution is that the transcodei lacks infoimation about how the graphical designer would like the
  • Image editing or drawing software often include a layer featuie (l e Adobe PhotoShop and Adobe Illustrator) which enable a graphical designer to apply oi edit image elements in one layer without affecting image elements in other layers
  • Layers are basically a means of organizing image elements into logical groups In most software with the layers feature, the designer can choose to show or hide each layer
  • the piesent invention provides a method and an apparatus foi adaptation of pages with text, images and video content to the characteristics and within the capabilities of the presentation context, detected dehveiy context and the content itself
  • the present invention also provides an apparatus, with a graphical user interface, for preparation of images or video for adaptation by creating metadata profiles describing the characteristics and limitations for the images or video
  • references to "the piesent invention” refer to preferred embodiments thereof and are not intended to limit the invention to stnctly the embodiments used to illustrate the invention in the written description
  • the present invention is able to provide a method and an apparatus implementing the method so as to enable the adaptation process when adapting original images to optimized images (media content) This is achieved by cieating metadata profiles for the detected dehveiy context, the presentation context and the o ⁇ ginal image
  • the adaptation process pei forms a content negotiation between these three metadata profiles and then converts the o ⁇ ginal image accoiding to the results fiom the content negotiation
  • the result is an optimized image, adapted to the present situation
  • the adaptation apparatus can be compared to two alternate technologies Multiple authoring (cieating seveial veisions of each image targeting different media-channels) and transcoding
  • a version of an image developed for one media-channel will be a compromise of the lowest common denominators defined for the targeted media-channel
  • the resulting image from multiple authoring will not be optimized to all of the variables involved, 1 e the exact screen size, the bandwidth, the color reproduction etc
  • the adaptation apparatus gives a better user experience since the image is usually optimised to every situation and the graphical designer only has to maintain one version of each image
  • transcoder software is able to detect the characteristics of the delivery context and adapt images to these characteristics
  • existing transcoders does not handle images with a manually created metadata profile
  • This metadata profile contains information determined by a graphical designer This information is necessary if a transcoder for example shall ciop the image gracefully
  • the result is an adaptation process where the images presented on the device is better adapted based on the intent of the graphical designer
  • the adaptation process involving cropping and scaling down to minimum detail level or minimum view size enables automatic cropping and scaling within the limits approved by a giaphical designer (web page designer)
  • the apparatus enables graphical designei s to create metadata profiles foi oiiginal images theieby making the process of preparing images fast and easy to learn As a result, the giaphical designer has more control since the impact the settings have on the image is displayed
  • the method for caching improves the performance of the adaptation apparatus by reducing the number of adaptation processes being executed
  • a method for caching optimized or intermediate presentation data is also described This method improves the performance of the apparatus performing the adaptation process and thereby reduces or eliminates the performance loss that often takes place when an adaptation process is implemented
  • the systems and methods allows for the creation and editing of the metadata profile for the original image
  • This appaiatus is software with a graphical user interface and can typically be integrated in image editing software
  • the metadata profile describes the characteiistics of the original image but it also lepiesents the graphical designe s (the person using this apparatus) judgments and conclusions of how the original image should be optimized and what the limitations of the image are
  • the methods involved in optimizing images can also be used to optimize video
  • the mam difference between the metadata profile for an oiiginal video and an original image is that the parameters in the metadata profile are related to the video timeline This can change anywhere in the timeline The apparatus's must then also be changed accordingly BRIEF DESCRIPTION OF THE ILLUSTRATIONS
  • Figure 1 illustrates an exemplary system for piepa ⁇ ng, adapting and delivering media data over a network in accordance with an embodiment of the present invention
  • Figure 2 illustrates an exemplary original image and associated areas in accordance with an embodiment of the present invention
  • Figure 3 illustrates an exemplary flowchart for delivering delivery context in accordance with an embodiment of the present invention
  • Figure 4 illustrates an exemplary flowchart for cropping an image in accordance with an embodiment of the present invention
  • elements may be recited as being “coupled”, this terminology's use contemplates elements being connected togethei in such a way that there may be other components interstitial ly located between the specified elements, and that the elements so specified may be connected in fixed or movable lelation one to the othei
  • Certain components may be described as being "adjacent" to one another In these instances, it is expected that a relationship so characteiized shall be interpreted to mean that the components are located pioximate to one anothei , but not necessanly in contact with each other Normally there will be an absence of other components positioned there between, but this is not a requirement Still furthei, some structural relationships oi onentations may be designated with the word “substantially” In those cases, it is meant that the lelationship or orientation is as described, with allowances for variations that do not effect the cooperation of the so described component or components
  • a user 10 using a usei device 12 accesses a website hosted on one oi moie adaptation apparatuses oi servers 18 via a network 16
  • the usei device 12 can include, but is not limited to, a computer, a mobile telephone, a personal digital assistant (PDA), or any other apparatus enabling humans to communicate with a network
  • the network 16 can include, but is not limited to, the Internet, an Intranet, a local access network (LAN), a wide area network (WAN), or any other communication means that can allow a user device and a sei vei to communicate with one another
  • the one oi more adaptation apparatuses 18 is configuied to run an adaptation process for providing presentation pages to a plurality of different types of devices
  • the adaptation apparatus 18 can comprise one or more servers, be coupled to one or more servers, be coupled to one or more web hosting servers, etc
  • the one or more adaptation apparatuses or servers 18 are configured to provide one or more presentation pages or delivery context 14 to the one or more user devices 12
  • the one or moieshingntation pages can include text, images, video, hyperlinks, buttons, form- fields and other types of data rendeied on a computei screen or capable of being printed on paper
  • the adaptation apparatus 18 includes media content 20, presentation context, and detected delivery context 24
  • the media content 20 includes a media content metadata profile 26 describing the characteristics and limitations of the content, one or more original images 28, and/or other data related to the media content
  • the media content 20 can include rules defining alternatives or adaptation rules
  • the media content metadata piofile 26 can be embedded as part of the content
  • the presentation context 22 is the context in which the media content is transformed into a presentation page, e g , how the media is presented to the user in a presentation page
  • the presentation context 22 includes presentation context metadata profile 30, a style sheet 32, page layout, style, the graphical design, etc
  • a presentation page is defined as a unit of presentation that results fiom a request submitted by the device
  • Presentation page is one type of presentation data
  • Presentation data is the content sent to the device
  • There are often used a combination of different types of presentation data to build up a presentation page for example one item for the text and page structure and other items for images and multimedia content.
  • Presentation format is the standard and the version of the standard used to format an item of presentation data.
  • Common presentation formats for web type presentation data include HTML (HyperText Markup Language) 4.01, HTML 3.2, XHTML (extensible HyperText Markup Language) 1.0 and WML (WAP Markup Language) 1.2.
  • Common presentation formats for images are JPEG (Joint Photographic Expert Group), GIF (Graphical Interchange Format), TIFF (Tag Image File Format) and PNG (Portable Network Graphics).
  • How the presentation data should be presented is determined in the presentation context, i.e., the logic and content of the presentation context is typically implemented as a style sheet, e.g., Extensible Style Language - Formatting Objects (XSL FO), with either embedded or external metadata and rules that defines the rules and limitations for the adaptation of the media content involved.
  • XSL FO Extensible Style Language - Formatting Objects
  • There exist standards used to define content and metadata for presentation context such as XSL-FO. Typical standards are intended to be used when creating multiple media-channels and not one channel that dynamic
  • the detected delivery context 24 represents the user device 12 and the present situation the user 10 is in and includes, at a minimum, detected delivery context metadata profile 34.
  • the delivery context metadata profile 34 describes the characteristics of the present delivery context and can include, but is not limited to, user parameters, device parameters, network parameters, etc.
  • User parameters refer to parameters associated with a given user and can include preferred language, accessibility preferences, etc. Examples of device parameters are screen dimensions of the device, device input capabilities (keyboard, mouse, camera etc.), memory capabilities, etc.
  • the network parameters refer to parameters associated with the connection between the device and the server and can include bandwidth, how the user pays for the connection, physical location of the user, etc.
  • the adaptation apparatus adapts the presentation data for the given device using either cropping or scaling of an original image.
  • the web page designer selects a maximum image area, an optimal cropping area, and a maximum cropping area (e.g., a minimum image that can be displayed). These different screens/views are created using the original image.
  • Preferred embodiments of the present invention aie directed to enable an adaptation of media content, optimizing the content to the characteristics of (he delivery context and presentation context, based on the intentions of the creator of the media content
  • the adaptation process adapts media content to the characteristics and within the limits of the capabilities of the delivery context, presentation context and the media content
  • the process includes at least a content negotiation process and a transcoding process
  • the content negotiation process compares the information in the different metadata profiles and results in a set of parameters that are used as settings for the transcoding process
  • the adaptation process adapts the media content to be optimized presentation data, e g , the delivery context 14
  • Each metadata profiles delivery context, media content, and presentation context can be divided into several smaller profiles or each parameter can be stored sepaiately
  • the metadata profiles can be stoied in any data foimat, I e XML, database, va ⁇ ables in system memory (e g , RAM), etc
  • an exemplary original image and various cropping areas of the image in accordance with an embodiment of the present invention are illustrated
  • the graphical designer can select an image border area 36, a maximum image area 38, an optimum cropping area 40, and a maximum cropping area 42 using a graphical user interface (not shown)
  • the maximum image area 38 is the largest image area that can be displayed
  • the image border area 36 is the maximum image area including a border around the maximum image area 38
  • the bordei does not have to be uniform
  • the optimum cropping area 40 is the prefeired image that the graphical designer prefeis to be lllustiated
  • the optimum cropping area 40 is always ciopped within the limits of the maximum image area is the area
  • the maximum ciopping aiea 42 is the smallest image that the graphical designer elects to be illustrated
  • the maximum cropping area 42 must be located inside the optimum ciopping area 40 The area inside the maximum cropping area 42 is protected, therefore the image within the maximum
  • the graphical designer can select regions of interest (ROI) within an original image
  • ROI regions of interest
  • Each region of inteiest includes, at a minimum, an optimum cropping area 40 and a maximum cropping area 42
  • the regions can be prioritized as well
  • the graphical designer can adjust the level of detail foi an image For example, the graphical designer can select the minimum detail level foi the image boidei aiea 36, the maximum image area 38, the optimum cropping area 40, and the maximum cropping area 42, as well as their alternatives
  • the minimum detail level is stored in the media content metadata profile
  • the graphical designer can set the minimum view size
  • the graphical designer can select the minimum detail level for the image border area 36, the maximum image area 38, the optimum cropping area 40, and the maximum cropping area 42, as well as then alternatives
  • the minimum view size is determined by adjusting the image display size on the screen and determining what the smallest size that an image can be displayed, e g , based on scaling
  • the minimum view size is based on screen size and screen resolution
  • the minimum view size is stored in the media content metadata piofile
  • the user requests media data using the user device at step 50
  • the adaptation apparatus let ⁇ eves the detected delivery context metadata profile describing the characteristics for the detected dehveiy context using methods known in the ait, the media content metadata profile along with the requested original image file, and the presentation context metadata profile along with the image in the stylesheet (1 e available space for this image in the layout for the page) at step 52
  • the adaptation apparatus performs a content negotiation process between the different metadata profiles delivery context, media content and presentation context at step 54
  • the success of the content negotiation is determined at step 56
  • the content negotiation process results in a set of parameteis, e g , dehveiy context, at step 58
  • e g if a limitation is exceeded, e g , if the allowable image size exceeds the size of the maximum cropping area, the content negotiations would fail and
  • the content negotiation process is successful the a copy of the original image file is transformed according to the result parameters from the content negotiation process and the optimized image (dehveiy context) is sent to the user device at step 62, e g , as an HTTP Response
  • the result is an optimized image, ciopped, lesized and adapted to the characteristics of the delivery context according the characteristics of the metadata profile of the presentation context and the original image
  • the user requests media data, e g , an image, uses the usei device at step 60
  • the adaptation apparatus determines the maximum available space for the optimized image at step 74
  • the maximum available space for the optimized image is determined by comparing the delivery context metadata (i e , due to the screen size) and/or the presentation context metadata (I e , if the image must be displayed in a limited area of the page layout)
  • the adaptation apparatus determines the maximum image width and height For example, the maximum available width/height is equal to the maximum available scieen width/height minus the width/height lest ⁇ ction innachntation context gives the maximum image width/height in pixels
  • the maximum available screen width/height is the scieen width/height in pixels minus toolbars, scrollbars, minimum margins, etc This is the width or height in pixels that is available for displaying the image.
  • the width or height restriction in the presentation context is the width or height that is occupied and that is not available for the image. Margins and space occupied by other elements typically determine the width and height restrictions.
  • the width/height of the minimum image area is shorter than the maximum image width/height, the content negotiation fails. Note that the difference in image resolution between the original image and the resolution of the screen of the device (will be used as the resolution of the optimized image) must be a part of this calculation.
  • the optimal cropping area exists, the following approach is used: if the maximum image width/height is longer than the width/height of optimal cropping area, the image width/height is cropped to the width/height of the optimal cropping area; otherwise it is cropped to the maximum image width/height.
  • the optimal cropping area does not exist, the following approach is used instead: if the maximum image width/height is longer than the width/height of maximum image area, the image width/height is cropped to the width/height of the width/height of maximum image area; otherwise it is cropped to the maximum image width/height.
  • the adaptation apparatus determines the necessary cropping at step 76.
  • the adaptation apparatus determines if the necessary cropping exceeds the maximum cropping area at step 78.
  • the content negotiation process results in a set of parameters, e.g., delivery context, at step 80.
  • the adaptation process crops the image as little as possible (as close to the maximum image area as possible).
  • a limitation e.g., if the allowable image size exceeds the size of the maximum cropping area, the content negotiations fail and an exception occurs at step 82.
  • An exception can result in a text message being displayed, an alternate image being displayed, an error message being displayed, etc.
  • the original image file is transformed according to the result parameters from the content negotiation process and the optimized image (delivery context) is sent to the user device at step 84, e.g., as an HTTP Response.
  • the result is an optimized image, cropped, resized and adapted to the characteristics of the delivery context without compromising any limitations and according the characteristics of the metadata profile of the presentation context and the original image.
  • the present invention has been disclosed in terms of images, the same system and method can also be applied to video, e.g., a video stream.
  • the same method for images is used except instead of adapting one still image, the adaptation apparatus adapts a whole sequence of images in a video-stream
  • a set of characteristics in the metadata profile has a reference to a section (a start and end point in the timeline) of the video-stream
  • the content negotiation process is only executed once for each set of characteristics, that is every time the characteristics have a relation to a new section of the video-stream Aftei each content negotiation process, each image in the related section is transformed according to the lesult parameters from the content negotiation
  • Prefe ⁇ ed embodiments of the present invention include a computer program product stored on at least one computer-ieadable medium implementing prefe ⁇ ed methods of the present invention
  • Some embodiments of the invention include an adaptation apparatus for preparing and adapting data for delivery over a network
  • the adaptation apparatus executes the adaptation process when adapting original images to optimized images
  • the presentation context, the delivery context and the content itself have their characteristics and limitations described in metadata profiles
  • the adaptation process performs a content negotiation process where these characteristics are compared and results in a set of parameters These parameters are compromise for the transcoding process if the content negotiation process was successful (no limitations defined in the metadata profile was exceeded) If the content negotiation process is successful the transcoding process will be executed and the optimized output will be delivered to the device
  • maximum image aiea and maximum cropping area are defined
  • the maximum cropping aiea is the same as the size of the oiiginal image if it is not set as a paiameter in the metadata profile foi the oi iginal image
  • the approach for adapting image size, staiting with the maximum image area uses a parameter to determine the priority between rescahng and cropping
  • the targeted size for the optimized image is determined by retrieving available width and height from the delivery context metadata profile and checking the presentation context for limitations regarding available space
  • the maximum amount of cropping is limited by the size of the maximum cropping area, this area is not cropped
  • the minimum amount of cropping is determined by the maximum image size. In prefe ⁇ ed embodiments, the optimized image will always be cropped within the maximum image size area.
  • the metadata profile for the original image also has optimal cropping area defined and process for reducing image size is initiated with the optimal cropping area.
  • the metadata profile for the original image also can have the minimum detail level defined. The minimum detail level sets the limitation for reducing image size using scaling. This method will only apply to the adaptation of bitmap images, not vector graphics.
  • the content negotiation process identifies one group of characteristics to use for the transformation. A group of characteristics where limitations such as the maximum image area or the maximum cropping area or the minimum detail level are exceeded are not be used. If there are several groups of characteristics that could be used the content negotiation process selects one. For embodiments where the metadata profile for the original image also has cropping strategy defined, the method uses the cropping strategy to determine the priority between the amount of cropping of the top, bottom, left and right side.
  • an apparatus and method for adaptation of images to people with low vision uses a preference from the delivery context metadata profile (set to low vision).
  • the original image has a metadata profile where maximum image size and maximum cropping area is defined. The process starts with the maximum cropping area and enlarges (scales-up) the image as much as the available space in the delivery context and presentation context allows.
  • Specific embodiments include manually creating a metadata profile for a still-image (original image) through a graphical user interface.
  • the original image and the metadata profile are used as input.
  • a graphical user interface allows the user to apply a rectangle to identify the maximum cropping area in the image and another rectangle to identify the optimal cropping area in the image and a third rectangle used to define the maximum image area.
  • These embodiments allow the user to apply a rectangle to identify the maximum cropping area in the image and the image borders are used to define the maximum image area.
  • inventions further provide a graphical user interface where the user applies a rectangle to identify the maximum cropping area and another rectangle to identify the optimal cropping area and the image bordei s are used to define the maximum image area
  • the invention allows the user to apply maximum cropping area with related optimal cropping area and maximum image size multiple times in different locations in the same original image In this fashion, the user applies a different priority for each group of maximum cropping aiea, optimal ciopping aiea and maximum image area
  • the system allows maximum ciopping areas with ielated maximum image size multiple times in different locations in the same original image
  • the user applies a diffeient priority for each set of maximum ciopping area and maximum image area - optionally applying several rectangles identifying alternate cropping areas The rectangles identifying alternate cropping areas and where the image borders are one of the cropping alternatives
  • the user can apply several figures identifying regions of interest (ROI) in the oi iginal image
  • ROI regions of interest
  • Each ROI can be defined as mandatoiy or optional If it is optional it may have a priority
  • Embodiments allow the user to set the minimum detail level by viewing how the image resolution changes when adjusting the minimum detail level and allow the user to set the minimum view size by adjusting the image display size on the screen The user determines the smallest size that should be used when the image is displayed The value saved is calculated accoid g to the screen size, the screen resolution and the distance between the usei 's eyes and the scieen as well as the selected minimum view
  • a layer can be hidden when a minimum detail level characteristic is exceeded, and/or when a minimum view size characteristic is exceeded Alternatively, one or more image elements in a vector graphic will be hidden when a minimum detail level characteristic and/or minimum view size characteristic is exceeded
  • Embodiments of the invention include server-side caching of presentation data where each cached item has a media query expression If the media query expression is validated as true against a delivery context metadata profile the cached item is approved for being returned to the device without adaptation
  • Each cached item can have a metadata profile If a content negotiation process comparing the delivery context metadata profile with the cached item metadata piofile is successful the cached item is approved foi being returned to the device without adaptation
  • Wheieshingnation data is in XML format or another markup language (e g HTML) the cached item must be updated with some dynamic data before being returned to the device
  • the presentation data or a cache metadata profile contain metadata indicating the location of where the dynamic data should be inserted, where the dynamic data should be letneved from and the maximum data size allowed for the dynamic data When the cached item is retrieved, the dynamic data is also retrieved and then the data is merged If the dynamic data aie larger than the maximum data size allowed, the dynamic data is adapted to the chai ctens
  • the metadata profile for the original image also has the minimum view size defined
  • the minimum view size sets the limitation for reducing image size using scaling
  • the maximum cropping area is the same as the size of the original image if it is not set as a parameter m the metadata profile for the original image
  • the process for adapting image size, starting with the maximum image area uses a parameter to determine the priority between rescahng and cropping
  • the targeted size for the optimized image is determined by retrieving available width and height fiom the delivery context metadata profile and check the presentation context for limitations regaiding available space
  • the maximum amount of cropping is limited by the size of the maximum ciopping area, this area is not cropped
  • the minimum amount of ciopping is determined by the maximum image size
  • the optimized image is cropped within the maximum image size area In some cases, there is no maximum data size for the dynamic data, but a maximum numbei of charactei s in one or more text strings is used instead of maximum data size
  • the present invention finds applicability in the computer industry and more specifically in webpage hosting where an adaptation apparatus determines one or more presentation pages for displaying on one or more different type of user devices

Abstract

Adapting one or more web pages having text, images and/or video content to the characteristics and within the capabilities of the presentation context (22), delivery context and the content itself. Using a graphical user interface, a graphical designer is able to prepare an image or video by creating metadata profiles (26) describing the characteristics and limitations for the images or videos.

Description

A METHOD AND SYSTEM FOR PREPARING AND ADAPTING TEXT, IMAGES AND VIDEO FOR DELIVERY OVER A NETWORK
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] The current application claims pπonty to Provisional Patent Application Serial No 60/395,610 entitled "A Method and System for Prepaπng and Adapting Text, Images and Video foi Delivery Ovei a Network" filed July 15, 2002, which is incorporated herein by reference in its entirety
BACKGROUND OF THE INVENTION
[0002] Field of the Invention. The present invention relates to methods and systems for prepaπng, adapting and delivering data over a network More specifically, pieferred embodiments of the invention relates to piepaπng, adapting and delivering presentation pages containing text, images, video, or other media data to devices over a network based at least in part on media content, delivery context and presentation context
[0003] Background Information. As the popularity of the Internet continues to rise, the number of different types of devices that can access the Internet continue to πse as well Traditionally, people have accessed the Internet using only personal computers For example, today, more and moie mobile telephones are providing Internet access As a result, providing suitable lnfoimation to these devices is becoming more difficult For example, someone accessing the Internet using a mobile telephone cannot receive the same information that is available using a personal computer due to vanous reasons including screen dimensions, lesolution, color capability, etc
[0004] One approach to solve this problem is to cieate multiple veisions, also refeired to as media-channels, of the content oi create multiple scripts, tailored to different usei devices The display capabilities of a peisonal computer and a mobile telephone can greatly vary Even the display capabilities of mobile telephone vary not only between mobile telephone manufacturers, but also between telephone models Thus, providing multiple versions for each of the possible devices is not practical Moreover, as new devices or models enter the market, new versions of a website need to be created for these new devices or models
[0005] Another approach to solve this pioblem is to divide media-channels based on different presentation foimats like HTML (HyperText Markup Language), WML (WAP Markup Language) and CSS (Cascading Style Sheets) However the same presentation format is not supported by eveiy different device, for example, different devices have different screen sizes, diffeient input devices, implement diffeient level of support foi a presentation format or use their own proprietary extensions of it The same presentation format can also be accessed using very different connection types Dividing media-channels based on connection types has the same problem since most devices and presentation formats can be used in each type of connection In addition, different software installation and upgrades, software settings and user preferences add additional complexity to the delivery context Since the development required for supporting each media-channel is resource demanding and must be customized for each implementation, it means that most content providers supports only a few media-channels adapted to only the most common denominators Some solutions use software for detecting some characteristics about the delivery context (e g , characteristics related to presentation format, connection type, device and usei preferences) to impiove adaptation and make a channel support more devices
[0006] Another common approach to delivei content to different types of dehveiy contexts today is by using tianscoder software Some transcoder software can detect some of the characteristics of the delivery context The content is then transformed and adapted to these characteristics One advantage with transcoder software is that adding support for new devices often is less resource demanding than compared to solutions with multiple scripts supporting different channels All implementations of a transcoder can usually use the same softwaie upgrade However, transcoders often lack important information about the content Some transcoders detect some information about how the content should be adapted, often referred to as transcoding hints, but if the content is created for one media-channel, there is limited data and alternatives available necessary for a high quality adaptation to very different media-channels Also, the aspect of the presentation context is not handled efficiently Some tianscoders only handle merged input data where content and design (the presentation context) are mixed, 1 e HTML pages designed for a desktop computer The problem with this solution is that the transcodei lacks infoimation about how the graphical designer would like the designed piesentation page to be rendered in a delivery context that is very different for the delivery context it was intended Other tianscoders apply design by using style sheets or scripts This enables developers and designers to create a better design for different media-channels but this technology has the same problems as with cieating several scripts for different media-channels without using transcoder software Moreover, transcoding and adaptation software typically requires additional processing thus resulting in a lower performance
[0007] Images are one of the most difficult types of content to handle when a wide range of diffeient media channels should be suppoi ted When using several scπpts, supporting different media channels, one vei sion of each image is often created for each type of media channel Some solutions also provide seveial versions of each image, created manually or automatically created by image software Then the best image alternative is selected based on information detected about the delivery context Anothei approach is to automatically create a new version of an image foi every session or request, adapted to chaiacteπstics detected about the delivery context The capabilities for this type of image adaptation arehowever very limited since the software has little to no information about the image Thus, a successful cropping of an image often requires a designer's opinion of what parts of the image that could be cropped and what parts that should be protected It is common to provide a text alternative to display when an image could not be presented on a device
[0008] Similarly, video data also suffers from most of the same challenges as images The same implementations are often used as when adapting images In addition many video streaming technologies automatically detect the bandwidth and adapt the frame-size, frame- rate and bit-rate accordingly It is common to provide a still image and/or text alternative that can be used when a video cannot be presented
[0009] Image editing or drawing software often include a layer featuie (l e Adobe PhotoShop and Adobe Illustrator) which enable a graphical designer to apply oi edit image elements in one layer without affecting image elements in other layers Layers are basically a means of organizing image elements into logical groups In most software with the layers feature, the designer can choose to show or hide each layer There also exist other features, other than layers, used to group image elements and edit them individually
[0010] Moreover, there are existing standards used for metadata profiles describing the characteristics and capabilities of a dehveiy context, e g , Composite Capabilities / Preference Profiles (CC/PP) and UAPiof (a CC/PP implementation used in WAP 2 0) There are also seveial common methods used to detect the chaiacteπstics and capabilities of the delivery context These methods can be used to build metadata profiles for delivery context Examples of such methods are using infoimation in HTTP (Hypertext Transfer Protocol) headers, such as the USER_AGENT string (one of the HTTP headers) to identify browser and operating system All characteristics with fixed values can then be retπeved from stored data Another technique is to send scripts that detect browser settings, etc to the client (1 e browser) that are executed client-side with the results being sent back to the server Many characteristics about the network connection can be done by pinging from the server to the client (or using similar methods to test current bandwidth), performing Domain Name Server (DNS) lookup, lookup information about IP addresses The WAP 2 0 documentation also defines new methods used to letπeve complete UAProf piofiles Yet another technique is to define a type of media-channel by choosing a combination of a presentation format (HTML, WML, etc ) and form factor for the device (e g , format for a PDA, desktop computer, etc ) The rest of the parameters aie then assumed by trying to find the lowest common denominators for the targeted devices
[0011] The piesent invention provides a method and an apparatus foi adaptation of pages with text, images and video content to the characteristics and within the capabilities of the presentation context, detected dehveiy context and the content itself The present invention also provides an apparatus, with a graphical user interface, for preparation of images or video for adaptation by creating metadata profiles describing the characteristics and limitations for the images or video
BRIEF SUMMARY OF THE INVENTION
[0012] References to "the piesent invention" refer to preferred embodiments thereof and are not intended to limit the invention to stnctly the embodiments used to illustrate the invention in the written description The present invention is able to provide a method and an apparatus implementing the method so as to enable the adaptation process when adapting original images to optimized images (media content) This is achieved by cieating metadata profiles for the detected dehveiy context, the presentation context and the oπginal image The adaptation process pei forms a content negotiation between these three metadata profiles and then converts the oπginal image accoiding to the results fiom the content negotiation The result is an optimized image, adapted to the present situation
[0013] The adaptation apparatus can be compared to two alternate technologies Multiple authoring (cieating seveial veisions of each image targeting different media-channels) and transcoding
[0014] A version of an image developed for one media-channel will be a compromise of the lowest common denominators defined for the targeted media-channel The resulting image from multiple authoring will not be optimized to all of the variables involved, 1 e the exact screen size, the bandwidth, the color reproduction etc The adaptation apparatus gives a better user experience since the image is usually optimised to every situation and the graphical designer only has to maintain one version of each image
[0015] Some transcoder software is able to detect the characteristics of the delivery context and adapt images to these characteristics However, existing transcoders does not handle images with a manually created metadata profile This metadata profile contains information determined by a graphical designer This information is necessary if a transcoder for example shall ciop the image gracefully The result is an adaptation process where the images presented on the device is better adapted based on the intent of the graphical designer
[0016] The adaptation process involving cropping and scaling down to minimum detail level or minimum view size enables automatic cropping and scaling within the limits approved by a giaphical designer (web page designer) The apparatus enables graphical designei s to create metadata profiles foi oiiginal images theieby making the process of preparing images fast and easy to learn As a result, the giaphical designer has more control since the impact the settings have on the image is displayed
[0017] The method for caching improves the performance of the adaptation apparatus by reducing the number of adaptation processes being executed A method for caching optimized or intermediate presentation data is also described This method improves the performance of the apparatus performing the adaptation process and thereby reduces or eliminates the performance loss that often takes place when an adaptation process is implemented
[0018] The systems and methods allows for the creation and editing of the metadata profile for the original image This appaiatus is software with a graphical user interface and can typically be integrated in image editing software The metadata profile describes the characteiistics of the original image but it also lepiesents the graphical designe s (the person using this apparatus) judgments and conclusions of how the original image should be optimized and what the limitations of the image are
[0019] The methods involved in optimizing images can also be used to optimize video The mam difference between the metadata profile for an oiiginal video and an original image is that the parameters in the metadata profile are related to the video timeline This can change anywhere in the timeline The apparatus's must then also be changed accordingly BRIEF DESCRIPTION OF THE ILLUSTRATIONS
[0020] In the following, the present invention is described in greatei detail by way of examples and with reference to the attached drawings, in which
[0021] Figure 1 illustrates an exemplary system for piepaπng, adapting and delivering media data over a network in accordance with an embodiment of the present invention,
[0022] Figure 2 illustrates an exemplary original image and associated areas in accordance with an embodiment of the present invention,
[0023] Figure 3 illustrates an exemplary flowchart for delivering delivery context in accordance with an embodiment of the present invention, and
[0024] Figure 4 illustrates an exemplary flowchart for cropping an image in accordance with an embodiment of the present invention
DETAILED DESCRIPTION OF THE INVENTION
[0025] As requned, detailed embodiments of the piesent invention are disclosed herein However, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms The figures are not necessarily to scale, and some featuies may be exaggerated oi minimized to show details of particular components Therefore, specific structural and functional details disclosed herein are not to be interpieted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present invention
[0026] Moreover, elements may be recited as being "coupled", this terminology's use contemplates elements being connected togethei in such a way that there may be other components interstitial ly located between the specified elements, and that the elements so specified may be connected in fixed or movable lelation one to the othei Certain components may be described as being "adjacent" to one another In these instances, it is expected that a relationship so characteiized shall be interpreted to mean that the components are located pioximate to one anothei , but not necessanly in contact with each other Normally there will be an absence of other components positioned there between, but this is not a requirement Still furthei, some structural relationships oi onentations may be designated with the word "substantially" In those cases, it is meant that the lelationship or orientation is as described, with allowances for variations that do not effect the cooperation of the so described component or components
[0027] Referring to Figure 1, a schematic diagram of the system in accordance with an exemplary embodiment of the present invention is illustrated As shown, a user 10 using a usei device 12 accesses a website hosted on one oi moie adaptation apparatuses oi servers 18 via a network 16 The usei device 12 can include, but is not limited to, a computer, a mobile telephone, a personal digital assistant (PDA), or any other apparatus enabling humans to communicate with a network The network 16 can include, but is not limited to, the Internet, an Intranet, a local access network (LAN), a wide area network (WAN), or any other communication means that can allow a user device and a sei vei to communicate with one another The one oi more adaptation apparatuses 18 is configuied to run an adaptation process for providing presentation pages to a plurality of different types of devices The adaptation apparatus 18 can comprise one or more servers, be coupled to one or more servers, be coupled to one or more web hosting servers, etc
[0028] The one or more adaptation apparatuses or servers 18 are configured to provide one or more presentation pages or delivery context 14 to the one or more user devices 12 The one or moie piesentation pages can include text, images, video, hyperlinks, buttons, form- fields and other types of data rendeied on a computei screen or capable of being printed on paper As shown, the adaptation apparatus 18 includes media content 20, presentation context, and detected delivery context 24
[0029] The media content 20 includes a media content metadata profile 26 describing the characteristics and limitations of the content, one or more original images 28, and/or other data related to the media content The media content 20 can include rules defining alternatives or adaptation rules The media content metadata piofile 26 can be embedded as part of the content
[0030] The presentation context 22 is the context in which the media content is transformed into a presentation page, e g , how the media is presented to the user in a presentation page The presentation context 22 includes presentation context metadata profile 30, a style sheet 32, page layout, style, the graphical design, etc A presentation page is defined as a unit of presentation that results fiom a request submitted by the device Presentation page is one type of presentation data Presentation data is the content sent to the device There are often used a combination of different types of presentation data to build up a presentation page, for example one item for the text and page structure and other items for images and multimedia content. Presentation format is the standard and the version of the standard used to format an item of presentation data. Common presentation formats for web type presentation data include HTML (HyperText Markup Language) 4.01, HTML 3.2, XHTML (extensible HyperText Markup Language) 1.0 and WML (WAP Markup Language) 1.2. Common presentation formats for images are JPEG (Joint Photographic Expert Group), GIF (Graphical Interchange Format), TIFF (Tag Image File Format) and PNG (Portable Network Graphics). How the presentation data should be presented is determined in the presentation context, i.e., the logic and content of the presentation context is typically implemented as a style sheet, e.g., Extensible Style Language - Formatting Objects (XSL FO), with either embedded or external metadata and rules that defines the rules and limitations for the adaptation of the media content involved. There exist standards used to define content and metadata for presentation context, such as XSL-FO. Typical standards are intended to be used when creating multiple media-channels and not one channel that dynamically adapts to all of the characteristics of the delivery context.
[0031] The detected delivery context 24 represents the user device 12 and the present situation the user 10 is in and includes, at a minimum, detected delivery context metadata profile 34. The delivery context metadata profile 34 describes the characteristics of the present delivery context and can include, but is not limited to, user parameters, device parameters, network parameters, etc. User parameters refer to parameters associated with a given user and can include preferred language, accessibility preferences, etc. Examples of device parameters are screen dimensions of the device, device input capabilities (keyboard, mouse, camera etc.), memory capabilities, etc. The network parameters refer to parameters associated with the connection between the device and the server and can include bandwidth, how the user pays for the connection, physical location of the user, etc. There exist several methods known in the art for detecting characteristics for the delivery context.
[0032] In order to provide images to a variety of different devices, the adaptation apparatus adapts the presentation data for the given device using either cropping or scaling of an original image. During creation of the presentation page, the web page designer selects a maximum image area, an optimal cropping area, and a maximum cropping area (e.g., a minimum image that can be displayed). These different screens/views are created using the original image. [0033] Preferred embodiments of the present invention aie directed to enable an adaptation of media content, optimizing the content to the characteristics of (he delivery context and presentation context, based on the intentions of the creator of the media content The adaptation process adapts media content to the characteristics and within the limits of the capabilities of the delivery context, presentation context and the media content The process includes at least a content negotiation process and a transcoding process The content negotiation process compares the information in the different metadata profiles and results in a set of parameters that are used as settings for the transcoding process The adaptation process adapts the media content to be optimized presentation data, e g , the delivery context 14
[0034] Each metadata profiles delivery context, media content, and presentation context can be divided into several smaller profiles or each parameter can be stored sepaiately The metadata profiles can be stoied in any data foimat, I e XML, database, vaπables in system memory (e g , RAM), etc
[0035] Referring to Figure 2, an exemplary original image and various cropping areas of the image in accordance with an embodiment of the present invention are illustrated As shown, the graphical designer can select an image border area 36, a maximum image area 38, an optimum cropping area 40, and a maximum cropping area 42 using a graphical user interface (not shown) The maximum image area 38 is the largest image area that can be displayed The image border area 36 is the maximum image area including a border around the maximum image area 38 As shown, the bordei does not have to be uniform The optimum cropping area 40 is the prefeired image that the graphical designer prefeis to be lllustiated The optimum cropping area 40 is always ciopped within the limits of the maximum image area is the area The maximum ciopping aiea 42 is the smallest image that the graphical designer elects to be illustrated The maximum cropping area 42 must be located inside the optimum ciopping area 40 The area inside the maximum cropping area 42 is protected, therefore the image within the maximum cropping area 42 cannot be cropped In this example, the maximum ciopping area 42 includes a female modeling a jacket In the preferred embodiment, the giaphical designei only has to select a maximum image area 38 and a maximum cropping area 42 The image border aiea 36, maximum image area 38, optimum cropping area 40, and maximum cropping area 42 are stoied within the media content metadata profile 26 [0036] In the preferred embodiment, the graphical designei can select multiple maximum image areas 38, e g , alternative maximum image areas When there are multiple maximum image areas 38, the giaphical designei can pπoi itize them Similai ly, the graphical designer can select multiple optimum ciopping aieas 40, e g , alternative ci opping areas, and can prioritize them Similarly, the graphical designer can select maximum cropping areas 42, alternative maximum cropping aieas, and prioritize them as well The alternative maximum image areas, alternative cropping areas and alternative maximum cropping area, as well as the respective priorities, are created using the graphical user interface and are stored with the media content metadata profile 26
[0037] Using the giaphical user interface, the graphical designer can select regions of interest (ROI) within an original image Each region of inteiest includes, at a minimum, an optimum cropping area 40 and a maximum cropping area 42 The regions can be prioritized as well
[0038] In the preferred embodiment, using the graphical user interface, the graphical designer can adjust the level of detail foi an image For example, the graphical designer can select the minimum detail level foi the image boidei aiea 36, the maximum image area 38, the optimum cropping area 40, and the maximum cropping area 42, as well as their alternatives The minimum detail level is stored in the media content metadata profile
[0039] In the preferred embodiment, using the graphical user interface, the graphical designer can set the minimum view size The graphical designer can select the minimum detail level for the image border area 36, the maximum image area 38, the optimum cropping area 40, and the maximum cropping area 42, as well as then alternatives The minimum view size is determined by adjusting the image display size on the screen and determining what the smallest size that an image can be displayed, e g , based on scaling The minimum view size is based on screen size and screen resolution The minimum view size is stored in the media content metadata piofile
[0040] Refeiπng to Figuie 3, an exemplary flowchart for delivering delivery context in accoi dance with an embodiment of the piesent invention is lllustiated As shown, the user requests media data using the user device at step 50 The adaptation apparatus letπeves the detected delivery context metadata profile describing the characteristics for the detected dehveiy context using methods known in the ait, the media content metadata profile along with the requested original image file, and the presentation context metadata profile along with the image in the stylesheet (1 e available space for this image in the layout for the page) at step 52 The adaptation apparatus performs a content negotiation process between the different metadata profiles delivery context, media content and presentation context at step 54 The success of the content negotiation is determined at step 56 Preferably, the content negotiation process results in a set of parameteis, e g , dehveiy context, at step 58 However, if a limitation is exceeded, e g , if the allowable image size exceeds the size of the maximum cropping area, the content negotiations would fail and an exception occurs at step 60 An exception can result in a text message being displayed, an alternate image being displayed, an error message being displayed, etc
[0041] When the content negotiation process is successful the a copy of the original image file is transformed according to the result parameters from the content negotiation process and the optimized image (dehveiy context) is sent to the user device at step 62, e g , as an HTTP Response The result is an optimized image, ciopped, lesized and adapted to the characteristics of the delivery context according the characteristics of the metadata profile of the presentation context and the original image
[0042] Referring to Figure 4, an exemplary flowchart for cropping an image in accordance with an embodiment of the present invention is illustrated As shown, the user requests media data, e g , an image, uses the usei device at step 60 The adaptation appaiatus letiieves the detected delivery context metadata profile describing the chaiacteπstics foi the detected delivery context using methods known in the art, the media content metadata profile along with the requested original image file, and the presentation context metadata profile along with the image in the style sheet (I e. available space for this image in the layout for the page) at step 72. The adaptation apparatus determines the maximum available space for the optimized image at step 74 The maximum available space for the optimized image is determined by comparing the delivery context metadata (i e , due to the screen size) and/or the presentation context metadata (I e , if the image must be displayed in a limited area of the page layout)
[0043] To determine the maximum available space, the adaptation apparatus determines the maximum image width and height For example, the maximum available width/height is equal to the maximum available scieen width/height minus the width/height lestπction in piesentation context gives the maximum image width/height in pixels The maximum available screen width/height is the scieen width/height in pixels minus toolbars, scrollbars, minimum margins, etc This is the width or height in pixels that is available for displaying the image. The width or height restriction in the presentation context is the width or height that is occupied and that is not available for the image. Margins and space occupied by other elements typically determine the width and height restrictions. If the width/height of the minimum image area is shorter than the maximum image width/height, the content negotiation fails. Note that the difference in image resolution between the original image and the resolution of the screen of the device (will be used as the resolution of the optimized image) must be a part of this calculation.
[0044] If the optimal cropping area exists, the following approach is used: if the maximum image width/height is longer than the width/height of optimal cropping area, the image width/height is cropped to the width/height of the optimal cropping area; otherwise it is cropped to the maximum image width/height.
[0045] If the optimal cropping area does not exist, the following approach is used instead: if the maximum image width/height is longer than the width/height of maximum image area, the image width/height is cropped to the width/height of the width/height of maximum image area; otherwise it is cropped to the maximum image width/height.
[0046] The adaptation apparatus determines the necessary cropping at step 76. The adaptation apparatus determines if the necessary cropping exceeds the maximum cropping area at step 78. Preferably, the content negotiation process results in a set of parameters, e.g., delivery context, at step 80. The adaptation process crops the image as little as possible (as close to the maximum image area as possible). However, if a limitation is exceeded, e.g., if the allowable image size exceeds the size of the maximum cropping area, the content negotiations fail and an exception occurs at step 82. An exception can result in a text message being displayed, an alternate image being displayed, an error message being displayed, etc.
[0047] When the content negotiation process is successful the original image file is transformed according to the result parameters from the content negotiation process and the optimized image (delivery context) is sent to the user device at step 84, e.g., as an HTTP Response. The result is an optimized image, cropped, resized and adapted to the characteristics of the delivery context without compromising any limitations and according the characteristics of the metadata profile of the presentation context and the original image.
[0048] Although the present invention has been disclosed in terms of images, the same system and method can also be applied to video, e.g., a video stream. For video, the same method for images is used except instead of adapting one still image, the adaptation apparatus adapts a whole sequence of images in a video-stream A set of characteristics in the metadata profile has a reference to a section (a start and end point in the timeline) of the video-stream In preferred embodiments, the content negotiation process is only executed once for each set of characteristics, that is every time the characteristics have a relation to a new section of the video-stream Aftei each content negotiation process, each image in the related section is transformed according to the lesult parameters from the content negotiation
[0049] Prefeπed embodiments of the present invention include a computer program product stored on at least one computer-ieadable medium implementing prefeπed methods of the present invention
[0050] Although the present invention has been described and illustrated in detail, it is to be clearly understood that the same is by way of illustration and example only, and is not to be taken as a limitation The spuit and scope of the present invention aie to be limited only by the terms of any claims presented hereafter
[0051] Some embodiments of the invention include an adaptation apparatus for preparing and adapting data for delivery over a network The adaptation apparatus executes the adaptation process when adapting original images to optimized images The presentation context, the delivery context and the content itself have their characteristics and limitations described in metadata profiles The adaptation process performs a content negotiation process where these characteristics are compared and results in a set of parameters These parameters are compromise for the transcoding process if the content negotiation process was successful (no limitations defined in the metadata profile was exceeded) If the content negotiation process is successful the transcoding process will be executed and the optimized output will be delivered to the device
[0052] In some embodiments, maximum image aiea and maximum cropping area are defined The maximum cropping aiea is the same as the size of the oiiginal image if it is not set as a paiameter in the metadata profile foi the oi iginal image The approach for adapting image size, staiting with the maximum image area, uses a parameter to determine the priority between rescahng and cropping The targeted size for the optimized image is determined by retrieving available width and height from the delivery context metadata profile and checking the presentation context for limitations regarding available space The maximum amount of cropping is limited by the size of the maximum cropping area, this area is not cropped The minimum amount of cropping is determined by the maximum image size. In prefeπed embodiments, the optimized image will always be cropped within the maximum image size area.
[0053] In other embodiments, the metadata profile for the original image also has optimal cropping area defined and process for reducing image size is initiated with the optimal cropping area. Further, the metadata profile for the original image also can have the minimum detail level defined. The minimum detail level sets the limitation for reducing image size using scaling. This method will only apply to the adaptation of bitmap images, not vector graphics.
[0054] In yet other embodiments, several groups of related maximum image area, maximum cropping area and possible optimal cropping area characteristics are defined. The content negotiation process identifies one group of characteristics to use for the transformation. A group of characteristics where limitations such as the maximum image area or the maximum cropping area or the minimum detail level are exceeded are not be used. If there are several groups of characteristics that could be used the content negotiation process selects one. For embodiments where the metadata profile for the original image also has cropping strategy defined, the method uses the cropping strategy to determine the priority between the amount of cropping of the top, bottom, left and right side.
[0055] In an alternate embodiment, an apparatus and method for adaptation of images to people with low vision uses a preference from the delivery context metadata profile (set to low vision). The original image has a metadata profile where maximum image size and maximum cropping area is defined. The process starts with the maximum cropping area and enlarges (scales-up) the image as much as the available space in the delivery context and presentation context allows.
[0056] Specific embodiments include manually creating a metadata profile for a still-image (original image) through a graphical user interface. The original image and the metadata profile are used as input. A graphical user interface allows the user to apply a rectangle to identify the maximum cropping area in the image and another rectangle to identify the optimal cropping area in the image and a third rectangle used to define the maximum image area. These embodiments allow the user to apply a rectangle to identify the maximum cropping area in the image and the image borders are used to define the maximum image area. These embodiments further provide a graphical user interface where the user applies a rectangle to identify the maximum cropping area and another rectangle to identify the optimal cropping area and the image bordei s are used to define the maximum image area In some embodiments, the invention allows the user to apply maximum cropping area with related optimal cropping area and maximum image size multiple times in different locations in the same original image In this fashion, the user applies a different priority for each group of maximum cropping aiea, optimal ciopping aiea and maximum image area Optionally, the system allows maximum ciopping areas with ielated maximum image size multiple times in different locations in the same original image Using embodiments of the invention, the user applies a diffeient priority for each set of maximum ciopping area and maximum image area - optionally applying several rectangles identifying alternate cropping areas The rectangles identifying alternate cropping areas and where the image borders are one of the cropping alternatives
[0057] In prefeπed embodiments, the user can apply several figures identifying regions of interest (ROI) in the oi iginal image Each ROI can be defined as mandatoiy or optional If it is optional it may have a priority Embodiments allow the user to set the minimum detail level by viewing how the image resolution changes when adjusting the minimum detail level and allow the user to set the minimum view size by adjusting the image display size on the screen The user determines the smallest size that should be used when the image is displayed The value saved is calculated accoid g to the screen size, the screen resolution and the distance between the usei 's eyes and the scieen as well as the selected minimum view
[0058] In some embodiments, e g , those employing vector graphics, a layer can be hidden when a minimum detail level characteristic is exceeded, and/or when a minimum view size characteristic is exceeded Alternatively, one or more image elements in a vector graphic will be hidden when a minimum detail level characteristic and/or minimum view size characteristic is exceeded
[0059] Embodiments of the invention include server-side caching of presentation data where each cached item has a media query expression If the media query expression is validated as true against a delivery context metadata profile the cached item is approved for being returned to the device without adaptation Each cached item can have a metadata profile If a content negotiation process comparing the delivery context metadata profile with the cached item metadata piofile is successful the cached item is approved foi being returned to the device without adaptation Wheie piesenation data is in XML format or another markup language (e g HTML) the cached item must be updated with some dynamic data before being returned to the device The presentation data or a cache metadata profile contain metadata indicating the location of where the dynamic data should be inserted, where the dynamic data should be letneved from and the maximum data size allowed for the dynamic data When the cached item is retrieved, the dynamic data is also retrieved and then the data is merged If the dynamic data aie larger than the maximum data size allowed, the dynamic data is adapted to the chai ctenstics of the delivery context, if the adaptation fails, the cached
Figure imgf000017_0001
[0060] In some embodiments, the metadata profile for the original image also has the minimum view size defined The minimum view size sets the limitation for reducing image size using scaling
[0061] Where maximum image area and maximum cropping area is defined, the maximum cropping area is the same as the size of the original image if it is not set as a parameter m the metadata profile for the original image The process for adapting image size, starting with the maximum image area, uses a parameter to determine the priority between rescahng and cropping The targeted size for the optimized image is determined by retrieving available width and height fiom the delivery context metadata profile and check the presentation context for limitations regaiding available space The maximum amount of cropping is limited by the size of the maximum ciopping area, this area is not cropped The minimum amount of ciopping is determined by the maximum image size The optimized image is cropped within the maximum image size area In some cases, there is no maximum data size for the dynamic data, but a maximum numbei of charactei s in one or more text strings is used instead of maximum data size
[0062] Industrial Applicability The present invention finds applicability in the computer industry and more specifically in webpage hosting where an adaptation apparatus determines one or more presentation pages for displaying on one or more different type of user devices

Claims

What is claimed is
1 An adaptation apparatus for preparing and adapting data for delivery over a network, the adaptation apparatus is configured for performing the following steps receiving a request for a presentation page, retrieving media content, presentation context, and detected delivery context, with the media content furthei compnsing a metadata profile, the presentation context further comprising at least a metadata piofile and the detected delivery context further comprising a metadata piofile comparing the metadata piofile and determining result pai ametei s, and sending the presentation page based on the lesult parameters
2 The adaptation appaiatus of claim 1 wheiein the media content further comprises an image
3 The adaptation apparatus of claim 2 wherein the presentation context further comprises a style sheet
4 The adaptation apparatus of claim 3 wheiein the metadata profile for the media content comprises at least one maximum image aiea and at least one maximum crop area
5 The adaptation apparatus of claim 3 wherein the metadata profile for the media content comprises at least one image bolder, at least one maximum image area, at least one optimum ci opping area and at least one maximum crop area
6 The adaptation apparatus of claim 5 wherein the metadata profile foi the media content further comprises one or more priority values for the at least one image border, for the at least one maximum image area, for the at least one optimum cropping area, and for the at least one maximum crop area
7 The adaptation appaiatus of claim 3 wheiein the metadata profile for the detected delivery context further comprises at least one of user parameters, device parameters, and network parameters The adaptation apparatus of claim 3 wherein the metadata profile for the media content further comprises a minimum detail level.
PCT/US2003/022017 2002-07-15 2003-07-15 Editing image for delivery over a network WO2004008308A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2003249237A AU2003249237A1 (en) 2002-07-15 2003-07-15 Editing image for delivery over a network

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US39561002P 2002-07-15 2002-07-15
US60/395,610 2002-07-15

Publications (2)

Publication Number Publication Date
WO2004008308A2 true WO2004008308A2 (en) 2004-01-22
WO2004008308A3 WO2004008308A3 (en) 2004-03-18

Family

ID=30115898

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/022017 WO2004008308A2 (en) 2002-07-15 2003-07-15 Editing image for delivery over a network

Country Status (3)

Country Link
US (1) US20040117735A1 (en)
AU (1) AU2003249237A1 (en)
WO (1) WO2004008308A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007006839A1 (en) * 2005-07-13 2007-01-18 Nokia Corporation Method for creating browsable document for a client device
GB2419768B (en) * 2004-11-01 2011-03-02 Atr Advanced Telecomm Res Inst Video content creating apparatus
US8539341B2 (en) 2007-10-24 2013-09-17 Plastic Logic Limited Electronic document reader
CN103997492A (en) * 2014-05-20 2014-08-20 五八同城信息技术有限公司 Adaption system and method

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7365758B2 (en) * 2002-10-21 2008-04-29 Microsoft Corporation System and method for scaling data according to an optimal width for display on a mobile device
US7339598B2 (en) 2003-07-11 2008-03-04 Vistaprint Technologies Limited System and method for automated product design
US20070118812A1 (en) * 2003-07-15 2007-05-24 Kaleidescope, Inc. Masking for presenting differing display formats for media streams
US7860309B1 (en) * 2003-09-30 2010-12-28 Verisign, Inc. Media publishing system with methodology for parameterized rendering of image regions of interest
CN1934525B (en) * 2004-03-18 2010-06-16 皇家飞利浦电子股份有限公司 Scanning display apparatus and operation method thereof
US9329827B2 (en) * 2004-12-29 2016-05-03 Funmobility, Inc. Cropping of images for display on variably sized display devices
FI117656B (en) 2005-02-15 2006-12-29 Lumi Interactive Ltd Content optimization for receiving terminals
JP4419876B2 (en) * 2005-03-14 2010-02-24 富士ゼロックス株式会社 Image processing device
TWI292108B (en) * 2005-12-28 2008-01-01 Via Tech Inc Fault-tolerant methods and systems for managing webpage presentation
US8780139B2 (en) * 2006-03-27 2014-07-15 Adobe Systems Incorporated Resolution monitoring when using visual manipulation tools
US7982909B2 (en) * 2006-04-21 2011-07-19 Eastman Kodak Company Method for automatically generating a dynamic digital metadata record from digitized hardcopy media
US7769363B2 (en) 2006-08-01 2010-08-03 Chew Gregory T H User-initiated communications during multimedia content playback on a mobile communications device
US8015581B2 (en) 2007-01-05 2011-09-06 Verizon Patent And Licensing Inc. Resource data configuration for media content access systems and methods
US8214793B1 (en) * 2007-06-28 2012-07-03 Adobe Systems Incorporated Automatic restoration of tool configuration while navigating layers of a composition
US20090150435A1 (en) * 2007-12-08 2009-06-11 International Business Machines Corporation Dynamic updating of personal web page
TWI419519B (en) * 2009-12-22 2013-12-11 Ind Tech Res Inst System and method for transmitting network packets adapted for multimedia streams
US8356071B2 (en) * 2010-05-14 2013-01-15 Mitel Networks Corporation Presentational system and method for IP telephones and other devices
US8640021B2 (en) * 2010-11-12 2014-01-28 Microsoft Corporation Audience-based presentation and customization of content
CA2844065C (en) 2011-08-04 2018-04-03 Google Inc. Providing knowledge panels with search results
JP2013130964A (en) * 2011-12-20 2013-07-04 Ricoh Co Ltd Display control device, display control system and program
US9274683B2 (en) 2011-12-30 2016-03-01 Google Inc. Interactive answer boxes for user search queries
US9342618B2 (en) * 2012-06-04 2016-05-17 Sap Se Web application compositon and modification editor
US20140160148A1 (en) * 2012-12-10 2014-06-12 Andrew J. Barkett Context-Based Image Customization
US10037366B2 (en) * 2014-02-07 2018-07-31 Microsoft Technology Licensing, Llc End to end validation of data transformation accuracy
US9106887B1 (en) 2014-03-13 2015-08-11 Wowza Media Systems, LLC Adjusting encoding parameters at a mobile device based on a change in available network bandwidth
US20150261425A1 (en) * 2014-03-14 2015-09-17 Apple Inc. Optimized presentation of multimedia content
US9720581B2 (en) * 2014-09-08 2017-08-01 International Business Machines Corporation Responsive image rendition authoring
WO2016056411A1 (en) 2014-10-10 2016-04-14 ソニー株式会社 Encoding device and method, playback device and method, and program
US10325511B2 (en) * 2015-01-30 2019-06-18 Conduent Business Services, Llc Method and system to attribute metadata to preexisting documents
US10349059B1 (en) * 2018-07-17 2019-07-09 Wowza Media Systems, LLC Adjusting encoding frame size based on available network bandwidth

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6023714A (en) * 1997-04-24 2000-02-08 Microsoft Corporation Method and system for dynamically adapting the layout of a document to an output device
US6029182A (en) * 1996-10-04 2000-02-22 Canon Information Systems, Inc. System for generating a custom formatted hypertext document by using a personal profile to retrieve hierarchical documents
US6199082B1 (en) * 1995-07-17 2001-03-06 Microsoft Corporation Method for delivering separate design and content in a multimedia publishing system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6400996B1 (en) * 1999-02-01 2002-06-04 Steven M. Hoffberg Adaptive pattern recognition based control system and method
US6643652B2 (en) * 2000-01-14 2003-11-04 Saba Software, Inc. Method and apparatus for managing data exchange among systems in a network
WO2001052118A2 (en) * 2000-01-14 2001-07-19 Saba Software, Inc. Information server
WO2001052090A2 (en) * 2000-01-14 2001-07-19 Saba Software, Inc. Method and apparatus for a web content platform
JP2001346031A (en) * 2000-06-05 2001-12-14 Fuji Photo Film Co Ltd Method and device for compositing image

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6199082B1 (en) * 1995-07-17 2001-03-06 Microsoft Corporation Method for delivering separate design and content in a multimedia publishing system
US6029182A (en) * 1996-10-04 2000-02-22 Canon Information Systems, Inc. System for generating a custom formatted hypertext document by using a personal profile to retrieve hierarchical documents
US6023714A (en) * 1997-04-24 2000-02-08 Microsoft Corporation Method and system for dynamically adapting the layout of a document to an output device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2419768B (en) * 2004-11-01 2011-03-02 Atr Advanced Telecomm Res Inst Video content creating apparatus
WO2007006839A1 (en) * 2005-07-13 2007-01-18 Nokia Corporation Method for creating browsable document for a client device
US8539341B2 (en) 2007-10-24 2013-09-17 Plastic Logic Limited Electronic document reader
US8711395B2 (en) 2007-10-24 2014-04-29 Plastic Logic Limited Electronic document reading devices
US8836970B2 (en) 2007-10-24 2014-09-16 Plastic Logic Limited Document printing techniques
CN103997492A (en) * 2014-05-20 2014-08-20 五八同城信息技术有限公司 Adaption system and method
CN103997492B (en) * 2014-05-20 2018-02-27 五八同城信息技术有限公司 A kind of adaption system and method

Also Published As

Publication number Publication date
AU2003249237A1 (en) 2004-02-02
AU2003249237A8 (en) 2004-02-02
US20040117735A1 (en) 2004-06-17
WO2004008308A3 (en) 2004-03-18

Similar Documents

Publication Publication Date Title
WO2004008308A2 (en) Editing image for delivery over a network
US8010702B2 (en) Feature-based device description and content annotation
US7631260B1 (en) Application modification based on feed content
US7900137B2 (en) Presenting HTML content on a screen terminal display
US10042950B2 (en) Method and apparatus for modifying the font size of a webpage according to the screen resolution of a client device
US9898542B2 (en) Narration of network content
US7636792B1 (en) Methods and systems for dynamic and automatic content creation for mobile devices
JP4344693B2 (en) System and method for browser document editing
KR101494285B1 (en) Method and device for dynamically wrapping text when displaying a selected region of an electronic document
US10185702B1 (en) Publisher formatting controls
US20110173188A1 (en) System and method for mobile document preview
US20030167334A1 (en) Provision of content to a client device
US20100199197A1 (en) Selective content transcoding
US20030061386A1 (en) Method and system of use of transcode directives for distributed control of transcoding servers
US20090112824A1 (en) Method and apparatus for generating presentation configuration file of document content
WO2007082442A1 (en) An electronic program guide interface customizing method, server, set top box and system
NZ534184A (en) Document display system and method
JP2007233659A (en) Information distribution system for network service
Krause Introducing Web Development
US20140258816A1 (en) Methodology to dynamically rearrange web content for consumer devices
US20040148292A1 (en) Method of adaptive data transmission
US6636235B1 (en) Lettering adjustments for display resolution
KR20040088061A (en) Stylesheet uploading to manage terminal diversity
US20080297521A1 (en) System and method for providing skins for a web page
JP2007509402A (en) HTML content display on screen terminal display

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP