US8929459B2 - Systems and methods utilizing efficient video compression techniques for browsing of static image data - Google Patents

Systems and methods utilizing efficient video compression techniques for browsing of static image data Download PDF

Info

Publication number
US8929459B2
US8929459B2 US13/247,917 US201113247917A US8929459B2 US 8929459 B2 US8929459 B2 US 8929459B2 US 201113247917 A US201113247917 A US 201113247917A US 8929459 B2 US8929459 B2 US 8929459B2
Authority
US
United States
Prior art keywords
static image
browser
video
compression
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US13/247,917
Other versions
US20120076210A1 (en
Inventor
Pascal Massimino
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Priority to US13/247,917 priority Critical patent/US8929459B2/en
Assigned to GOOGLE INC. reassignment GOOGLE INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MASSIMINO, PASCAL
Publication of US20120076210A1 publication Critical patent/US20120076210A1/en
Application granted granted Critical
Publication of US8929459B2 publication Critical patent/US8929459B2/en
Assigned to GOOGLE LLC reassignment GOOGLE LLC CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: GOOGLE INC.
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234336Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782Web browsing, e.g. WebTV
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • H04N21/6377Control signals issued by the client directed to the server or network components directed to server
    • H04N21/6379Control signals issued by the client directed to the server or network components directed to server directed to encoder, e.g. for requesting a lower encoding rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6581Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image

Definitions

  • the field relates to browsing image data for display.
  • a variety of media content including image and video data is now made available to users at client devices.
  • a user at a client device operates a browser.
  • the browser also called a client browser
  • the web server is coupled over one or more networks, such as the Internet, to a web server.
  • the web server in turn can be part of or coupled to another server (such as a media streaming server).
  • the web server and/or the media server can serve media content to the browser on a client device for display or viewing by the user.
  • Compression is often used in the case of image data and video data to reduce the amount of data that needs to be transmitted over a network.
  • static images also called pictures
  • Video has been compressed according to a number of different video compression techniques and standards, such as, H.261, H.262, MPEG I-part 2, MPEG 2-part 4, or H.263 video compression.
  • Newer video compression techniques and standards have been developed as well to compress video. These newer video compression techniques (also called modern techniques) include for example MPEG 4 AVC/H.264, VC-1, On2 VP6-VP8 video compression.
  • a browser When browsing a web page, a browser often identifies a file and requests the file from a remote server. The browser then receives the requested file and renders it for display depending upon its file format and type of compression used to create the file. For instance, static images sent in a file format such as GIF, PNG or JPEG files are received and then decompressed and rendered for display by the browser on a client device according to the file format or tag specified in the web page. Likewise, compressed video files referenced in a web page are fetched by the browser and then decompressed and rendered for display by the browser on a client device according to the file format or tag specified in the web page.
  • static images sent in a file format such as GIF, PNG or JPEG files are received and then decompressed and rendered for display by the browser on a client device according to the file format or tag specified in the web page.
  • compressed video files referenced in a web page are fetched by the browser and then decompressed and rendered for display by the browser on a client device
  • a browser requests a compressed static image and has a compressed static image sent over a network even when inefficient.
  • Embodiments include systems and methods that use video compression techniques when browsing web pages referencing static image data or video content.
  • this can include using modern video compression techniques when browsing web pages referencing compressed static image data to obtain increased efficiency in transmission and/or rendering of the static image data on a browser at a client device.
  • this may include browsing a web page referencing compressed video content and then decoding the referenced compressed video content to obtain static image data for rendering in a browser window.
  • a system in an embodiment, includes a browser configured to operate on a first computing device and browse a received web page having a video content identifier and an associated video compression data signature.
  • the browser includes a decoder that decodes compressed video content associated with the video content identifier in accordance with a type of video compression identified by the video compression data signature to obtain static image data.
  • the browser renders the obtained static image data for display in a browser window that shows content corresponding to the received web page.
  • a method includes receiving, at a computing device having a browser, a web page having a video content identifier and an associated video compression data signature, and recognizing the video compression data signature.
  • the method includes decoding compressed video content associated with the content identifier based on the recognized video compression data signature to obtain static image data, and rendering the obtained static image data for display in a browser window showing content corresponding to the received web page.
  • the video compression data signature identifies a type of video compression more efficient than a type of static image compression.
  • the video compression data signature may identify a type of video compression selected from the group of VP8, H.264/AVC, or VC-1 video compression, while the type of static image compression is a type of compression selected from the group of JPEG, GIF or PNG file or image compression formats.
  • the method further includes requesting the compressed video content from a remote site over a network, and receiving the compressed video content from the remote site over a network prior to the decoding.
  • recognizing, decoding, and rendering are performed by a browser at the computing device.
  • a recompressing service is used.
  • a system includes a browser, configured to operate on a first computing device and browse a received web page having a static image content identifier and an associated static image compression data signature.
  • the browser is further configured to request compressed image content associated with the static image content identifier and receive compressed video content that is a recompression of the requested compressed static image content.
  • the browser includes a decoder that decodes the received compressed video content based on a recognized video compression data signature to obtain static image data.
  • the browser renders the obtained static image data for display in the browser.
  • a method in another embodiment, includes receiving, at a first computing device having a browser, a web page having a static image content identifier and an associated static image compression data signature, and requesting compressed image content associated with the static image content identifier. The method further includes receiving compressed video content that is a recompression of the requested compressed static image content, and decoding the received compressed video content based on the recognized video compression data signature to obtain static image data. The method then includes a step of rendering the obtained static image data for display in a browser window showing content corresponding to the received web page.
  • the static image content identifier and an associated static image compression data signature are included in a URL in the received web page.
  • the static image compression data signature identifies a type of static image compression and the compressed video content is more efficiently recompressed than the compressed static image content.
  • the compressed video content is recompressed with a type of video compression selected from the group of VP8, H.264, or VC-1 video compression and the compressed static image content is a type of static image compression selected from the group of JPEG, GIF or PNG formats.
  • the method further includes displaying the browser window on a display so a user can view the rendered static image data corresponding to the received web page.
  • the computing device requests the compressed image content from a remote site over a network prior to the decoding.
  • the requesting, decoding, and rendering are performed by the browser at the computing device.
  • the method also includes at a remote second computing device coupled to the first computing device over a network, the steps of transcoding the requested compressed image content associated with the static image content identifier to obtain the compressed video content, and sending the compressed video content over the network to the first computing device, whereby the compressed video content is transmitted more efficiently over the network than a transmission of the compressed imaged content.
  • FIG. 1 is a diagram of a system for utilizing video compression techniques when browsing compressed static image data according to an embodiment of the present invention.
  • FIG. 2 is a flowchart diagram of a method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart diagram of a method using a recompression service according to a further embodiment.
  • FIG. 4 is a browser implementation that can be used in the system of FIG. 1 and with methods of FIGS. 2 and 3 according to one example.
  • HTML HyperText Markup Language
  • browsers implementing HTML are still using GIF, PNG and JPEG format for their static images using the image ⁇ img> tag.
  • the image tag is not limited to these three image compression standards and the HTML standard is open to any other format.
  • a feature provided here is using known video compression standards as an image format (such as static image or picture image format). These known video compression techniques can include modern video compression techniques more recent than, say, older formats according to the JPEG standard. In one preferred example, modern video compression standards are used to compress static images instead of a collection of frames. This can replace the use of JPEG compressed files, for instance.
  • embodiments described herein allow browsers to benefit from these advances in compression technology and make them available for image display too. For instance, the inventor has found in examples that this can save about 10-33% of file size (and bandwidth) on thumbnails, user photos and advertisement banners.
  • a browser when a browser receives data corresponding to an image data, it looks up few bytes at the beginning of the stream to infer the nature of the compression used.
  • a browser recognizes new data signatures corresponding to modern video standards (like AVC/H.264, VC-1, VP8 for instance). The browser recognizes this format and decodes the corresponding video sequence in order to display one or several frame of this video sequence as an image in the web page.
  • this technique can be used with a recompression service where a browser at a client requests a regular static image (JPEG data) using a URL, but instead receives recompressed bytes supplied by the recompressing service.
  • This service would fetch the JPEG data itself and retranscode it toward a more efficient video format before serving the result to the browser and thereby using less bandwidth.
  • the browser would then decompress this alternate data toward a displayable image samples, or turn the video data back into a standard image format.
  • the recompression service may include a transcoder device in charge of converting regular image data like JPEG into video data and serving the video data instead to a requesting consumer device (such as a client computing device with a browser or other client application).
  • the recompression service may carry out the transcoding off-line or on-line.
  • the requesting consumer device would be made aware of the change in data representation and either: decompress the data itself, or request a proxy process to do this decompression, returning the decompressed image samples.
  • FIG. 1 is a diagram of a system 100 for utilizing video compression techniques when browsing compressed static image data according to an embodiment of the present invention.
  • System 100 includes a browser 110 and decoder 120 implemented on a client device 102 .
  • Client device 102 also has a display 107 for displaying content browsed by browser 110 to a user.
  • Client device 102 can be any type of computing device.
  • Example computing devices that may be used include, but are not limited to, a computer, workstation, distributed computing system, computer cluster, embedded system, game console, stand-alone electronic device, networked device, mobile device (e.g., smartphone, tablet, laptop or personal computer), set-top box, television, or other type of processor or computer system having at least a processor and memory.
  • a processor may be a single processor, or part of a plurality of processors, or combinations thereof.
  • a processor may also be in processor devices that may have one or more processor “cores.”
  • System 100 further includes remote computing devices 104 and 106 coupled to client device 102 over one or more networks 105 .
  • Network(s) 105 can be any type of data network or combination of data networks (such as the Internet, wide area, medium area or local area network) for carrying data between the computing devices 102 , 104 and 106 .
  • Network(s) 105 can support protocols and technology including, but not limited to, World Wide Web protocols and/or services.
  • Remote computing devices 104 and 106 may each be any type of computing device including, but not limited to, a computer, workstation, distributed computing system, computer cluster, embedded system, game console, stand-alone electronic device, networked device, mobile device (e.g., smartphone, tablet, laptop or personal computer), set-top box, television, or other type of processor or computer system having at least a processor and memory.
  • a processor may be a single processor, or part of a plurality of processors, or combinations thereof.
  • a processor may also be in processor devices that may have one or more processor “cores.”
  • a web server 130 is implemented on computing device 104 . Any type of web server may be used to serve web content to browser 110 .
  • a wet server is a software component that responds to a hypertext transfer protocol (HTTP) request with an HTTP response.
  • HTTP hypertext transfer protocol
  • the web server may be, without limitation, Apache HTTP Server, Apache Tomcat, Microsoft® Internet Information Server, JBoss Application Server, WebLogic Application Server®, or Sun JavaTM System Web Server.
  • the web server may serve content such as hypertext markup language (HTML), extendable markup language (XML), documents, videos, images, multimedia features, MACROMEDIA Flash programs, or any combination thereof. These examples are illustrative and do not limit the present invention.
  • Web server 130 can operate alone or in tandem with other servers (such as media servers), web servers, or devices and can be part of any search engine, portal, or web site.
  • browser 110 can browse a web page that references a video compression file, decode the referenced video compression file with decoder 120 to obtain a static image, and render the static image for display.
  • This allows web pages to include references to video compression files in static image sections of a web page denoted by tags such as “img”.
  • the references to video compression files can include, but are not limited to, files compressed with modem video compression techniques such as AVC/H.264, or VP8 video compression. The operation of browser 110 according to this feature is described further below with reference to FIG. 2 .
  • a recompression service 140 with a transcoder 142 can be used.
  • Browser 110 can browse a web page that references a static image compression file and have the compressed static image be transcoded by transcoder 142 into a video compression file. The transcoded video compression file is then sent over a network rather than sending the originally requested static image compression file. Decoder 120 decodes the sent video compression file to a static image, and browser 110 renders the static image for display. This can result in efficiencies in network transmission especially when the transcoded video compression file is smaller than the referenced compressed static image in the web page. The operation of browser 110 according to this feature is described further below with reference to FIG. 3 .
  • Browser 110 can be any type of browser including any conventional browser, such as a Google Chrome, Microsoft Internet Explorer, Apple Safari, or Mozilla Firefox browser, modified to operate as described herein.
  • functionality described herein can be implemented in a Webkit tool suite for use for example in a Google Chrome, Apple Safari, or other browser using the Webkit tool suite.
  • FIG. 4 shows an example of browser 410 that may be used having a user-interface 420 , browsing engine 430 , and rendering engine 440 .
  • Decoder 120 can then be coupled to at least the browsing engine and rendering engine.
  • the user-interface can support interactions with a user and the browser including sending and receiving control commands or data between the browser and a user-interface unit (such as, a touch screen, GUI, voice control, or other 1/0 device).
  • the browsing engine manages and carries out browsing functions.
  • the rendering engine manages and carries out rendering of data for display.
  • decoder 120 is not necessarily part of browser 110 and instead can be a stand-alone module or incorporated in another application on a client or even in a separate remote decompressing service.
  • recompression service 140 with transcoder 142 can be independent of web server 130 , or can be part of or integral with web server 130 .
  • Recompression service 140 with transcoder 142 can also be locally or remotely coupled to communicate with web server 130 .
  • Browser 110 , decoder 120 , web server 130 , recompression service 140 , and transcoder 142 can be implemented in software, hardware, firmware, tangible readable medium having instructions, or any combination thereof on one or more computing devices.
  • programmable logic such logic may execute on a commercially available processing platform or a special purpose device.
  • Embodiments also may be directed to computer program products comprising software stored on any computer useable medium. Such software, when executed in one or more data processing device, causes a data processing device(s) to operate as described herein.
  • Embodiments of the invention may employ any computer useable or readable medium.
  • Examples of computer useable mediums include, but are not limited to, primary storage devices (e.g., any type of random access memory), secondary storage devices (e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes, magnetic storage devices, and optical storage devices, MEMS, nanotechnological storage device, etc.).
  • primary storage devices e.g., any type of random access memory
  • secondary storage devices e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes, magnetic storage devices, and optical storage devices, MEMS, nanotechnological storage device, etc.
  • the operation of browser 110 and web server 130 is described further with respect to the method 200 of FIG. 2 (steps 210 - 240 ).
  • the method 200 of FIG. 2 however is not necessarily limited to the structure or operation of system 100 .
  • browser 110 is configured to operate on client device 102 and browse a web page 202 having a video content identifier and an associated video compression data signature (step 210 ).
  • browser 110 recognizes the video content identifier (such as a filename) and an associated video compression data signature (such as a tag or file name suffix) indicative of a type of video compression or file format.
  • Browser 110 then obtains a compressed file identified by the video content identifier.
  • This compressed file can be accessed locally from a cache or local memory, if available, or remotely by sending a request (e.g., URL) to web server 130 .
  • Web server 130 (or another server such as a media server) then returns the requested compressed video file to fulfill the request made by browser 110 .
  • decoder 120 decodes compressed video content associated with the video content identifier in accordance with a type of video compression identified by the video compression data signature to obtain static image data.
  • Browser 110 renders the obtained static image data for display in a browser window on display 107 that shows content corresponding to the received web page (step 240 ).
  • browser 110 displays a static image in a display of a web page even when the web page identified a compressed video file with a type of video compression identified by its video compression data signature.
  • a web page may include a compressed video file with a video compression data signature indicating a modem video compression technique such as H.264/AVC, VC-1, or VP8 compression.
  • Decoder 120 decodes this compressed video to obtain a static image (or a video frame, such as, a keyframe or other desired frame of a video frame sequence). Browser 110 then renders for display the static image (i.e., the keyframe or other desired frame of a video sequence). This is particularly helpful for display of thumbnails, ads, or other small area content.
  • the video compression data signature identifies a type of video compression more efficient than a type of static image compression.
  • the video compression data signature may identify a type of video compression selected from the group of VP8, H.264/AVC, or VC-1 video compression, while the type of static image compression is a type of compression selected from the group of JPEG, GIF or PNG file or image compression formats.
  • the method further includes requesting the compressed video content from a remote site over a network, and receiving the compressed video content from the remote site over a network prior to the decoding.
  • recognizing, decoding, and rendering are performed by a browser at the computing device.
  • a recompressing service 140 is used as shown optionally in FIG. 1 .
  • the operation of browser 110 , web server 130 , and recompressing service 140 is described further with respect to the method of FIG. 3 (steps 310 - 350 ).
  • the method of FIG. 3 however is not necessarily limited to the structure or operation of system 100 .
  • browser 110 browses a received web page 302 having a static image content identifier and an associated static image compression data signature (step 310 ). Browser 110 requests compressed static image content associated with the static image content identifier (step 320 ).
  • a method 300 includes browsing a web page 302 having a static image content identifier and an associated static image compression data signature (step 310 ).
  • compressed image content associated with the static image content identifier is requested of a recompressing service 140 at a remote server.
  • a transcoder 142 transcodes compressed static image content to a compressed video content such as a file (step 330 ).
  • Recompression service 140 then returns the compressed video content to fulfill the browser 110 request. This can be done directly from the recompression service 140 or through web server 130 .
  • decoder 120 decodes the received compressed video content based on the recognized video compression data signature to obtain static image data (step 340 ). Browser 110 then renders the obtained static image data for display in a browser window showing content corresponding to the received web page (step 350 ).
  • recompression service 140 can send transcoded data to another client application or proxy service for decompressing rather the browser 110 .
  • transcoder 142 can transcode images in a standard JPEG format toward more efficient compression derived from video compression standard and transmit the resulting bytes not to a browser directly, but to a decoding process (such as one carried out in a Google Toolbar) that will decode the result and transmit the resulting image bytes to the browser directly, on the client's side.
  • a product such as iGoogle can request transcoding and use Google Toolbar as a decompressing proxy.
  • system 100 and method 200 may include:
  • transcoder 142 as described can convert a JPEG (or PNG) to Google VP8.
  • JPEG or PNG
  • Google VP8 One reason VP8 in an example is better than JPEG is due to mainly the use of spatial intra prediction.
  • the Google VP8 coding may use spatial intra prediction modes (as opposed to the frequency-domain prediction one can find in JPEG/MPEG).
  • Google VP8 examples may also have better coefficient coding, range coding instead of Huffman codes, variable block sizes (16 ⁇ 16/4 ⁇ 4), and two-stage transforms.
  • a simple one-call API may be used to compress and decompress VP8 data from and to raw YUV samples.
  • decoder 120 is a fast H.264 keyframe decoder that works based on the assumption one is only decoding one keyframe.
  • This keyframe decoder example extends a Google Chrome browser with

Abstract

Embodiments include systems and methods that use video compression techniques when browsing web pages referencing static image data or video content. In non-limiting examples, this can include using modern video compression techniques when browsing web pages referencing compressed static image data to obtain increased efficiency in transmission and/or rendering of the static image data on a browser at a client device. In an embodiment, a system includes a browser that browses a received web page having a content identifier and an associated video compression data signature. The browser includes a decoder that decodes compressed video content associated with the content identifier in accordance with a type of video compression identified by the video compression data signature to obtain static image data.

Description

CROSS REFERENCE TO RELATED APPLICATION(S)
This application claims priority to U.S. Provisional Patent Application No. 61/387,317, filed Sep. 28, 2010.
FIELD
The field relates to browsing image data for display.
RELATED ART
A variety of media content including image and video data is now made available to users at client devices. The emergence and development of computer networks and protocols, including the World Wide Web (or simply “web”), has allowed many users to view and enjoy media content served from remote locations over the web. A user at a client device operates a browser. The browser (also called a client browser) is coupled over one or more networks, such as the Internet, to a web server. The web server in turn can be part of or coupled to another server (such as a media streaming server). Depending upon a particular application or content being viewed, the web server and/or the media server can serve media content to the browser on a client device for display or viewing by the user.
Compression is often used in the case of image data and video data to reduce the amount of data that needs to be transmitted over a network. A variety of different types of compression and file formats have been developed and used over the years. For instance, static images (also called pictures) have long been compressed and sent in a file format as GIF, PNG or JPEG files. Video has been compressed according to a number of different video compression techniques and standards, such as, H.261, H.262, MPEG I-part 2, MPEG 2-part 4, or H.263 video compression. Newer video compression techniques and standards have been developed as well to compress video. These newer video compression techniques (also called modern techniques) include for example MPEG 4 AVC/H.264, VC-1, On2 VP6-VP8 video compression.
When browsing a web page, a browser often identifies a file and requests the file from a remote server. The browser then receives the requested file and renders it for display depending upon its file format and type of compression used to create the file. For instance, static images sent in a file format such as GIF, PNG or JPEG files are received and then decompressed and rendered for display by the browser on a client device according to the file format or tag specified in the web page. Likewise, compressed video files referenced in a web page are fetched by the browser and then decompressed and rendered for display by the browser on a client device according to the file format or tag specified in the web page.
In the case of a static image, a browser requests a compressed static image and has a compressed static image sent over a network even when inefficient.
SUMMARY
Embodiments include systems and methods that use video compression techniques when browsing web pages referencing static image data or video content. In non-limiting examples, this can include using modern video compression techniques when browsing web pages referencing compressed static image data to obtain increased efficiency in transmission and/or rendering of the static image data on a browser at a client device. In further examples, this may include browsing a web page referencing compressed video content and then decoding the referenced compressed video content to obtain static image data for rendering in a browser window.
In an embodiment, a system includes a browser configured to operate on a first computing device and browse a received web page having a video content identifier and an associated video compression data signature. The browser includes a decoder that decodes compressed video content associated with the video content identifier in accordance with a type of video compression identified by the video compression data signature to obtain static image data. The browser renders the obtained static image data for display in a browser window that shows content corresponding to the received web page.
In an embodiment, a method includes receiving, at a computing device having a browser, a web page having a video content identifier and an associated video compression data signature, and recognizing the video compression data signature. The method includes decoding compressed video content associated with the content identifier based on the recognized video compression data signature to obtain static image data, and rendering the obtained static image data for display in a browser window showing content corresponding to the received web page.
In a feature, the video compression data signature identifies a type of video compression more efficient than a type of static image compression. For example, the video compression data signature may identify a type of video compression selected from the group of VP8, H.264/AVC, or VC-1 video compression, while the type of static image compression is a type of compression selected from the group of JPEG, GIF or PNG file or image compression formats.
In an embodiment, the method further includes requesting the compressed video content from a remote site over a network, and receiving the compressed video content from the remote site over a network prior to the decoding.
In another embodiment, recognizing, decoding, and rendering are performed by a browser at the computing device.
In a still further embodiment, a recompressing service is used. In an embodiment, a system includes a browser, configured to operate on a first computing device and browse a received web page having a static image content identifier and an associated static image compression data signature. The browser is further configured to request compressed image content associated with the static image content identifier and receive compressed video content that is a recompression of the requested compressed static image content. The browser includes a decoder that decodes the received compressed video content based on a recognized video compression data signature to obtain static image data. The browser renders the obtained static image data for display in the browser.
In another embodiment, a method includes receiving, at a first computing device having a browser, a web page having a static image content identifier and an associated static image compression data signature, and requesting compressed image content associated with the static image content identifier. The method further includes receiving compressed video content that is a recompression of the requested compressed static image content, and decoding the received compressed video content based on the recognized video compression data signature to obtain static image data. The method then includes a step of rendering the obtained static image data for display in a browser window showing content corresponding to the received web page.
In a feature, the static image content identifier and an associated static image compression data signature are included in a URL in the received web page. In a further feature, the static image compression data signature identifies a type of static image compression and the compressed video content is more efficiently recompressed than the compressed static image content. In a non-limiting example, the compressed video content is recompressed with a type of video compression selected from the group of VP8, H.264, or VC-1 video compression and the compressed static image content is a type of static image compression selected from the group of JPEG, GIF or PNG formats.
In a further embodiment, the method further includes displaying the browser window on a display so a user can view the rendered static image data corresponding to the received web page.
In one example, the computing device requests the compressed image content from a remote site over a network prior to the decoding. In another example the requesting, decoding, and rendering are performed by the browser at the computing device.
In a further example, the method also includes at a remote second computing device coupled to the first computing device over a network, the steps of transcoding the requested compressed image content associated with the static image content identifier to obtain the compressed video content, and sending the compressed video content over the network to the first computing device, whereby the compressed video content is transmitted more efficiently over the network than a transmission of the compressed imaged content.
Further embodiments, features, and advantages of the invention, as well as the structure and operation of the various embodiments of the invention are described in detail below with reference to accompanying drawings.
BRIEF DESCRIPTION OF THE FIGURES
Embodiments of the invention are described with reference to the accompanying drawings. In the drawings, like reference numbers may indicate identical or functionally similar elements. The drawing in which an element first appears is generally indicated by the left-most digit in the corresponding reference number.
FIG. 1 is a diagram of a system for utilizing video compression techniques when browsing compressed static image data according to an embodiment of the present invention.
FIG. 2 is a flowchart diagram of a method according to an embodiment of the present invention.
FIG. 3 is a flowchart diagram of a method using a recompression service according to a further embodiment.
FIG. 4 is a browser implementation that can be used in the system of FIG. 1 and with methods of FIGS. 2 and 3 according to one example.
DETAILED DESCRIPTION OF EMBODIMENTS Overview and Discussion of Embodiments
By limiting fetching and rendering according to specified types of compression and file formats, browsers often fail to take advantage of more modern compression techniques which can be more efficient. This is especially true when browsing web pages having static image data in older compression formats such as JPEG, GIF, and PNG. While JPEG compression is an ancestor to block-based modern video compression techniques, some substantial improvement in coding efficiency has been made since the 1990s as the more modern video compression techniques use increasingly efficient prediction and/or correction models.
Browsers encountering such older compression formats often request the compressed files over a network which requires transmission and then have to correspondingly decompress the files during rendering to display a static image. Inefficiencies may exist in the transmission and/or rendering—especially when static image files using older compression techniques are involved which is common in many of today's web pages including HTML pages.
In embodiments of the present invention these inefficiencies are reduced. More modern video compression techniques may be used when browsing existing web pages that reference static image data. This is especially important for browsers operating on client devices such as mobile devices, including smartphones, tablet, or laptop computing devices where processing resources or communications resources (e.g. bandwidth or latency) may be limited.
For instance, browsers implementing HTML are still using GIF, PNG and JPEG format for their static images using the image <img> tag. Yet the image tag is not limited to these three image compression standards and the HTML standard is open to any other format. A feature provided here is using known video compression standards as an image format (such as static image or picture image format). These known video compression techniques can include modern video compression techniques more recent than, say, older formats according to the JPEG standard. In one preferred example, modern video compression standards are used to compress static images instead of a collection of frames. This can replace the use of JPEG compressed files, for instance.
As discovered by the inventor, embodiments described herein allow browsers to benefit from these advances in compression technology and make them available for image display too. For instance, the inventor has found in examples that this can save about 10-33% of file size (and bandwidth) on thumbnails, user photos and advertisement banners.
For example, when a browser receives data corresponding to an image data, it looks up few bytes at the beginning of the stream to infer the nature of the compression used. In embodiments of the present invention, a browser recognizes new data signatures corresponding to modern video standards (like AVC/H.264, VC-1, VP8 for instance). The browser recognizes this format and decodes the corresponding video sequence in order to display one or several frame of this video sequence as an image in the web page.
In a further feature, this technique can be used with a recompression service where a browser at a client requests a regular static image (JPEG data) using a URL, but instead receives recompressed bytes supplied by the recompressing service. This service would fetch the JPEG data itself and retranscode it toward a more efficient video format before serving the result to the browser and thereby using less bandwidth. The browser would then decompress this alternate data toward a displayable image samples, or turn the video data back into a standard image format.
In operation, the recompression service may include a transcoder device in charge of converting regular image data like JPEG into video data and serving the video data instead to a requesting consumer device (such as a client computing device with a browser or other client application). The recompression service may carry out the transcoding off-line or on-line. The requesting consumer device would be made aware of the change in data representation and either: decompress the data itself, or request a proxy process to do this decompression, returning the decompressed image samples.
System
FIG. 1 is a diagram of a system 100 for utilizing video compression techniques when browsing compressed static image data according to an embodiment of the present invention. System 100 includes a browser 110 and decoder 120 implemented on a client device 102. Client device 102 also has a display 107 for displaying content browsed by browser 110 to a user.
Client device 102 can be any type of computing device. Example computing devices that may be used include, but are not limited to, a computer, workstation, distributed computing system, computer cluster, embedded system, game console, stand-alone electronic device, networked device, mobile device (e.g., smartphone, tablet, laptop or personal computer), set-top box, television, or other type of processor or computer system having at least a processor and memory. A processor may be a single processor, or part of a plurality of processors, or combinations thereof. A processor may also be in processor devices that may have one or more processor “cores.”
System 100 further includes remote computing devices 104 and 106 coupled to client device 102 over one or more networks 105. Network(s) 105 can be any type of data network or combination of data networks (such as the Internet, wide area, medium area or local area network) for carrying data between the computing devices 102, 104 and 106. Network(s) 105 can support protocols and technology including, but not limited to, World Wide Web protocols and/or services. Remote computing devices 104 and 106 may each be any type of computing device including, but not limited to, a computer, workstation, distributed computing system, computer cluster, embedded system, game console, stand-alone electronic device, networked device, mobile device (e.g., smartphone, tablet, laptop or personal computer), set-top box, television, or other type of processor or computer system having at least a processor and memory. A processor may be a single processor, or part of a plurality of processors, or combinations thereof. A processor may also be in processor devices that may have one or more processor “cores.”
A web server 130 is implemented on computing device 104. Any type of web server may be used to serve web content to browser 110. In an embodiment, a wet server is a software component that responds to a hypertext transfer protocol (HTTP) request with an HTTP response. As illustrative examples, the web server may be, without limitation, Apache HTTP Server, Apache Tomcat, Microsoft® Internet Information Server, JBoss Application Server, WebLogic Application Server®, or Sun Java™ System Web Server. The web server may serve content such as hypertext markup language (HTML), extendable markup language (XML), documents, videos, images, multimedia features, MACROMEDIA Flash programs, or any combination thereof. These examples are illustrative and do not limit the present invention. Web server 130 can operate alone or in tandem with other servers (such as media servers), web servers, or devices and can be part of any search engine, portal, or web site.
According to a feature browser 110 can browse a web page that references a video compression file, decode the referenced video compression file with decoder 120 to obtain a static image, and render the static image for display. This allows web pages to include references to video compression files in static image sections of a web page denoted by tags such as “img”. The references to video compression files can include, but are not limited to, files compressed with modem video compression techniques such as AVC/H.264, or VP8 video compression. The operation of browser 110 according to this feature is described further below with reference to FIG. 2.
According to another feature, a recompression service 140 with a transcoder 142 can be used. Browser 110 can browse a web page that references a static image compression file and have the compressed static image be transcoded by transcoder 142 into a video compression file. The transcoded video compression file is then sent over a network rather than sending the originally requested static image compression file. Decoder 120 decodes the sent video compression file to a static image, and browser 110 renders the static image for display. This can result in efficiencies in network transmission especially when the transcoded video compression file is smaller than the referenced compressed static image in the web page. The operation of browser 110 according to this feature is described further below with reference to FIG. 3.
Browser 110 can be any type of browser including any conventional browser, such as a Google Chrome, Microsoft Internet Explorer, Apple Safari, or Mozilla Firefox browser, modified to operate as described herein. In one example, not intended to be limiting, functionality described herein can be implemented in a Webkit tool suite for use for example in a Google Chrome, Apple Safari, or other browser using the Webkit tool suite. FIG. 4 shows an example of browser 410 that may be used having a user-interface 420, browsing engine 430, and rendering engine 440. Decoder 120 can then be coupled to at least the browsing engine and rendering engine. The user-interface can support interactions with a user and the browser including sending and receiving control commands or data between the browser and a user-interface unit (such as, a touch screen, GUI, voice control, or other 1/0 device). The browsing engine manages and carries out browsing functions. The rendering engine manages and carries out rendering of data for display.
In other examples, decoder 120 is not necessarily part of browser 110 and instead can be a stand-alone module or incorporated in another application on a client or even in a separate remote decompressing service.
In further example arrangements, recompression service 140 with transcoder 142 can be independent of web server 130, or can be part of or integral with web server 130. Recompression service 140 with transcoder 142 can also be locally or remotely coupled to communicate with web server 130.
Browser 110, decoder 120, web server 130, recompression service 140, and transcoder 142 can be implemented in software, hardware, firmware, tangible readable medium having instructions, or any combination thereof on one or more computing devices. In one embodiment, if programmable logic is used, such logic may execute on a commercially available processing platform or a special purpose device. Embodiments also may be directed to computer program products comprising software stored on any computer useable medium. Such software, when executed in one or more data processing device, causes a data processing device(s) to operate as described herein. Embodiments of the invention may employ any computer useable or readable medium. Examples of computer useable mediums include, but are not limited to, primary storage devices (e.g., any type of random access memory), secondary storage devices (e.g., hard drives, floppy disks, CD ROMS, ZIP disks, tapes, magnetic storage devices, and optical storage devices, MEMS, nanotechnological storage device, etc.).
Surfing Video Compression Files with Static Image Display
For brevity, the operation of browser 110 and web server 130 is described further with respect to the method 200 of FIG. 2 (steps 210-240). The method 200 of FIG. 2 however is not necessarily limited to the structure or operation of system 100.
According to a feature, browser 110 is configured to operate on client device 102 and browse a web page 202 having a video content identifier and an associated video compression data signature (step 210). In step 220, browser 110 recognizes the video content identifier (such as a filename) and an associated video compression data signature (such as a tag or file name suffix) indicative of a type of video compression or file format.
Browser 110 then obtains a compressed file identified by the video content identifier. This compressed file can be accessed locally from a cache or local memory, if available, or remotely by sending a request (e.g., URL) to web server 130. Web server 130 (or another server such as a media server) then returns the requested compressed video file to fulfill the request made by browser 110.
In step 230, decoder 120 decodes compressed video content associated with the video content identifier in accordance with a type of video compression identified by the video compression data signature to obtain static image data. Browser 110 renders the obtained static image data for display in a browser window on display 107 that shows content corresponding to the received web page (step 240).
In this way, browser 110 displays a static image in a display of a web page even when the web page identified a compressed video file with a type of video compression identified by its video compression data signature. For instance, in one feature example, a web page may include a compressed video file with a video compression data signature indicating a modem video compression technique such as H.264/AVC, VC-1, or VP8 compression. Decoder 120 decodes this compressed video to obtain a static image (or a video frame, such as, a keyframe or other desired frame of a video frame sequence). Browser 110 then renders for display the static image (i.e., the keyframe or other desired frame of a video sequence). This is particularly helpful for display of thumbnails, ads, or other small area content.
For example, the inventor has implemented a Google Chrome browser which can browse an HTML page using syntactic elements like: <img src=‘video.264’> to display the first frame of the video file ‘video.264’ compressed using the H.264 video standard (“MPEG-4-part10/AVC”).
In a feature, the video compression data signature identifies a type of video compression more efficient than a type of static image compression. For example, the video compression data signature may identify a type of video compression selected from the group of VP8, H.264/AVC, or VC-1 video compression, while the type of static image compression is a type of compression selected from the group of JPEG, GIF or PNG file or image compression formats.
In one embodiment, the method further includes requesting the compressed video content from a remote site over a network, and receiving the compressed video content from the remote site over a network prior to the decoding.
In another embodiment, recognizing, decoding, and rendering are performed by a browser at the computing device.
Surfing Static Image Compression Files with Recompressed Static Image Display
Recompressing Service
In a still further embodiment, a recompressing service 140 is used as shown optionally in FIG. 1. For brevity, the operation of browser 110, web server 130, and recompressing service 140 is described further with respect to the method of FIG. 3 (steps 310-350). The method of FIG. 3 however is not necessarily limited to the structure or operation of system 100.
In an embodiment, browser 110 browses a received web page 302 having a static image content identifier and an associated static image compression data signature (step 310). Browser 110 requests compressed static image content associated with the static image content identifier (step 320).
As shown in FIG. 3, in another embodiment, a method 300 includes browsing a web page 302 having a static image content identifier and an associated static image compression data signature (step 310). In step 320, compressed image content associated with the static image content identifier is requested of a recompressing service 140 at a remote server. A transcoder 142 transcodes compressed static image content to a compressed video content such as a file (step 330). Recompression service 140 then returns the compressed video content to fulfill the browser 110 request. This can be done directly from the recompression service 140 or through web server 130.
Once recompression is completed or as it occurs in the case of streaming, decoder 120 decodes the received compressed video content based on the recognized video compression data signature to obtain static image data (step 340). Browser 110 then renders the obtained static image data for display in a browser window showing content corresponding to the received web page (step 350).
In other alternative examples, in step 330 recompression service 140 can send transcoded data to another client application or proxy service for decompressing rather the browser 110. For example, transcoder 142 can transcode images in a standard JPEG format toward more efficient compression derived from video compression standard and transmit the resulting bytes not to a browser directly, but to a decoding process (such as one carried out in a Google Toolbar) that will decode the result and transmit the resulting image bytes to the browser directly, on the client's side. In other example, a product such as iGoogle can request transcoding and use Google Toolbar as a decompressing proxy.
Further Examples and Programming Notes
Further examples implementing aspects of system 100 and methods 200 and 300, not intended to be limiting of the present invention, are described below.
Using VP8 as new <img> Format
In one example, system 100 and method 200 may include:
    • using Google VP8 format for <img> files, mainly to replace JPEG when possible;
    • using a lightweight VP8 keyframe decoder that works based on the assumption one is only decoding one keyframe; and
    • extending a Chrome browser with <img src=“picture.vp8”> or <video src=“picture.vp8”>, to further make the Web experience for a user faster.
    • In one example of a modified Chrome browser, example web pages were obtained with the JPEG images were converted to VP8, reducing size by factor 1.5.
    • Libraries or other tools may be used to convert data from and to VP8;
    • A tool may be used to convert PNG or JPEG to VP8 files.
      Transcoding
JPEG to Google VP8
In one example, transcoder 142 as described can convert a JPEG (or PNG) to Google VP8. One reason VP8 in an example is better than JPEG is due to mainly the use of spatial intra prediction. The Google VP8 coding may use spatial intra prediction modes (as opposed to the frequency-domain prediction one can find in JPEG/MPEG). Google VP8 examples may also have better coefficient coding, range coding instead of Huffman codes, variable block sizes (16×16/4×4), and two-stage transforms.
Low-Level Encoding and Decoding API
In an example, a simple one-call API may be used to compress and decompress VP8 data from and to raw YUV samples. One can convert between RGB and YUV.
Decoding
Keyframe Decoding
In one example, decoder 120 is a fast H.264 keyframe decoder that works based on the assumption one is only decoding one keyframe. This keyframe decoder example extends a Google Chrome browser with
    • <img src=“picture.264”> or <video src=“picture.264”>, and thereby makes a user experience of web browsing faster.
In another example, a page from YouTube was compared against its H.264 equivalent where all the JPEGs have been converted to H.264 using a constant moderate compression factor and a reduction of about 33% in size was obtained.
CONCLUSION
The embodiments have been described above with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed.
The foregoing description of the specific embodiments will so fully reveal the general nature of the invention that others can, by applying knowledge within the skill of the art, readily modify and/or adapt for various applications such specific embodiments, without undue experimentation, without departing from the general concept of the present invention. Therefore, such adaptations and modifications are intended to be within the meaning and range of equivalents of the disclosed embodiments, based on the teaching and guidance presented herein. It is to be understood that the phraseology or terminology herein is for the purpose of description and not of limitation, such that the terminology or phraseology of the present specification is to be interpreted by the skilled artisan in light of the teachings and guidance.
Exemplary embodiments of the present invention have been presented. The invention is not limited to these examples. These examples are presented herein for purposes of illustration, and not limitation. Alternatives (including equivalents, extensions, variations, deviations, etc., of those described herein) will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein. Such alternatives fall within the scope and spirit of the invention.

Claims (20)

What is claimed is:
1. A method comprising:
receiving, at a computing device having a browser, a web page that references a static image identifier;
requesting a static image file identified by the static image identifier from a web server using the browser, the static image identifier indicating that the static image file is encoded using a type of static image compression;
receiving a compressed video file in response to the request for the static image file;
recognizing that the compressed video file contains a video compression data signature by examining a plurality of bytes within the received compressed video file; and
decoding the received compressed video file using a type of video compression identified by the video compression data signature to obtain static image data encoded in the compressed video file.
2. The method of claim 1, wherein the static image identifier is included in a URL within an image tag in the received web page.
3. The method of claim 1, wherein the type of video compression more efficient than a type of static image compression used to encode image data in the static image file.
4. The method of claim 3, wherein the video compression data signature identifies a type of video compression selected from the group of VP8, H.264, and VC-1 video compression.
5. The method of claim 4, wherein the type of static image compression comprises a type of compression selected from the group of JPEG, GIF, and PNG static image compression.
6. The method of claim 1, wherein the decoding the received compressed video file is performed by a client application other than the browser, the client application configured to transmit the decoded static image data to the browser after decoding.
7. The method of claim 1, wherein the decoding the received compressed video file is performed by a keyframe decoder, the keyframe decoder having capability limited to decoding a video keyframe.
8. The method of claim 1, wherein the received compressed video file was transcoded from the requested static image file by a recompression service in response to the request for the static image file.
9. The method of claim 1, wherein the static image data includes a plurality of static images and each of the plurality of static images is rendered for display by the browser.
10. The method of claim 1, further comprising:
recompressing the decoded static image data using a type of static image compression selected from the group of JPEG, PNG, and GIF.
11. A system comprising:
a browser, configured to operate on a first computing device and browse a received web page including a static content identifier, the browser further being configured to request static image content associated with the static content identifier that is encoded using a type of static image compression;
wherein the browser receives, in response to the request, compressed video content that is a video compression of the requested static image content; and
wherein the browser employs a decoder that decodes the received compressed video content based on a video compression data signature associated with the compressed video content to obtain static image data, the video compression data signature recognized by examining a plurality of bytes within the compressed video content.
12. The system of claim 11, further comprising:
a client application configured to operate on the first computing device, wherein the decoder employed by the browser is included within the client application and is configured to transmit the decoded static image data to the browser after decoding.
13. The system of claim 11, wherein the decoder is a keyframe decoder, the keyframe decoder having capability limited to decoding a video keyframe.
14. The system of claim 11, wherein the received compressed video content was transcoded from the requested static image content by a recompression service in response to the request for the static image content.
15. The system of claim 11, wherein the static image data includes a plurality of static images and each of the plurality of static images is rendered for display by the browser.
16. The system of claim 11, wherein the decoder is configured to recompress the decoded static image data using a type of static image compression selected from the group of JPEG, PNG, and GIF.
17. A system comprising:
a plurality of computing devices, each computing device having at least one processor and at least one memory, wherein the memory of the plurality of computing devices include instructions for execution by the at least one processor, including instructions to:
receive a HTTP request from a web browser executing on a client device for static image content, the static image content within a static image file identified by a static image identifier,
transcode the requested static image content into a video compression file using a type of video compression, the video compression including a video compression signature, and
transmit the video compression file to the client device in response to the request for static image content; and
wherein the client device recognizes that the video compression file is encoded using a type of video compression by examining a plurality of bytes within the static image compression file.
18. The system of claim 17, wherein the instructions to receive the HTTP request from the web browser are included in a web server application stored in the memory of a first computing device of the plurality of computing devices, the web server application configured to be executed by the at least one processor of the first computing device, and wherein the instructions to transcode the requested static image content into a video compression file are included in a recompression service application stored in the memory of a second computing device of the plurality of computing devices, the recompression service application configured to be executed by the at least one processor of the second computing device.
19. The system of claim 18, wherein the recompression service includes a transcoder configured to transcode the requested static image content, wherein the transcoder is a keyframe encoder, the keyframe encoder having capability limited to encoding a video keyframe.
20. The system of claim 17, wherein a client application executed by the client device receives the transmitted video compression file, decodes the video compression file based on the recognized type of video compression to obtain static image data, recompresses the static image data using a type of static image compression, and transmits the recompressed static image data to the web browser.
US13/247,917 2010-09-28 2011-09-28 Systems and methods utilizing efficient video compression techniques for browsing of static image data Expired - Fee Related US8929459B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/247,917 US8929459B2 (en) 2010-09-28 2011-09-28 Systems and methods utilizing efficient video compression techniques for browsing of static image data

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US38731710P 2010-09-28 2010-09-28
US13/247,917 US8929459B2 (en) 2010-09-28 2011-09-28 Systems and methods utilizing efficient video compression techniques for browsing of static image data

Publications (2)

Publication Number Publication Date
US20120076210A1 US20120076210A1 (en) 2012-03-29
US8929459B2 true US8929459B2 (en) 2015-01-06

Family

ID=44789624

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/247,917 Expired - Fee Related US8929459B2 (en) 2010-09-28 2011-09-28 Systems and methods utilizing efficient video compression techniques for browsing of static image data
US13/247,920 Abandoned US20120079544A1 (en) 2010-09-28 2011-09-28 Systems and Methods Utilizing Efficient Video Compression Techniques for Providing Static Image Data

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/247,920 Abandoned US20120079544A1 (en) 2010-09-28 2011-09-28 Systems and Methods Utilizing Efficient Video Compression Techniques for Providing Static Image Data

Country Status (2)

Country Link
US (2) US8929459B2 (en)
WO (1) WO2012050832A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10157480B2 (en) 2016-06-24 2018-12-18 Microsoft Technology Licensing, Llc Efficient decoding and rendering of inter-coded blocks in a graphics pipeline
US10405003B2 (en) 2017-01-20 2019-09-03 Google Llc Image compression based on semantic relevance
US10575007B2 (en) 2016-04-12 2020-02-25 Microsoft Technology Licensing, Llc Efficient decoding and rendering of blocks in a graphics pipeline
US11197010B2 (en) 2016-10-07 2021-12-07 Microsoft Technology Licensing, Llc Browser-based video decoder using multiple CPU threads

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130142444A1 (en) * 2011-12-06 2013-06-06 Honeywell International, Inc. doing business as (d.b.a.) Honeywell Scanning & Mobility Hand held bar code readers or mobile computers with cloud computing services
US8485430B2 (en) 2011-12-06 2013-07-16 Honeywell International, Inc. Hand held bar code readers or mobile computers with cloud computing services
US9558386B2 (en) 2012-05-15 2017-01-31 Honeywell International, Inc. Encoded information reading terminal configured to pre-process images
US9064254B2 (en) 2012-05-17 2015-06-23 Honeywell International Inc. Cloud-based system for reading of decodable indicia
US9092683B2 (en) 2012-07-10 2015-07-28 Honeywell International Inc. Cloud-based system for processing of decodable indicia
TW201406158A (en) * 2012-07-18 2014-02-01 Hon Hai Prec Ind Co Ltd System and method for transmitting and displaying network videos
US9066071B2 (en) * 2012-11-12 2015-06-23 Samsung Electronics Co., Ltd. Method and apparatus for providing screen data
JP5717870B2 (en) * 2013-03-22 2015-05-13 株式会社東芝 COMMUNICATION DEVICE, COMMUNICATION METHOD, AND PROGRAM
WO2015056296A1 (en) * 2013-10-15 2015-04-23 株式会社 東芝 Electronic device and communication control method
CN109672888B (en) * 2018-09-25 2022-04-22 平安科技(深圳)有限公司 Picture compression method, equipment and computer readable storage medium
CN115379257A (en) * 2021-05-20 2022-11-22 阿里巴巴新加坡控股有限公司 Rendering method, device, system, storage medium and program product

Citations (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5481297A (en) * 1994-02-25 1996-01-02 At&T Corp. Multipoint digital video communication system
US5517246A (en) * 1992-06-29 1996-05-14 Canon Kabushiki Kaisha Image processing apparatus and method, and system thereof
US5539908A (en) * 1992-11-24 1996-07-23 International Business Machines Corporation Dynamically linked and shared compression/decompression
US5589945A (en) 1993-01-11 1996-12-31 Abecassis; Max Computer-themed playing system
US5659539A (en) 1995-07-14 1997-08-19 Oracle Corporation Method and apparatus for frame accurate access of digital audio-visual information
US5696869A (en) 1992-02-07 1997-12-09 Max Abecassis Variable-content-video provider system
US5767987A (en) 1994-09-26 1998-06-16 Ricoh Corporation Method and apparatus for combining multiple image scans for enhanced resolution
US5793647A (en) 1995-08-15 1998-08-11 Diffracto, Ltd. System and method for graphical image data acquistion, storage, and retrieval
US5822465A (en) * 1992-09-01 1998-10-13 Apple Computer, Inc. Image encoding by vector quantization of regions of an image and codebook updates
US5828370A (en) 1996-07-01 1998-10-27 Thompson Consumer Electronics Inc. Video delivery system and method for displaying indexing slider bar on the subscriber video screen
US5870754A (en) * 1996-04-25 1999-02-09 Philips Electronics North America Corporation Video retrieval of MPEG compressed sequences using DC and motion signatures
US5930493A (en) 1995-06-07 1999-07-27 International Business Machines Corporation Multimedia server system and method for communicating multimedia information
US5963203A (en) 1997-07-03 1999-10-05 Obvious Technology, Inc. Interactive video icon with designated viewing position
US5973696A (en) * 1996-08-08 1999-10-26 Agranat Systems, Inc. Embedded web server
US6014706A (en) 1997-01-30 2000-01-11 Microsoft Corporation Methods and apparatus for implementing control functions in a streamed video display system
US6031939A (en) * 1997-03-17 2000-02-29 Alcatel Method of optimizing the compression of image data, with automatic selection of compression conditions
US6112234A (en) 1997-07-01 2000-08-29 Leiper; Thomas W. Method for transfer of radiographic images
US6119154A (en) 1995-07-14 2000-09-12 Oracle Corporation Method and apparatus for non-sequential access to an in-progress video feed
US6185363B1 (en) 1997-06-02 2001-02-06 Philips Electronics North America Corporation Visual indexing system
US6195692B1 (en) * 1997-06-02 2001-02-27 Sony Corporation Television/internet system having multiple data stream connections
US6208765B1 (en) 1998-06-19 2001-03-27 Sarnoff Corporation Method and apparatus for improving image resolution
US6212302B1 (en) * 1998-12-29 2001-04-03 Eastman Kodak Company Method and apparatus for visually optimized rate control
US6252544B1 (en) * 1998-01-27 2001-06-26 Steven M. Hoffberg Mobile communication device
US6256423B1 (en) 1998-09-18 2001-07-03 Sarnoff Corporation Intra-frame quantizer selection for video compression
US6285804B1 (en) 1998-12-21 2001-09-04 Sharp Laboratories Of America, Inc. Resolution improvement from multiple images of a scene containing motion at fractional pixel values
US6292837B1 (en) 1997-10-30 2001-09-18 Daniel Miller Apparatus and method for non-sequential image data transmission and display
US20010055336A1 (en) * 1996-04-12 2001-12-27 Edward A. Krause Compressed-video reencoder system for modifying the compression ratio of digitally encoded video programs
US6349154B1 (en) 1997-12-22 2002-02-19 U.S. Philips Corporation Method and Arrangement for creating a high-resolution still picture
US6349151B1 (en) * 1998-12-29 2002-02-19 Eastman Kodak Company Method and apparatus for visually optimized compression parameters
US20020026639A1 (en) 2000-08-22 2002-02-28 Naoya Haneda Information processing system, information processing method, and recording medium
US6356545B1 (en) * 1997-08-08 2002-03-12 Clarent Corporation Internet telephone system with dynamically varying codec
US6356589B1 (en) * 1999-01-28 2002-03-12 International Business Machines Corporation Sharing reference data between multiple encoders parallel encoding a sequence of video frames
US20020033844A1 (en) * 1998-10-01 2002-03-21 Levy Kenneth L. Content sensitive connected content
US20020062482A1 (en) * 2000-11-22 2002-05-23 International Business Machines Corporation System and method for selectable semantic codec pairs for very low data-rate video transmission
US20020071485A1 (en) 2000-08-21 2002-06-13 Kerem Caglar Video coding
US20020097917A1 (en) * 2000-05-12 2002-07-25 Nelson William E. Method for compressing digital documents with control of image quality subject to multiple compression rate constraints
US6434197B1 (en) 1999-01-07 2002-08-13 General Instrument Corporation Multi-functional transcoder for compressed bit streams
US20030025648A1 (en) * 2001-08-06 2003-02-06 David Glen Wireless device method and apparatus with drawing command throttling control
US6538698B1 (en) 1998-08-28 2003-03-25 Flashpoint Technology, Inc. Method and system for sorting images in an image capture unit to ease browsing access
US20030133501A1 (en) * 1992-01-29 2003-07-17 Mitsubishi Denki Kabushiki Kaisha High-efficiency encoder and video information recording/reproducing apparatus
US20030142872A1 (en) * 2002-01-29 2003-07-31 Masahiko Koyanagi Image processing apparatus, decoding device, encoding device, image processing system, image processing method, and encoding method
US20030154190A1 (en) 2002-02-14 2003-08-14 Takeshi Misawa Image display apparatus and method and image management program
US20030174217A1 (en) 2002-03-15 2003-09-18 Fuji Photo Film Co., Ltd. Picture filing device, digital camera and frame-picture managing method
US6628845B1 (en) 1999-10-20 2003-09-30 Nec Laboratories America, Inc. Method for subpixel registration of images
US20030189652A1 (en) 2002-04-05 2003-10-09 Nobutoshi Takayama Imaging apparatus
US6650704B1 (en) 1999-10-25 2003-11-18 Irvine Sensors Corporation Method of producing a high quality, high resolution image from a sequence of low quality, low resolution images that are undersampled and subject to jitter
US20030215018A1 (en) 2002-05-14 2003-11-20 Macinnis Alexander G. System and method for transcoding entropy-coded bitstreams
US20030215011A1 (en) * 2002-05-17 2003-11-20 General Instrument Corporation Method and apparatus for transcoding compressed video bitstreams
US6654418B2 (en) 1997-02-14 2003-11-25 At&T Corp. Non-linear quantizer for video coding
US20040066968A1 (en) * 2002-10-07 2004-04-08 Infocus Corporation Data compression and decompression system and method
US20040100505A1 (en) 2002-11-21 2004-05-27 Cazier Robert Paul System for and method of prioritizing menu information
US6754181B1 (en) * 1996-11-18 2004-06-22 Mci Communications Corporation System and method for a directory service supporting a hybrid communication system architecture
US20040172440A1 (en) 2003-02-27 2004-09-02 Nobuyoshi Nakajima Image-printing system using peer-to-peer network
US6810149B1 (en) 2000-08-17 2004-10-26 Eastman Kodak Company Method and system for cataloging images
US20040220791A1 (en) * 2000-01-03 2004-11-04 Interactual Technologies, Inc. A California Corpor Personalization services for entities from multiple sources
US20040220926A1 (en) * 2000-01-03 2004-11-04 Interactual Technologies, Inc., A California Cpr[P Personalization services for entities from multiple sources
US20050018768A1 (en) * 2001-09-26 2005-01-27 Interact Devices, Inc. Systems, devices and methods for securely distributing highly-compressed multimedia content
US20050050043A1 (en) 2003-08-29 2005-03-03 Nokia Corporation Organization and maintenance of images using metadata
US20050050002A1 (en) * 2003-07-11 2005-03-03 Benjamin Slotznick Apparatus and method of presenting textual material to enhance readability for people who have difficulty distinguishing left from right
US6907079B2 (en) 2002-05-01 2005-06-14 Thomson Licensing S.A. Deblocking filter conditioned on pixel brightness
US20050192924A1 (en) 2004-02-17 2005-09-01 Microsoft Corporation Rapid visual sorting of digital files and data
US20050193408A1 (en) * 2000-07-24 2005-09-01 Vivcom, Inc. Generating, transporting, processing, storing and presenting segmentation information for audio-visual programs
US20050204041A1 (en) * 2004-03-10 2005-09-15 Microsoft Corporation Cross-domain authentication
US20050210145A1 (en) * 2000-07-24 2005-09-22 Vivcom, Inc. Delivering and processing multimedia bookmark
US20050216186A1 (en) 2004-03-24 2005-09-29 Dorfman Barnaby M System and method for displaying images in an online directory
US20050220352A1 (en) 2002-03-28 2005-10-06 Wemelsfelder Armand V Video encoding with constrained fluctuations of quantizer scale
US20050276323A1 (en) 2002-09-27 2005-12-15 Vanguard Software Solutions, Inc. Real-time video coding/decoding
US20060047967A1 (en) * 2004-08-31 2006-03-02 Akhan Mehmet B Method and system for data authentication for use with computer systems
US20060090141A1 (en) 2001-05-23 2006-04-27 Eastman Kodak Company Method and system for browsing large digital multimedia object collections
US20060098738A1 (en) 2003-01-09 2006-05-11 Pamela Cosman Video encoding methods and devices
US20060195881A1 (en) * 2004-12-08 2006-08-31 Imagine Communications, Ltd. Distributed statistical multiplexing of multi-media
US20060200475A1 (en) 2005-03-04 2006-09-07 Eastman Kodak Company Additive clustering of images lacking individualized date-time information
US7130472B2 (en) * 2002-01-21 2006-10-31 Canon Kabushiki Kaisha Image distribution apparatus, communication terminal apparatus, and control method thereof
US20070025441A1 (en) 2005-07-28 2007-02-01 Nokia Corporation Method, module, device and system for rate control provision for video encoders capable of variable bit rate encoding
US7218674B2 (en) 2003-11-10 2007-05-15 Mediatek Incorporation Method and device for controlling quantization scales of a video encoding bit stream
US20070177673A1 (en) 2006-01-12 2007-08-02 Lg Electronics Inc. Processing multiview video
US7263125B2 (en) 2002-04-23 2007-08-28 Nokia Corporation Method and device for indicating quantizer parameters in a video coding system
US20080049971A1 (en) * 2000-03-24 2008-02-28 Ramos Daniel O Systems and methods for processing content objects
EP1903698A2 (en) 2006-09-25 2008-03-26 Vdl Method and apparatus for generating digital audio signals including images
US20080168489A1 (en) * 2007-01-10 2008-07-10 Steven Schraga Customized program insertion system
US7403662B2 (en) 2003-08-21 2008-07-22 International Business Machines Corporation Browsing JPEG images using MPEG hardware chips
US7415662B2 (en) 2000-01-31 2008-08-19 Adobe Systems Incorporated Digital media management apparatus and methods
US20090138484A1 (en) * 1998-10-01 2009-05-28 Ramos Daniel O Method for Enhancing Content using Persistent Content Identification
WO2009066284A2 (en) * 2007-11-20 2009-05-28 Ubstream Ltd. A method and system for compressing digital video streams
US7602997B2 (en) 2005-01-19 2009-10-13 The United States Of America As Represented By The Secretary Of The Army Method of super-resolving images
US7627227B2 (en) * 2004-05-17 2009-12-01 Microsoft Corporation Reverse presentation of digital media streams
US20100023979A1 (en) * 2008-07-25 2010-01-28 Time Warner Cable Inc. System and method for sharing digital images over a content-based network
US20100042747A1 (en) * 2008-01-04 2010-02-18 Zoran Corporation Transcoding content for maximizing playback abilities in a switch enabled device
US20100070608A1 (en) 2008-09-10 2010-03-18 Ripcode, Inc. System and method for delivering content
US20100067822A1 (en) 2005-01-19 2010-03-18 U.S. Government As Represented By The Secretary Of The Army System and method of super-resolution imaging from a sequence of translated and rotated low-resolution images
US20100086028A1 (en) 2007-04-16 2010-04-08 Kabushiki Kaisha Toshiba Video encoding and decoding method and apparatus
US20100118945A1 (en) 2007-03-29 2010-05-13 Kabushiki Kaisha Toshiba Method and apparatus for video encoding and decoding
US8045480B2 (en) * 2004-12-02 2011-10-25 Cisco Technology, Inc. Intelligent provisioning of DSP channels for codec changes
US20110264676A1 (en) 2010-04-26 2011-10-27 Adi Belan Method and system for providing the download of transcoded files
US20120201475A1 (en) 2009-10-05 2012-08-09 I.C.V.T. Ltd. Method and system for processing an image
US8359656B2 (en) 2002-12-11 2013-01-22 Broadcom Corporation Media processing system supporting different media formats via server-based transcoding
US8508651B2 (en) 2007-04-06 2013-08-13 Canon Kabushiki Kaisha Image stabilizing apparatus, image pick-up apparatus and image stabilizing method

Patent Citations (100)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030133501A1 (en) * 1992-01-29 2003-07-17 Mitsubishi Denki Kabushiki Kaisha High-efficiency encoder and video information recording/reproducing apparatus
US5696869A (en) 1992-02-07 1997-12-09 Max Abecassis Variable-content-video provider system
US5517246A (en) * 1992-06-29 1996-05-14 Canon Kabushiki Kaisha Image processing apparatus and method, and system thereof
US5822465A (en) * 1992-09-01 1998-10-13 Apple Computer, Inc. Image encoding by vector quantization of regions of an image and codebook updates
US5539908A (en) * 1992-11-24 1996-07-23 International Business Machines Corporation Dynamically linked and shared compression/decompression
US5589945A (en) 1993-01-11 1996-12-31 Abecassis; Max Computer-themed playing system
US5481297A (en) * 1994-02-25 1996-01-02 At&T Corp. Multipoint digital video communication system
US5767987A (en) 1994-09-26 1998-06-16 Ricoh Corporation Method and apparatus for combining multiple image scans for enhanced resolution
US5930493A (en) 1995-06-07 1999-07-27 International Business Machines Corporation Multimedia server system and method for communicating multimedia information
US5659539A (en) 1995-07-14 1997-08-19 Oracle Corporation Method and apparatus for frame accurate access of digital audio-visual information
US6119154A (en) 1995-07-14 2000-09-12 Oracle Corporation Method and apparatus for non-sequential access to an in-progress video feed
US5793647A (en) 1995-08-15 1998-08-11 Diffracto, Ltd. System and method for graphical image data acquistion, storage, and retrieval
US20010055336A1 (en) * 1996-04-12 2001-12-27 Edward A. Krause Compressed-video reencoder system for modifying the compression ratio of digitally encoded video programs
US5870754A (en) * 1996-04-25 1999-02-09 Philips Electronics North America Corporation Video retrieval of MPEG compressed sequences using DC and motion signatures
US5903264A (en) 1996-07-01 1999-05-11 Sun Microsystems, Inc. Video delivery system and method for displaying an indexing slider bar
US5828370A (en) 1996-07-01 1998-10-27 Thompson Consumer Electronics Inc. Video delivery system and method for displaying indexing slider bar on the subscriber video screen
US5973696A (en) * 1996-08-08 1999-10-26 Agranat Systems, Inc. Embedded web server
US6754181B1 (en) * 1996-11-18 2004-06-22 Mci Communications Corporation System and method for a directory service supporting a hybrid communication system architecture
US6014706A (en) 1997-01-30 2000-01-11 Microsoft Corporation Methods and apparatus for implementing control functions in a streamed video display system
US6654418B2 (en) 1997-02-14 2003-11-25 At&T Corp. Non-linear quantizer for video coding
US6031939A (en) * 1997-03-17 2000-02-29 Alcatel Method of optimizing the compression of image data, with automatic selection of compression conditions
US6195692B1 (en) * 1997-06-02 2001-02-27 Sony Corporation Television/internet system having multiple data stream connections
US6185363B1 (en) 1997-06-02 2001-02-06 Philips Electronics North America Corporation Visual indexing system
US6112234A (en) 1997-07-01 2000-08-29 Leiper; Thomas W. Method for transfer of radiographic images
US5963203A (en) 1997-07-03 1999-10-05 Obvious Technology, Inc. Interactive video icon with designated viewing position
US6356545B1 (en) * 1997-08-08 2002-03-12 Clarent Corporation Internet telephone system with dynamically varying codec
US6292837B1 (en) 1997-10-30 2001-09-18 Daniel Miller Apparatus and method for non-sequential image data transmission and display
US6349154B1 (en) 1997-12-22 2002-02-19 U.S. Philips Corporation Method and Arrangement for creating a high-resolution still picture
US6252544B1 (en) * 1998-01-27 2001-06-26 Steven M. Hoffberg Mobile communication device
US6208765B1 (en) 1998-06-19 2001-03-27 Sarnoff Corporation Method and apparatus for improving image resolution
US6538698B1 (en) 1998-08-28 2003-03-25 Flashpoint Technology, Inc. Method and system for sorting images in an image capture unit to ease browsing access
US6256423B1 (en) 1998-09-18 2001-07-03 Sarnoff Corporation Intra-frame quantizer selection for video compression
US20020033844A1 (en) * 1998-10-01 2002-03-21 Levy Kenneth L. Content sensitive connected content
US20090138484A1 (en) * 1998-10-01 2009-05-28 Ramos Daniel O Method for Enhancing Content using Persistent Content Identification
US6285804B1 (en) 1998-12-21 2001-09-04 Sharp Laboratories Of America, Inc. Resolution improvement from multiple images of a scene containing motion at fractional pixel values
US6349151B1 (en) * 1998-12-29 2002-02-19 Eastman Kodak Company Method and apparatus for visually optimized compression parameters
US6212302B1 (en) * 1998-12-29 2001-04-03 Eastman Kodak Company Method and apparatus for visually optimized rate control
US6434197B1 (en) 1999-01-07 2002-08-13 General Instrument Corporation Multi-functional transcoder for compressed bit streams
US6356589B1 (en) * 1999-01-28 2002-03-12 International Business Machines Corporation Sharing reference data between multiple encoders parallel encoding a sequence of video frames
US6628845B1 (en) 1999-10-20 2003-09-30 Nec Laboratories America, Inc. Method for subpixel registration of images
US6650704B1 (en) 1999-10-25 2003-11-18 Irvine Sensors Corporation Method of producing a high quality, high resolution image from a sequence of low quality, low resolution images that are undersampled and subject to jitter
US20040220791A1 (en) * 2000-01-03 2004-11-04 Interactual Technologies, Inc. A California Corpor Personalization services for entities from multiple sources
US20040220926A1 (en) * 2000-01-03 2004-11-04 Interactual Technologies, Inc., A California Cpr[P Personalization services for entities from multiple sources
US7415662B2 (en) 2000-01-31 2008-08-19 Adobe Systems Incorporated Digital media management apparatus and methods
US20080049971A1 (en) * 2000-03-24 2008-02-28 Ramos Daniel O Systems and methods for processing content objects
US20020097917A1 (en) * 2000-05-12 2002-07-25 Nelson William E. Method for compressing digital documents with control of image quality subject to multiple compression rate constraints
US20050210145A1 (en) * 2000-07-24 2005-09-22 Vivcom, Inc. Delivering and processing multimedia bookmark
US20050193408A1 (en) * 2000-07-24 2005-09-01 Vivcom, Inc. Generating, transporting, processing, storing and presenting segmentation information for audio-visual programs
US6810149B1 (en) 2000-08-17 2004-10-26 Eastman Kodak Company Method and system for cataloging images
US20020071485A1 (en) 2000-08-21 2002-06-13 Kerem Caglar Video coding
US20020026639A1 (en) 2000-08-22 2002-02-28 Naoya Haneda Information processing system, information processing method, and recording medium
US20020062482A1 (en) * 2000-11-22 2002-05-23 International Business Machines Corporation System and method for selectable semantic codec pairs for very low data-rate video transmission
US20060090141A1 (en) 2001-05-23 2006-04-27 Eastman Kodak Company Method and system for browsing large digital multimedia object collections
US20060028399A1 (en) * 2001-08-06 2006-02-09 David Glen Wireless device method and apparatus with drawing command throttling control
US20030025648A1 (en) * 2001-08-06 2003-02-06 David Glen Wireless device method and apparatus with drawing command throttling control
US20050018768A1 (en) * 2001-09-26 2005-01-27 Interact Devices, Inc. Systems, devices and methods for securely distributing highly-compressed multimedia content
US7130472B2 (en) * 2002-01-21 2006-10-31 Canon Kabushiki Kaisha Image distribution apparatus, communication terminal apparatus, and control method thereof
US20030142872A1 (en) * 2002-01-29 2003-07-31 Masahiko Koyanagi Image processing apparatus, decoding device, encoding device, image processing system, image processing method, and encoding method
US20030154190A1 (en) 2002-02-14 2003-08-14 Takeshi Misawa Image display apparatus and method and image management program
US20030174217A1 (en) 2002-03-15 2003-09-18 Fuji Photo Film Co., Ltd. Picture filing device, digital camera and frame-picture managing method
US20050220352A1 (en) 2002-03-28 2005-10-06 Wemelsfelder Armand V Video encoding with constrained fluctuations of quantizer scale
US20030189652A1 (en) 2002-04-05 2003-10-09 Nobutoshi Takayama Imaging apparatus
US7263125B2 (en) 2002-04-23 2007-08-28 Nokia Corporation Method and device for indicating quantizer parameters in a video coding system
US6907079B2 (en) 2002-05-01 2005-06-14 Thomson Licensing S.A. Deblocking filter conditioned on pixel brightness
US20030215018A1 (en) 2002-05-14 2003-11-20 Macinnis Alexander G. System and method for transcoding entropy-coded bitstreams
US20030215011A1 (en) * 2002-05-17 2003-11-20 General Instrument Corporation Method and apparatus for transcoding compressed video bitstreams
US20050276323A1 (en) 2002-09-27 2005-12-15 Vanguard Software Solutions, Inc. Real-time video coding/decoding
US20040066968A1 (en) * 2002-10-07 2004-04-08 Infocus Corporation Data compression and decompression system and method
US20040100505A1 (en) 2002-11-21 2004-05-27 Cazier Robert Paul System for and method of prioritizing menu information
US8359656B2 (en) 2002-12-11 2013-01-22 Broadcom Corporation Media processing system supporting different media formats via server-based transcoding
US20060098738A1 (en) 2003-01-09 2006-05-11 Pamela Cosman Video encoding methods and devices
US20040172440A1 (en) 2003-02-27 2004-09-02 Nobuyoshi Nakajima Image-printing system using peer-to-peer network
US20050050002A1 (en) * 2003-07-11 2005-03-03 Benjamin Slotznick Apparatus and method of presenting textual material to enhance readability for people who have difficulty distinguishing left from right
US7403662B2 (en) 2003-08-21 2008-07-22 International Business Machines Corporation Browsing JPEG images using MPEG hardware chips
US20050050043A1 (en) 2003-08-29 2005-03-03 Nokia Corporation Organization and maintenance of images using metadata
US7218674B2 (en) 2003-11-10 2007-05-15 Mediatek Incorporation Method and device for controlling quantization scales of a video encoding bit stream
US20050192924A1 (en) 2004-02-17 2005-09-01 Microsoft Corporation Rapid visual sorting of digital files and data
US20050204041A1 (en) * 2004-03-10 2005-09-15 Microsoft Corporation Cross-domain authentication
US20050216186A1 (en) 2004-03-24 2005-09-29 Dorfman Barnaby M System and method for displaying images in an online directory
US7627227B2 (en) * 2004-05-17 2009-12-01 Microsoft Corporation Reverse presentation of digital media streams
US20060047967A1 (en) * 2004-08-31 2006-03-02 Akhan Mehmet B Method and system for data authentication for use with computer systems
US8045480B2 (en) * 2004-12-02 2011-10-25 Cisco Technology, Inc. Intelligent provisioning of DSP channels for codec changes
US20060195881A1 (en) * 2004-12-08 2006-08-31 Imagine Communications, Ltd. Distributed statistical multiplexing of multi-media
US7602997B2 (en) 2005-01-19 2009-10-13 The United States Of America As Represented By The Secretary Of The Army Method of super-resolving images
US20100067822A1 (en) 2005-01-19 2010-03-18 U.S. Government As Represented By The Secretary Of The Army System and method of super-resolution imaging from a sequence of translated and rotated low-resolution images
US20060200475A1 (en) 2005-03-04 2006-09-07 Eastman Kodak Company Additive clustering of images lacking individualized date-time information
US20070025441A1 (en) 2005-07-28 2007-02-01 Nokia Corporation Method, module, device and system for rate control provision for video encoders capable of variable bit rate encoding
US20070177673A1 (en) 2006-01-12 2007-08-02 Lg Electronics Inc. Processing multiview video
EP1903698A2 (en) 2006-09-25 2008-03-26 Vdl Method and apparatus for generating digital audio signals including images
US20080168489A1 (en) * 2007-01-10 2008-07-10 Steven Schraga Customized program insertion system
US20100118945A1 (en) 2007-03-29 2010-05-13 Kabushiki Kaisha Toshiba Method and apparatus for video encoding and decoding
US8508651B2 (en) 2007-04-06 2013-08-13 Canon Kabushiki Kaisha Image stabilizing apparatus, image pick-up apparatus and image stabilizing method
US20100086028A1 (en) 2007-04-16 2010-04-08 Kabushiki Kaisha Toshiba Video encoding and decoding method and apparatus
US20110211637A1 (en) * 2007-11-20 2011-09-01 Ub Stream Ltd. Method and system for compressing digital video streams
WO2009066284A2 (en) * 2007-11-20 2009-05-28 Ubstream Ltd. A method and system for compressing digital video streams
US20100042747A1 (en) * 2008-01-04 2010-02-18 Zoran Corporation Transcoding content for maximizing playback abilities in a switch enabled device
US20100023979A1 (en) * 2008-07-25 2010-01-28 Time Warner Cable Inc. System and method for sharing digital images over a content-based network
US20100070608A1 (en) 2008-09-10 2010-03-18 Ripcode, Inc. System and method for delivering content
US20120201475A1 (en) 2009-10-05 2012-08-09 I.C.V.T. Ltd. Method and system for processing an image
US20110264676A1 (en) 2010-04-26 2011-10-27 Adi Belan Method and system for providing the download of transcoded files

Non-Patent Citations (31)

* Cited by examiner, † Cited by third party
Title
"Implementors' Guide; Series H: Audiovisual and Multimedia Systems; Coding of moving video: Implementors Guide for H.264: Advanced video coding for generic audiovisual services". H.264. International Telecommunication Union. Version 12. Dated Jul. 30, 2010.
"Overview; VP7 Data Format and Decoder". Version 1.5. On2 Technologies, Inc. Dated Mar. 28, 2005.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video". H.264. Advanced video coding for generic audiovisual services. International Telecommunication Union. Version 11. Dated Mar. 2009.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video". H.264. Advanced video coding for generic audiovisual services. International Telecommunication Union. Version 11. Dated Mar. 2009.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video". H.264. Advanced video coding for generic audiovisual services. International Telecommunication Union. Version 12. Dated Mar. 2010.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video". H.264. Advanced video coding for generic audiovisual services. International Telecommunication Union. Version 12. Dated Mar. 2010.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video". H.264. Advanced video coding for generic audiovisual services. Version 8. International Telecommunication Union. Dated Nov. 1, 2007.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video". H.264. Advanced video coding for generic audiovisual services. Version 8. International Telecommunication Union. Dated Nov. 1, 2007.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video". H.264. Amendment 2: New profiles for professional applications. International Telecommunication Union. Dated Apr. 2007.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video". H.264. Amendment 2: New profiles for professional applications. International Telecommunication Union. Dated Apr. 2007.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video; Advanced video coding for generic audiovisual services". H.264. Amendment 1: Support of additional colour spaces and removal of the High 4:4:4 Profile. International Telecommunication Union. Dated Jun. 2006.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services". H.264. Amendment 1: Support of additional colour spaces and removal of the High 4:4:4 Profile. International Telecommunication Union. Dated Jun. 2006.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video; Advanced video coding for generic audiovisual services". H.264. Version 1. International Telecommunication Union. Dated May 2003.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services". H.264. Version 1. International Telecommunication Union. Dated May 2003.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video; Advanced video coding for generic audiovisual services". H.264. Version 3. International Telecommunication Union. Dated Mar. 2005.
"Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services". H.264. Version 3. International Telecommunication Union. Dated Mar. 2005.
"VP6 Bitstream & Decoder Specification". Version 1.02. On2 Technologies, Inc. Dated Aug. 17, 2006.
"VP6 Bitstream & Decoder Specification". Version 1.03. On2 Technologies, Inc. Dated Oct. 29, 2007.
"VP8 Data Format and Decoding Guide". WebM Project. Google On2. Dated: Dec. 1, 2010.
Fan. Z., & de Queiroz, R.L. (Feb. 2003). Identification of bitmap compression history: JPEG detection and quantizer estimation. IEEE Transactions on Image Processing, 12(2), 230-5. doi:http://dx.doi.org/10.1109/TIP.2002.807361.
Final Office Action mailed Feb. 11, 2014, in co-pending U.S. Appl. No. 13/247,920, 16 pp.
Non-Final Office Action mailed Nov. 6, 2013, in co-pending U.S. Appl. No. 13/247,920, 19 pp.
Sarkar et al, Modeling Full-Length Video Using Markov-Modulated Gamma-Based Framework, 2001. *
The International Search Report and the Written Opinion of the International Searching Authority, International Application No. PCT/US2011/053460, mailed on Dec. 16, 2011, 12 pages.
Wikipedia, the free encyclopedia, "Graphics Interchange Format", downloaded Jun. 24, 2014, 15 pp, http://en.wikipedia.org/w/index.php?title=Graphics-Interchange-Format&oldid=379610957.
Wikipedia, the free encyclopedia, "Graphics Interchange Format", downloaded Jun. 24, 2014, 15 pp, http://en.wikipedia.org/w/index.php?title=Graphics—Interchange—Format&oldid=379610957.
Wikipedia, the free encyclopedia, "JPEG", downloaded Jun. 24, 2014, 15 pp, http://en.wikipedia.org/w/index.php?title=JPEG&oldid=387366433.
Wikipedia, the free encyclopedia, "Motion JPEG", downloaded Jun. 24, 2014, 5 pp, http://en.wikipedia.org/w/index.php?title=Motion-JPEG&oldid=386187797.
Wikipedia, the free encyclopedia, "Motion JPEG", downloaded Jun. 24, 2014, 5 pp, http://en.wikipedia.org/w/index.php?title=Motion—JPEG&oldid=386187797.
Wikipedia, the free encyclopedia, "Portable Network Graphics", downloaded Jun. 24, 2014, 19 pp, http://en.wikipedia.org/w/index.php?title=Portable-Network-Graphics&oldid=386636989#Animation.
Wikipedia, the free encyclopedia, "Portable Network Graphics", downloaded Jun. 24, 2014, 19 pp, http://en.wikipedia.org/w/index.php?title=Portable—Network—Graphics&oldid=386636989#Animation.

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10575007B2 (en) 2016-04-12 2020-02-25 Microsoft Technology Licensing, Llc Efficient decoding and rendering of blocks in a graphics pipeline
US10157480B2 (en) 2016-06-24 2018-12-18 Microsoft Technology Licensing, Llc Efficient decoding and rendering of inter-coded blocks in a graphics pipeline
US11197010B2 (en) 2016-10-07 2021-12-07 Microsoft Technology Licensing, Llc Browser-based video decoder using multiple CPU threads
US10405003B2 (en) 2017-01-20 2019-09-03 Google Llc Image compression based on semantic relevance

Also Published As

Publication number Publication date
WO2012050832A1 (en) 2012-04-19
US20120079544A1 (en) 2012-03-29
US20120076210A1 (en) 2012-03-29

Similar Documents

Publication Publication Date Title
US8929459B2 (en) Systems and methods utilizing efficient video compression techniques for browsing of static image data
US10567809B2 (en) Selective media playing method and apparatus according to live streaming and recorded streaming
US10645405B2 (en) Script-based video rendering
RU2475832C1 (en) Methods and systems for processing document object models (dom) to process video content
US10979785B2 (en) Media playback apparatus and method for synchronously reproducing video and audio on a web browser
US8656443B2 (en) Method and system for providing dynamic time slice encoding for complete internet anywhere
US11178467B1 (en) Use video codecs to deliver images
US20150381987A1 (en) Drawing system, information processing apparatus for drawing, and drawing control method
US9674523B2 (en) Methods and apparatus for transcoding digital video
US20240064388A1 (en) Decoding a video stream within a browser
US10547878B2 (en) Hybrid transmission protocol
US9219948B2 (en) Method and system for compression and decompression for handling web content
KR102247887B1 (en) System for cloud streaming service, method of cloud streaming service using source information and apparatus for the same
De Neve et al. Improved BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)
CN114040198A (en) Image data optimization device and method
De Neve et al. Analysis of BSDL-based content adaptation for JPEG 2000 and HD Photo (JPEG XR)

Legal Events

Date Code Title Description
AS Assignment

Owner name: GOOGLE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MASSIMINO, PASCAL;REEL/FRAME:027097/0340

Effective date: 20110927

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: GOOGLE LLC, CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:GOOGLE INC.;REEL/FRAME:044277/0001

Effective date: 20170929

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230106