US9639260B2 - Application programming interfaces for gesture operations - Google Patents

Application programming interfaces for gesture operations Download PDF

Info

Publication number
US9639260B2
US9639260B2 US13/251,150 US201113251150A US9639260B2 US 9639260 B2 US9639260 B2 US 9639260B2 US 201113251150 A US201113251150 A US 201113251150A US 9639260 B2 US9639260 B2 US 9639260B2
Authority
US
United States
Prior art keywords
input
gesture
function call
event function
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US13/251,150
Other versions
US20120023461A1 (en
Inventor
Christopher Blumenberg
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Inc filed Critical Apple Inc
Priority to US13/251,150 priority Critical patent/US9639260B2/en
Publication of US20120023461A1 publication Critical patent/US20120023461A1/en
Application granted granted Critical
Publication of US9639260B2 publication Critical patent/US9639260B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0414Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G06F9/4443
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/802D [Two Dimensional] animation, e.g. using sprites
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04105Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04806Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Definitions

  • This disclosure relates to application programming interfaces that provide gesture operations.
  • An API is a source code interface that a computer system or program library provides in order to support requests for services from a software application.
  • An API is specified in terms of a programming language that can be interpretative or compiled when an application is built, rather than an explicit low level description of how data is laid out in memory.
  • the software that provides the functionality described by an API is said to be an implementation of the API.
  • Various devices such as electronic devices, computing systems, portable devices, and handheld devices have software applications.
  • the API interfaces between the software applications and user interface software to provide a user of the device with certain features and operations.
  • a user may desire certain operations such as scrolling, selecting, gesturing, and animating operations for a display of the device.
  • Scrolling is the act of sliding a directional (e.g., horizontal or vertical) presentation of content, such as text, drawings, or images, across a screen or display window.
  • a directional presentation of content such as text, drawings, or images
  • Scrolling is done with the help of a scrollbar or using keyboard shortcuts, often the arrow keys.
  • Gesturing is a type of user input with two or more input points.
  • Animating operations include changing content within a given time period.
  • the various types of devices may have a limited display size, user interface, software, API interface and/or processing capability which limits the ease of use of the devices.
  • User interfaces of devices implement APIs in order to provide requested functionality and features. These user interfaces can have difficulty interpreting the various types of user inputs and providing the intended functionality associated with the user inputs.
  • At least certain embodiments of the present disclosure include one or more application programming interfaces in an environment with user interface software interacting with a software application.
  • Various function calls or messages are transferred via the application programming interfaces between the user interface software and software applications.
  • Example application programming interfaces transfer function calls to implement scrolling, gesturing, and animating operations for a device.
  • At least certain embodiments of the present disclosure include an environment with user interface software interacting with a software application.
  • a method for operating through an application programming interface (API) in this environment includes transferring a set bounce call.
  • the method further includes setting at least one of maximum and minimum bounce values.
  • the set bounce call causes a bounce of a scrolled region in an opposite direction of a scroll based on a region past an edge of the scrolled region being visible in a display region at the end of the scroll.
  • At least certain embodiments of the present disclosure include an environment with user interface software interacting with a software application.
  • a method for operating through an application programming interface (API) in this environment includes transferring a rubberband call. Rubberbanding a scrolled region within a display region occurs by a predetermined maximum displacement when the scrolled region exceeds a display edge. The method further includes transferring an edge rubberband call to set displacement values for at least one edge of the display (e.g., top and bottom edges, left and right edges).
  • API application programming interface
  • At least certain embodiments of the present disclosure include an environment with user interface software interacting with a software application to provide gesture operations for a display of a device.
  • a method for operating through an application programming interface (API) in this environment includes transferring a scaling transform call.
  • the gesture operations include performing a scaling transform such as a zoom in or zoom out in response to a user input having two or more input points.
  • the gesture operations also include performing a rotation transform to rotate an image or view in response to a user input having two or more input points.
  • At least certain embodiments of the present disclosure include a method for performing animations for a display of a device.
  • the method includes starting at least one animation.
  • the method further includes determining the progress of each animation.
  • the method further includes completing each animation based on a single timer.
  • the single timer can be based on a redraw interval of the display hardware.
  • FIG. 1 is flow chart of a method for responding to a user input of a data processing device
  • FIG. 2 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 3 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 4 is a schematic diagram illustrating an embodiment of user interface of a portable electronic device 400 having a touch-sensitive display 408 ;
  • FIG. 5A-5C illustrate at least some embodiments of user interface of a portable electronic device 400 having a touch-sensitive display
  • FIG. 6A-6D illustrate the scrolling of a list of items to a terminus of the list, at which point an area beyond the terminus is displayed and the list is then scrolled in an opposite direction until the area beyond the terminus is no longer displayed, in accordance with some embodiments;
  • FIG. 7 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 8 illustrates first and second scroll angles for locking a scroll of a display of a device in a horizontal or vertical direction according to certain teachings of the present disclosure
  • FIG. 9 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • FIG. 10 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 11 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 12 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 13 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 14 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 15 illustrates a display of a device having a scaling transform of a view
  • FIGS. 16A and 16B illustrate a display of a device with a view having a first and a second scaling factor
  • FIG. 16C illustrates changing a view from a scale factor of 2 ⁇ to a scale factor of 1 ⁇ in at least some embodiments of the present disclosure
  • FIG. 17 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 18 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIG. 19 is flow chart of a method for animating views displayed on a display of a device
  • FIG. 20 is flow chart of a method for animating views displayed on a display of a device
  • FIG. 21 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure
  • FIGS. 22A and 22B illustrate synchronizing the resizing of windows of a display of a device
  • FIG. 23 illustrates a method for switching ownership of a view of an application displayed on a display of a data processing device
  • FIG. 24 illustrates a method for memory management of a view of an application displayed on a display of a device
  • FIGS. 25A and 25B illustrate a data structure having a hierarchy of layers with a layer being associated with a view
  • FIG. 26 illustrates a method for compositing media and non-media content of user interface for display on a device
  • FIG. 27 illustrates a data structure or layer tree having a hierarchy of layers
  • FIG. 28 is a perspective view of a device in accordance with one embodiment of the present disclosure.
  • FIG. 29 is a perspective view of a device in accordance with one embodiment of the present disclosure.
  • FIGS. 30A and 30B are perspective views of a wireless device in accordance with one embodiment of the present disclosure.
  • FIG. 31 is a block diagram of a system in which embodiments of the present disclosure can be implemented.
  • FIG. 32 shows another example of a device in accordance with one embodiment of the present disclosure
  • FIG. 33A is a perspective view of a device in a first configuration (e.g. in a laptop configuration) in accordance with one embodiment of the present disclosure
  • FIG. 33B is a perspective view of the device of FIG. 33A in a second configuration (e.g. a transition configuration) in accordance with one embodiment of the present disclosure
  • FIG. 33C is a perspective view of the device of FIG. 33A in a third configuration (e.g., a tablet configuration) in accordance with one embodiment of the present disclosure.
  • FIG. 34 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the present disclosure can relate to an apparatus for performing one or more of the operations described herein.
  • This apparatus may be specially constructed for the required purposes, or it may comprise a general purpose computer selectively activated or reconfigured by a computer program stored in the computer.
  • a computer program may be stored in a machine (e.g.
  • ROMs read-only memories
  • RAMs random access memories
  • EPROMs erasable programmable ROMs
  • EEPROMs electrically erasable programmable ROMs
  • flash memory magnetic or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a bus.
  • a machine-readable medium includes any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer).
  • a machine-readable medium includes read only memory (“ROM”); random access memory (“RAM”); magnetic disk storage media; optical storage media; flash memory devices; electrical, optical, acoustical or other form of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.); etc.
  • At least certain embodiments of the present disclosure include one or application programming interfaces in an environment with user interface software interacting with a software application.
  • Various function calls or messages are transferred via the application programming interfaces between the user interface software and software applications. Transferring the function calls or messages may include issuing, initiating, invoking or receiving the function calls or messages.
  • Example application programming interfaces transfer function calls to implement scrolling, gesturing, and animating operations for a device having a display region.
  • An API may also implement functions having parameters, variables, or pointers. An API may receive parameters as disclosed or other combinations of parameters.
  • other APIs individually or in combination can perform similar functionality as the disclosed APIs.
  • the display region is a form of a window.
  • a window is a display region which may not have a border and may be the entire display region or area of a display.
  • a display region may have at least one window and/or at least one view (e.g., web, text, or image content).
  • a window may have at least one view.
  • the methods, systems, and apparatuses disclosed can be implemented with display regions, windows, and/or views.
  • At least certain embodiments of the present disclosure include scrolling operations for scrolling a display of a device.
  • the scrolling operations include bouncing a scrolled region in an opposite direction of a scroll when a scroll completes, rubberbanding a scrolled region by a predetermined maximum displacement when the scrolled region exceeds a display edge, and setting a scrolling angle that locks the scroll in a horizontal or vertical direction.
  • gesture operations for a display of a device include performing a scaling transform such as a zoom in or zoom out in response to a user input having two or more input points.
  • the gesture operations also include performing a rotation transform to rotate an image or view in response to a user input having two or more input points.
  • At least certain embodiments of the present disclosure include a method for performing animations for a display of a device.
  • the method includes starting at least one animation.
  • the method further includes determining the progress of each animation.
  • the method further includes completing each animation based on a single timer.
  • the single timer can be based on a redraw interval of the display hardware.
  • At least certain embodiments of the disclosure may be part of a digital media player, such as a portable music and/or video media player, which may include a media processing system to present the media, a storage device to store the media and may further include a radio frequency (RF) transceiver (e.g., an RF transceiver for a cellular telephone) coupled with an antenna system and the media processing system.
  • RF radio frequency
  • media stored on a remote storage device may be transmitted to the media player through the RF transceiver.
  • the media may be, for example, one or more of music or other audio, still pictures, or motion pictures.
  • the portable media player may include a media selection device, such as a click wheel input device on an iPod® or iPod Nano® media player from Apple Computer, Inc. of Cupertino, Calif., a touch screen input device, pushbutton device, movable pointing input device or other input device.
  • the media selection device may be used to select the media stored on the storage device and/or the remote storage device.
  • the portable media player may, in at least certain embodiments, include a display device which is coupled to the media processing system to display titles or other indicators of media being selected through the input device and being presented, either through a speaker or earphone(s), or on the display device, or on both display device and a speaker or earphone(s).
  • the display device and input device are integrated while in other embodiments the display device and input device are separate devices.
  • Examples of a portable media player are described in U.S. patent application Ser. No. 11/586,862, titled “Automated Response to and Sensing of User Activity in Devices” and published U.S. patent application numbers 2003/0095096 and 2004/0224638 which have been incorporated by reference into the present application.
  • Embodiments of the disclosure described herein may be part of other types of data processing systems, such as, for example, entertainment systems or personal digital assistants (PDAs), or general purpose computer systems, or special purpose computer systems, or an embedded device within another device, or cellular telephones which do not include media players, or multi touch tablet devices, or other multi touch devices, or devices which combine aspects or functions of these devices (e.g., a media player, such as an iPod®, combined with a PDA, an entertainment system, and a cellular telephone in one device).
  • PDA personal digital assistants
  • electronic devices and consumer devices are types of devices.
  • FIG. 1 is flow chart of a method for responding to a user input of a device.
  • the method 100 includes receiving a user input at block 102 .
  • the user input may be in the form of an input key, button, wheel, touch, or other means for interacting with the device.
  • the method 100 further includes creating an event object in response to the user input at block 104 .
  • the method 100 further includes determining whether the event object invokes a scroll or gesture operation at block 106 . For example, a single touch that drags a distance across a display of the device may be interpreted as a scroll operation. In one embodiment, a two or more finger touch of the display may be interpreted as a gesture operation.
  • determining whether the event object invokes a scroll or gesture operation is based on receiving a drag user input for a certain time period.
  • the method 100 further includes issuing at least one scroll or gesture call based on invoking the scroll or gesture operation at block 108 .
  • the method 100 further includes responding to at least one scroll call, if issued, by scrolling a window having a view (e.g., web, text, or image content) associated with the event object based on an amount of a scroll with the scroll stopped at a predetermined position in relation to the user input at block 110 .
  • a window having a view e.g., web, text, or image content
  • an input may end at a certain position on a display of the device.
  • the scrolling may continue until reaching a predetermined position in relation to the last input received from the user.
  • the method 100 further includes responding to at least one gesture call, if issued, by changing a view associated with the event object based on receiving a plurality of input points in the form of the user
  • scroll operations include attaching scroll indicators to a content edge of a display.
  • the scroll indicators can be attached to the display edge.
  • user input in the form of a mouse/finger down causes the scroll indicators to be displayed on the display edge, content edge, or window edge of the scrolled region. If a mouse/finger up is then detected, the scroll indicators are faded out from the display region, content edge, or window edge of the scrolled region.
  • gesture operations include responding to at least one gesture call, if issued, by rotating a view associated with the event object based on receiving a plurality of input points in the form of the user input.
  • Gesture operations may also include scaling a view associated with the event object by zooming in or zooming out based on receiving the user input.
  • a device includes a display region having multiple views or windows. Each window may have a multiple views including superviews and subviews. It is necessary to determine which window, view, superview, or subview is contacted by a user input in the form of a mouse up, mouse down, or drag, etc.
  • An API can set various modes for making this determination.
  • a pass mode sends mouse down, mouse up, and drag inputs to the nearest subview.
  • an intercept on drag mode sends a drag input to the superview while mouse up and down inputs are sent to the subview.
  • an intercept mode sends all drag, mouse up and down inputs to the superview.
  • the superview may be scroller software operating as a subclass of a view software.
  • the subview may be view software operating as a subclass of the user interface software.
  • FIG. 2 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a bounce operation.
  • the method 200 for providing a bounce operation includes transferring a set bounce call at block 202 .
  • the method 200 further includes setting at least one of maximum and minimum bounce values at block 204 .
  • the minimum and maximum bounce values may be associated with at least one edge of a window that has received a user input.
  • the method 200 further includes causing a bounce of a scrolled region in an opposite direction of a scroll based on a region past the scrolled region being visible in a display region at the end of the scroll at block 206 .
  • the scrolled region may be a content region.
  • transferring the set bounce call is either one of issuing, initiating, invoking or receiving the set bounce call.
  • FIG. 3 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a rubberband operation.
  • the method 300 for providing a rubberband operation includes transferring a rubberband call to cause rubberbanding a scrolled region displayed within a display at block 302 .
  • the method 300 further includes transferring an edge rubberband call to set displacement values for at least one edge of the display at block 304 .
  • the displacement values are set for top and bottom edges, left and right edges, or all edges.
  • Rubberbanding a scrolled region according to the method 300 occurs by a predetermined maximum displacement value when the scrolled region exceeds a display edge of a display of a device based on the scroll. If a user scrolls content of the display making a region past the edge of the content visible in the display, then the displacement value limits the maximum amount for the region outside the content. At the end of the scroll, the content slides back making the region outside of the content no longer visible on the display.
  • transferring the rubberband call is either one of issuing, initiating, invoking or receiving the rubberband call.
  • FIG. 4 is a schematic diagram illustrating an embodiment of user interface of a portable electronic device 400 having a touch-sensitive display 408 .
  • the display 408 may include a window 410 .
  • the window 410 may include one or more displayed objects, such as information objects 412 - 1 to 412 - 4 .
  • the information objects 412 may correspond to contact information for one or more individuals in a list of items.
  • the displayed objects may be moved in response to detecting or determining movement 414 of a point of contact with the display, such as that associated with one or more digits 416 of a user (which are not drawn to scale in FIG. 4 ).
  • movement of the displayed objects may be accelerated in response to detecting or determining accelerated movement of the point of contact.
  • embodiment 400 includes one window 410 , in other embodiments there may be two or more display windows.
  • embodiment 400 illustrates movement 414 in a particular direction, in other embodiments movement of the displayed objects may be in response to movement 414 in one or more other directions, or in response to a scalar (i.e., a determined or detected movement independent of the direction).
  • FIGS. 5A-5C illustrate the scrolling of a list of items on a device to a terminus of the list, at which point one or more displayed items at the end of the list smoothly bounce off the end of the display, reverse direction, and then optionally come to a stop.
  • FIG. 5A is a schematic diagram illustrating an embodiment of user interface of a portable electronic device 400 having a touch-sensitive display.
  • One or more displayed objects, such as information object 412 - 1 may be a distance 512 - 1 from a terminus 514 of the list of items which is an edge of a scrolled region and may be moving with a velocity 510 - 1 while the list is being scrolled.
  • the terminus 514 is a virtual boundary associated with the displayed objects, as opposed to a physical boundary associated with the window 410 and/or the display 408 .
  • the movement corresponding to the scrolling may stop, i.e., the scrolling velocity may be zero at an instant in time.
  • the one or more displayed objects, such as the information 412 - 1 may subsequently reverse direction.
  • the information object 412 - 1 may have velocity 510 - 2 and may be a distance 512 - 2 from the terminus 514 .
  • the magnitude of velocity 510 - 2 may be less than the magnitude of velocity 510 - 1 when the distance 512 - 2 equals the distance 512 - 1 , i.e., the motion of the one or more displayed objects is damped after the scrolling list reaches and “bounces” at its terminus.
  • the method 200 performs the bounce operations described in FIGS. 5A-5C .
  • the bounce call transferred at block 202 determines whether a bounce operation is enabled.
  • the maximum and minimum bounces values determine the amount of bouncing of the scrolled region in an opposite direction of the scroll.
  • FIGS. 6A-6D illustrate the scrolling of a list of items to a terminus of the list, at which point an area beyond the terminus is displayed and the list is then scrolled in an opposite direction until the area beyond the terminus is no longer displayed, in accordance with some embodiments.
  • the rubberband operation of method 300 is illustrated in the example of FIGS. 6A-6D with the listed items being email messages.
  • FIGS. 6A-6D illustrate an exemplary user interface 3500 A for managing an inbox in accordance with some embodiments.
  • An analogous user interface may be used to display and manage other mailboxes (e.g., drafts, sent, trash, personal, etc.).
  • other types of lists are possible, including but not limited to lists of instant message conversations, favorite phone numbers, contact information, labels, email folders, email addresses, physical addresses, ringtones, or album names.
  • the user may scroll through the emails using vertically upward and/or vertically downward swipe gestures on the touch screen.
  • a portion of a list of emails is displayed in the screen area, including a top displayed email 3530 from Bruce Walker and a bottom displayed email 3532 from Kim Brook.
  • a user performs a vertically downward swipe gesture 3514 to scroll toward the top of the list.
  • the vertically downward gesture 3514 need not be exactly vertical; a substantially vertical gesture is sufficient. In some embodiments, a gesture within a predetermined angle of being perfectly vertical results in vertical scrolling.
  • the email 3534 from Aaron Jones is the first email in the list and thus is the terminus of the list.
  • an area 3536 ( FIG. 6C ) above the first email 3534 i.e., beyond the terminus of the list
  • the area displayed beyond the terminus of the list is visually indistinct from the background of the list.
  • both the area 3536 and the background of the emails e.g., emails 3534 and 3530 ) are white and thus are visually indistinct.
  • FIG. 6D illustrates the result of this scrolling in the opposite direction, the email 3534 from Aaron Jones is now displayed at the top of the screen area allotted to the list and the area 3536 is not displayed.
  • a vertically downward gesture resulted in display of an area beyond the first item in the list.
  • the values for the predetermined maximum displacement are set at block 304 for top and bottom edges or at block 306 for all edges of the window.
  • a vertically upward gesture may result in display of an area beyond the last item of the list, if the vertically upward gesture continues once the list has been scrolled to the last item.
  • the last item may be considered a terminus of the list, similar to the first item.
  • the gesture need not be exactly vertical to result in vertical scrolling; a gesture within a predefined range of angles from perfectly vertical is sufficient.
  • FIG. 7 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a directional scrolling operation.
  • the method 700 for operating through an application programming interface includes transferring a directional scroll angle call to determine if directional scrolling is enabled at block 702 .
  • the method 700 further includes transferring a directional scroll angle call to set a scroll angle for locking the scrolling in at least one of a vertical or a horizontal direction at block 704 .
  • the method 700 further includes locking the scrolling in the horizontal direction if a user input forms an angle with a horizontal direction that is less than or equal to a first scroll angle at block 706 .
  • the method 700 further includes locking the scrolling in the vertical direction if a user input forms an angle with the vertical direction that is less than or equal to a second scroll angle at block 708 .
  • a user input in the form of a drag forms an angle with the horizontal direction that is less than the first scroll angle.
  • the user presumably intends to scroll in the horizontal direction.
  • the scrolling will be locked in the horizontal direction until the user input exceeds the first scroll angle.
  • a second scroll angle may be used for locking the user input in the vertical direction.
  • the second scroll angle may be set equal to the first scroll angle.
  • FIG. 8 illustrates first and second scroll angles for locking a scroll of a display of a device in a horizontal or vertical direction.
  • the horizontal direction 802 and vertical direction 804 are in reference to a window or a display of a device.
  • a user input such as a drag movement forming an angle with the horizontal direction 802 less than or equal to the first scrolling angle 806 or 808 will lock the user input in the horizontal direction.
  • a user input forming an angle with the vertical direction 810 less than or equal to the second scrolling angle 810 or 812 will lock the user input in the vertical direction.
  • the first and second scrolling angles may be set at the same angle or at different angles as well. For example, the first and second scrolling angles may be set at 25 degrees. A user input less than or equal to 25 degrees with respect to the horizontal or vertical direction will lock the scrolling in the appropriate direction.
  • the horizontal and vertical locking angles can be determined in part by the aspect of the content. For example, content in the form of a tall page may receive a larger vertical locking angle compared to the horizontal locking angle.
  • FIG. 9 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a deceleration scroll operation.
  • the method 900 for providing the deceleration scroll operation includes transferring a deceleration scroll call to set a deceleration factor for a drag user input at block 902 .
  • the method 900 further includes slowing the scroll to a stop based on the speed of the drag user input and the deceleration factor at block 904 .
  • a user input in the form of a drag invokes a scroll operation for a certain time period.
  • the user input has a certain speed.
  • the scroll of the scrolled region of a window or a display region of a display of a device will be stopped after the user input stops by applying a deceleration factor to the speed of the user input during the drag movement.
  • FIG. 10 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a scroll hysteresis operation.
  • the method 1000 for providing the scroll hysteresis operation includes transferring a scroll hysteresis call to determine whether a user input invokes a scroll at block 1002 .
  • the method 1000 further includes setting a hysteresis value for determining whether a user input invokes a scroll at block 1004 .
  • a user input in the form of a drag over a certain distance across a display or window within a display of a device invokes a scroll operation.
  • the hysteresis value determines the certain distance which the user input must drag across the display or window prior to invoking a scroll operation.
  • a user input that does not drag the certain predetermined distance will not invoke a scroll operation and may be considered a mouse up or down input or other type of input.
  • FIG. 11 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to attach a scroll indicator to a scroll region edge or a window edge of a device.
  • the scroll region edge is associated with a content edge.
  • the window or display edge may be associated with the edge of a display region.
  • the method 1100 for providing the scroll indicator includes transferring a scroll indicator call to determine whether at least one scroll indicator attaches to an edge of a scroll region or a window edge at block 1102 .
  • a scroll indicator may be displayed on any display edge, window edge or scroll region edge.
  • the method 1100 further includes optionally attaching at least one scroll indicator to the edge of the scroll region based on the scroll indicator call at block 1104 .
  • the method 1100 further includes optionally attaching at least one scroll indicator to the window edge of the view based on the scroll indicator call at block 1106 .
  • the operations of method 1100 can be altered, modified, combined, or deleted.
  • block 1104 can be deleted.
  • block 1106 can be deleted from the method 1100 .
  • the order of block 1104 and block 1106 can be switched.
  • Other methods having various operations that have been disclosed within the present disclosure can also be altered, modified, rearranged, collapsed, combined, or deleted.
  • transferring the scroll indicator call is either one of issuing, initiating, invoking or receiving the scroll indicator call.
  • the user interface software e.g., software kit or library
  • FIG. 12 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to determine if an inadvertent user input contacts a view of a display of a device.
  • the method 1200 includes transferring an inadvertent user input call to determine whether the user input was inadvertent at block 1202 .
  • the method 1200 further includes ignoring the inadvertent user input based on the determination of the inadvertent user input call at block 1204 .
  • the inadvertent user input call comprises a thumb detection call to determine whether the user input was an inadvertent thumb.
  • transferring the inadvertent user input call is either one of issuing, initiating, invoking or receiving the inadvertent user input call.
  • a gesture API provides an interface between an application and user software in order to handle gesturing. Gesturing may include scaling, rotating, or other changes to a view, window, or display. A mask may merely permit certain changes while limiting or not permitting other changes.
  • Events of all kinds come into the application via a graphics framework. They are enqueued, collaleced if necessary and dispatched. If the events are system level events (e.g., application should suspend, device orientation has changed, etc) they are routed to the application having an instance of a class of the user interface software. If the events are hand events based on a user input, the events are routed to the window they occurred over. The window then routes these events to the appropriate control by calling the instance's mouse and gesture methods.
  • the control that receives a mouse down or mouse entered function will continue to get all future calls until the hand is lifted. If a second finger is detected, the gesture methods or functions are invoked. These functions may include start, change, and end gesture calls. The control that receives start gesture call will be sent all future change gesture calls until the gesture ends.
  • FIG. 13 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a gesture operation.
  • the method 1300 for providing the gesture operation includes transferring a handle gesture event call at block 1302 .
  • the method 1300 further includes transferring a gesture change call in response to the handle gesture event call at block 1304 .
  • a user input in the form of two or more points is received by a display of a device.
  • a multi-touch driver of the device receives the user input and packages the event into an event object.
  • a window server receives the event object and determines whether the event object is a gesture event object. If the window server determines that a gesture event object has been received, then user interface software issues or transfers the handle gesture call at block 1302 to a software application associated with the view. The software application confirms that a gesture event has been received and passes the handle gesture call to a library of the user interface software. The window server also associates the gesture event object with the view that received the user input. The library responds by transferring a gesture change call in response to the handle gesture event call at block 1304 .
  • a window or view associated with the user input receives the change call in order to perform the gesture event.
  • the user software that provides the view receives a gesture start event call, a gesture changed event call, a zoom to scale setting for the view, and a gesture end call.
  • the gesture calls receive an input of a gesture event which may be base event having a type such as a hand event, keyboard event, system event, etc.
  • a delegate associated with the application receives a start gesture call, gesture did change call, and gesture did finish call.
  • the user software is dynamically linking into the application during the run time of the gesture process.
  • the gesture changed function call contains the following information about the gesture:
  • more information about each finger down may be included as follows.
  • a gesture event object may be a chord event object having a chord count (e.g., number of fingers contacted the view or display), a chord start event, a chord change event, and a chord end event.
  • a chord change event may include a scaling or rotation transform.
  • FIG. 14 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a scaling transform of a display region, window, or view of a display of a device.
  • the method 1400 for providing the scaling transform includes transferring a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points at block 1402 .
  • the method 1400 further includes transferring a scaling gesture start call at block 1404 .
  • the method 1400 further includes transferring a scaling gesture progress call at block 1406 .
  • the method 1200 further includes transferring a scaling gesture end call at block 1408 .
  • a user input in the form of two or more input points moves together or apart to invoke a gesture event that performs a scaling transform on the view associated with the user input.
  • a scale transform includes a minimum and maximum scale factor.
  • FIG. 15 illustrates a display 1502 of a device having a scaling transform of a view.
  • the view 1504 e.g., web, text, or image content
  • a user input e.g., two fingers moving apart
  • a snapback flag determines whether the zoom out can proceed past the maximum scale factor to view 1508 prior to snapping back to the maximum scale factor associated with view 1516 .
  • FIG. 16A illustrates a display 1604 of a device having a first scaling factor of a view 1616 .
  • a user input e.g., two fingers 1608 and 1610 moving together
  • the dashed regions 1602 and 1650 represent the total area of the content with the only content being displayed in the display area 1604 and 1652 .
  • the center of the gesture event, center 1612 for FIG. 16A and center 1660 for FIG. 16B remains in the same position with respect to the display 1604 .
  • the scroll indicator 1606 shrinks to become scroll indicator 1654 during the transform to indicate that a smaller portion of the total content 1650 is being displayed on display 1604 as a result of the zoom in operation.
  • the dashed region 1650 is larger than the dashed region 1602 to represent that a larger portion of content is not being displayed on display 1652 in FIG. 16B as a result of the zoom in operation.
  • a user desires to change a view 1670 from a scale factor of 2 ⁇ to a scale factor of 1 ⁇ as illustrated in FIG. 16C .
  • a first set of user inputs 1672 and 1674 that move to the second set of user inputs 1676 and 1678 will decrease the scale factor from 2 ⁇ to 1 ⁇ . It may be desirable for the user to scale from 2 ⁇ to 1 ⁇ without having to move the user inputs a large distance across the view 1670 .
  • a gesture scaling transform flag may be set in order to determine a scaling transform for a view associated with a user input having a plurality of input points.
  • the scaling transform flag scales either from a current scale factor to a minimum scale factor or from the current scale factor to a maximum scale factor. For example, a flag may be set at the position associated with a 1.5 ⁇ scale factor and a third set of user inputs 1680 and 1682 . A user desiring to change the scale factor from 2 ⁇ to 1 ⁇ would only have to move his fingers, the user inputs, from the first set 1672 and 1674 to the third set 1680 and 1682 if the gesture scaling transform flag has been set at a scale factor of 1.5 ⁇ .
  • FIG. 17 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to provide a rotation transform of a view, window, or display region of a display of a device.
  • the method 1700 for providing the rotation transform includes transferring a rotation transform call to determine a rotation transform for a view associated with a user input having a plurality of input points at block 1702 .
  • the method 1700 further includes transferring a rotation gesture start call at block 1704 .
  • the method 1700 further includes transferring a rotation gesture progress call at block 1706 .
  • the method 1700 further includes transferring a rotation gesture end call at block 1708 .
  • a user input in the form of two or more input points rotates to invoke a gesture event that performs a rotation transform on the view associated with the user input.
  • the rotation transform includes a minimum and maximum degree of rotation for associated minimum and maximum rotation views.
  • the user input may temporarily rotate a view past a maximum degree of rotation prior to the view snapping back to the maximum degree of rotation.
  • FIG. 18 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application in order to notify a delegate of at least one animation associated with a display region, window, or view of a display of a device.
  • a delay in the animation may be specified by the API.
  • multiple animations may be assigned priority by the API.
  • the method 1800 for notifying the delegate includes determining whether any animation occurs at block 1802 .
  • the method 1800 further includes checking the progress of an animation at block 1804 . If progress has occurred, then the next state (e.g., position, opacity, or transform) of the animation can be calculated at block 1806 .
  • software invokes an animation that performs a scaling transform on the view associated with the user input.
  • a display may include numerous views. The view being increased in size by the scaling transform may obstruct other views in which case the other views may need to be reduced in size. Alternatively, the view being decreased in size by the scaling transform may create additional area for other views to increase in size.
  • FIG. 19 is flow chart of a method for animating a display region, windows, or views displayed on a display of a device.
  • the method 1900 includes starting at least two animations at block 1902 .
  • the method 1900 further includes determining the progress of each animation at block 1904 .
  • the method 1900 further includes completing each animation based on a single timer at block 1906 .
  • the single timer includes a timer based on a redraw interval which is a time period between the display of a current frame and a next frame of the display of the device.
  • changes in animation are updated to the display during the redraw interval in order to display the changes during the next frame of the display.
  • the progress of each animation may be calculated periodically or based upon a progress call.
  • the method 1900 may further include determining whether each animation is associated with a delegate. The delegate is then notified of the animation. Other views not associated with an animation may be changed depending on the software application controlling the delegate.
  • FIG. 20 is flow chart of a method for animating a display region, windows, or views displayed on a display of a device.
  • the method 2000 includes providing a single animation timer at block 2002 .
  • the method 2000 further includes animating a plurality of animations with the single animation timer at block 2004 .
  • a single timer may control all animations which occur simultaneously.
  • the animations may include a transform, a frame, and an opacity animation.
  • a animation transform may include a scaling or rotation transform.
  • a frame animation may include resizing of a frame.
  • An opacity animation changes the opacity from opaque to transparent or vice versa.
  • FIG. 21 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with multiple software applications or processes in order to synchronize animations associated with multiple views or windows of a display of a device.
  • the method 2100 for synchronizing the animations includes setting attributes of views independently with each view being associated with a process at block 2102 .
  • an attribute or property of a view may include a position, size, opacity, etc.
  • An animation alters one or more attributes from a first state to a second state.
  • the method 2100 further includes transferring a synchronization call to synchronize animations for the multiple views of the display at block 2104 .
  • the synchronization call may include input parameters or arguments such as an identification of the synchronization of the processes and a list of the processes that are requesting animation of the multiple views.
  • the synchronization call includes the identification and the number of processes that are requesting animation.
  • each application or process sends a synchronization call at different times.
  • the method 2100 further includes transferring a synchronization confirmation message when a synchronization flag is enabled at block 2106 .
  • the synchronization flag can be enabled when the processes to be synchronized have each sent messages to a window server operating the user interface software.
  • the method 2100 further includes updating the attributes of the views from a first state to a second state independently at block 2108 .
  • the window server receives the updated attributes from each process at different times.
  • the method 2100 further includes transferring a start animation call to draw the requested animations when both processes have updated attributes associated with the second state at block 2110 .
  • a first data structure or layer tree represents a hierarchy of layers that correspond to the views or windows of the processes.
  • a second data structure or render tree represents a similar copy of the layer tree.
  • the render tree is not updated until the independent processes have completed their separate animations. At this time, the render tree updates and redraws the screen with the new animations.
  • FIGS. 22A and 22B illustrate synchronizing the resizing of views or windows of a display of a device.
  • a window 2210 associated with a first process with a size attribute may increase in size by changing from a first state, window 2210 in FIG. 22A , to a second state, window 2210 in FIG. 22B .
  • a second window 2220 may decrease in size in proportion to the increase in size of the first window 2210 .
  • the method 2100 provides synchronization of the resizing of the windows 2210 and 2220 illustrated in FIGS. 22A and 22B .
  • the animations in changing from the first state to the second state may occur incrementally and occur with the synchronization of method 2100 .
  • FIG. 23 illustrates a method for switching ownership of a view of an application displayed on a display of a data processing device.
  • the method 2300 includes constructing a data structure having a hierarchy of layers with a layer being associated with a view and owning the view at block 2302 .
  • the layers may be content, windows, video, images, text, media, or any other type of object for user interface of the application.
  • the method 2300 further includes removing the layer from the data structure at block 2304 .
  • the method 2300 further includes switching ownership of the view from the layer to the view at block 2306 .
  • each layer from the data structure is associated with a view.
  • the layer associated with the view sends a delegate function call to the view in order to generate content provided by the view.
  • a first pointer reference points from the layer to the view.
  • a second pointer reference points from the view to the layer.
  • the number of references pointing to an object such as the view is defined as the retained count of the object.
  • the view may receive notification that the layer will be removed from the data structure. Removing the layer from the data structure may occur based on the view associated with the layer being removed from the display of the device. When the layer is removed from the data structure or layer tree the pointer from the layer to the view will be removed.
  • the view will have a retained count of zero and be deallocated or removed from memory if the ownership of the view is not reversed.
  • the view will have a retained count of at least one if ownership is reversed.
  • FIG. 24 illustrates a method for memory management of a view of an application displayed on a display of a device.
  • the method 2400 includes constructing a data structure having a hierarchy of layers with at least one layer being associated with the view at block 2402 .
  • the method 2400 further includes storing the data structure in memory at block 2404 .
  • the method 2400 further includes maintaining a retained count of the number of references to the view from other objects at block 2406 .
  • the method 2400 further includes deallocating the view from memory if the retained count is zero at block 2408 . As discussed above, the retained count of the view will be decremented if the layer is removed from the data structure. Removing the layer from the data structure may occur based on the view associated with the layer being removed from the display of the device.
  • FIGS. 25A and 25B illustrate a data structure having a hierarchy of layers with a layer being associated with a view.
  • the data structure includes layers 2502 , 2504 , and 2506 .
  • Layer 2506 is associated with the view 2510 .
  • the layer 2506 associated with the 2510 view sends a delegate call to the view in order to generate content provided by the view.
  • a first pointer reference 2508 points from the layer 2506 to the view 2510 .
  • a second pointer reference 2512 points from the view 2510 to the layer 2506 .
  • a third pointer reference 2532 may point from user interface (UI) controller 2530 to the view 2510 .
  • the UI controller 2530 may control operations associated with the view 2510 such as scrolling the view 2510 in response to a user input.
  • the view 2510 in FIG. 25A has a retained count of two based on the pointer references 2508 and 2532 .
  • FIG. 26 illustrates a method for compositing media and non-media content of user interface for display on a device.
  • the method 2600 includes constructing a data structure having a hierarchy of layers associated with the user interface of the device at block 2602 .
  • the method 2600 further includes determining whether each layer of the data structure is associated with media or non-media content at block 2604 .
  • the data structure or layer tree is traversed in order to determine whether each of the layers of the data structure is associated with media or non-media content.
  • the method 2600 further includes detaching a layer associated with media content from the data structure at block 2606 .
  • the method 2600 further includes storing media content in a first memory location at block 2606 .
  • the method 2600 further includes storing non-media content in a second memory location at block 2608 .
  • the method 2600 further includes compositing the media and non-media content for display on the device at block 2610 .
  • compositing the media and non-media content includes retrieving the media content from the first memory location, retrieving the non-media content from the second memory location, and scanning the media and non-media content directly to the display.
  • the memory location can be any type of memory located in cache, main memory, a graphics processing unit, or other location within a device.
  • the media content may include video, video plug-in, audio, image, or other time varying media.
  • the media content may be in the form of a YUV model with the Y representing a luminance component (the brightness) and U and V representing chrominance (color) components.
  • the media content may be scanned to the display at a rate of substantially twenty to forty frames per second.
  • the media content may be scaled prior to being scanned to the display of the device.
  • the non-media content may include content, views, and images that do not require frequent updating.
  • the non-media content may be in the form of a RGB model which is an additive model in which red, green, and blue (often used in additive light models) are combined in various ways to reproduce other colors.
  • the non-media content may be scanned to the display at a slower rate compared to the media content.
  • FIG. 27 illustrates a data structure or layer tree having a hierarchy of layers.
  • the layers can be associated with media and non-media content.
  • layer 2704 is associated with media content 2706 such as a video.
  • Layer 2710 is associated with non-media content 2712 which may be user interface view for the video.
  • Layers 2720 , 2730 , and 2740 are associated with non-media content 2722 , 2732 , and 2742 , respectively, that forms the components of the non-media content 2712 .
  • the method 2600 will determine whether each layer of the data structure is associated with media or non-content. Any layers associated with media content such as layer 2704 will be removed from the data structure and processed in a separate memory location.
  • the methods, systems, and apparatuses of the present disclosure can be implemented in various devices including electronic devices, consumer devices, data processing devices, desktop computers, portable computers, wireless devices, cellular devices, tablet devices, handheld devices, multi touch devices, multi touch data processing devices, any combination of these devices, or other like devices.
  • FIGS. 4-6 and 28-33 illustrate examples of a few of these devices.
  • FIG. 28 illustrates a device 2800 according to one embodiment of the disclosure.
  • FIG. 28 shows a wireless device in a telephone configuration having a “candy-bar” style.
  • the wireless device 2800 may include a housing 2832 , a display device 2834 , an input device 2836 which may be an alphanumeric keypad, a speaker 2838 , a microphone 2840 and an antenna 2842 .
  • the wireless device 2800 also may include a proximity sensor 2844 and an accelerometer 2846 . It will be appreciated that the embodiment of FIG. 28 may use more or fewer sensors and may have a different form factor from the form factor shown in FIG. 28 .
  • the display device 2834 is shown positioned at an upper portion of the housing 2832
  • the input device 2836 is shown positioned at a lower portion of the housing 2832
  • the antenna 2842 is shown extending from the housing 2832 at an upper portion of the housing 2832 .
  • the speaker 2838 is also shown at an upper portion of the housing 2832 above the display device 2834 .
  • the microphone 2840 is shown at a lower portion of the housing 2832 , below the input device 3286 . It will be appreciated that the speaker 2838 and microphone 2840 can be positioned at any location on the housing, but are typically positioned in accordance with a user's ear and mouth, respectively.
  • the display device 2834 may be, for example, a liquid crystal display (LCD) which does not include the ability to accept inputs or a touch input screen which also includes an LCD.
  • the input device 2836 may include, for example, buttons, switches, dials, sliders, keys or keypad, navigation pad, touch pad, touch screen, and the like. Any well-known speaker, microphone and antenna can be used for speaker 2838 , microphone 2840 and antenna 2842 , respectively.
  • the data acquired from the proximity sensor 2844 and the accelerometer 2846 can be combined together, or used alone, to gather information about the user's activities.
  • the data from the proximity sensor 2844 , the accelerometer 2846 or both can be used, for example, to activate/deactivate a display backlight, initiate commands, make selections, control scrolling, gesturing, animating or other movement in a display, control input device settings, or to make other changes to one or more settings of the device.
  • the device 2800 can be used to implement at least some of the methods discussed in the present disclosure.
  • FIG. 29 shows a device 2950 in accordance with one embodiment of the disclosure.
  • the device 2950 may include a housing 2952 , a display/input device 2954 , a speaker 2956 , a microphone 2958 and an optional antenna 2960 (which may be visible on the exterior of the housing or may be concealed within the housing).
  • the device 2950 also may include a proximity sensor 2962 and an accelerometer 2964 .
  • the device 2950 may be a cellular telephone or a device which is an integrated PDA and a cellular telephone or a device which is an integrated media player and a cellular telephone or a device which is both an entertainment system (e.g. for playing games) and a cellular telephone, or the device 2950 may be other types of devices described herein.
  • the device 2950 may include a cellular telephone and a media player and a PDA, all contained within the housing 2952 .
  • the device 2950 may have a form factor which is small enough that it fits within the hand of a normal adult and is light enough that it can be carried in one hand by an adult.
  • the term “portable” means the device can be easily held in an adult user's hands (one or both); for example, a laptop computer and an iPod are portable devices.
  • the display/input device 2954 may include a multi-point touch input screen in addition to being a display, such as an LCD.
  • the multi-point touch screen is a capacitive sensing medium configured to detect multiple touches (e.g., blobs on the display from a user's face or multiple fingers concurrently touching or nearly touching the display) or near touches (e.g., blobs on the display) that occur at the same time and at distinct locations in the plane of the touch panel and to produce distinct signals representative of the location of the touches on the plane of the touch panel for each of the multiple touches.
  • the device 2800 can be used to implement at least some of the methods discussed in the present disclosure.
  • FIGS. 30A and 30B illustrate a device 3070 according to one embodiment of the disclosure.
  • the device 3070 may be a cellular telephone which includes a hinge 3087 that couples a display housing 3089 to a keypad housing 3091 .
  • the hinge 3087 allows a user to open and close the cellular telephone so that it can be placed in at least one of two different configurations shown in FIGS. 30A and 30B .
  • the hinge 3087 may rotatably couple the display housing to the keypad housing.
  • a user can open the cellular telephone to place it in the open configuration shown in FIG. 30A and can close the cellular telephone to place it in the closed configuration shown in FIG. 30B .
  • the keypad housing 3091 may include a keypad 3095 which receives inputs (e.g. telephone number inputs or other alphanumeric inputs) from a user and a microphone 3097 which receives voice input from the user.
  • the display housing 3089 may include, on its interior surface, a display 3093 (e.g. an LCD) and a speaker 3098 and a proximity sensor 3084 ; on its exterior surface, the display housing 3089 may include a speaker 3096 , a temperature sensor 3094 , a display 3088 (e.g. another LCD), an ambient light sensor 3092 , and a proximity sensor 3084 A.
  • the display housing 3089 may include a first proximity sensor on its interior surface and a second proximity sensor on its exterior surface.
  • the device 3070 may contain components which provide one or more of the functions of a wireless communication device such as a cellular telephone, a media player, an entertainment system, a PDA, or other types of devices described herein.
  • the device 3070 may be a cellular telephone integrated with a media player which plays MP3 files, such as MP3 music files.
  • Each of the devices shown in FIGS. 4, 5A, 5B, 5C, 6A, 6B, 6C, 6D, 28, 29, 30A and 30B may be a wireless communication device, such as a cellular telephone, and may include a plurality of components which provide a capability for wireless communication.
  • FIG. 31 shows an embodiment of a wireless device 3070 which includes the capability for wireless communication.
  • the wireless device 3070 may be included in any one of the devices shown in FIGS. 4, 5A, 5B, 5C, 6A, 6B, 6C, 6D, 28, 29, 30A and 30B , although alternative embodiments of those devices of FIGS. 4, 5A, 5B, 5C, 6A, 6B, 6C, 6D, 28, 29, 30A and 30B may include more or fewer components than the Wireless device 3070 .
  • Wireless device 3070 may include an antenna system 3101 .
  • Wireless device 3070 may also include a digital and/or analog radio frequency (RF) transceiver 3102 , coupled to the antenna system 3101 , to transmit and/or receive voice, digital data and/or media signals through antenna system 3101 .
  • RF radio frequency
  • Wireless device 3070 may also include a digital processing system 3103 to control the digital RF transceiver and to manage the voice, digital data and/or media signals.
  • Digital processing system 3103 may be a general purpose processing device, such as a microprocessor or controller for example.
  • Digital processing system 3103 may also be a special purpose processing device, such as an ASIC (application specific integrated circuit), FPGA (field-programmable gate array) or DSP (digital signal processor).
  • Digital processing system 3103 may also include other devices, as are known in the art, to interface with other components of wireless device 3070 .
  • digital processing system 3103 may include analog-to-digital and digital-to-analog converters to interface with other components of wireless device 3070 .
  • Digital processing system 3103 may include a media processing system 3109 , which may also include a general purpose or special purpose processing device to manage media, such as files of audio data.
  • Wireless device 3070 may also include a storage device 3104 , coupled to the digital processing system, to store data and/or operating programs for the Wireless device 3070 .
  • Storage device 3104 may be, for example, any type of solid-state or magnetic memory device.
  • Wireless device 3070 may also include one or more input devices 3105 , coupled to the digital processing system 3103 , to accept user inputs (e.g., telephone numbers, names, addresses, media selections, etc.)
  • Input device 3105 may be, for example, one or more of a keypad, a touchpad, a touch screen, a pointing device in combination with a display device or similar input device.
  • Wireless device 3070 may also include at least one display device 33106 , coupled to the digital processing system 3103 , to display information such as messages, telephone call information, contact information, pictures, movies and/or titles or other indicators of media being selected via the input device 3105 .
  • Display device 3106 may be, for example, an LCD display device.
  • display device 3106 and input device 3105 may be integrated together in the same device (e.g., a touch screen LCD such as a multi-touch input panel which is integrated with a display device, such as an LCD display device).
  • the display device 3106 may include a backlight 3106 A to illuminate the display device 3106 under certain circumstances. It will be appreciated that the Wireless device 3070 may include multiple displays.
  • Wireless device 3070 may also include a battery 3107 to supply operating power to components of the system including digital RF transceiver 3102 , digital processing system 3103 , storage device 3104 , input device 3105 , microphone 3105 A, audio transducer 3108 , media processing system 3109 , sensor(s) 3110 , and display device 3106 .
  • Battery 3107 may be, for example, a rechargeable or non-rechargeable lithium or nickel metal hydride battery.
  • Wireless device 3070 may also include audio transducers 3108 , which may include one or more speakers, and at least one microphone 3105 A. In certain embodiments of the present disclosure, the wireless device 3070 can be used to implement at least some of the methods discussed in the present disclosure.
  • FIG. 32 shows another example of a device according to an embodiment of the disclosure.
  • This device 3200 may include a processor, such as microprocessor 3202 , and a memory 3204 , which are coupled to each other through a bus 3206 .
  • the device 3200 may optionally include a cache 3208 which is coupled to the microprocessor 3202 .
  • This device may also optionally include a display controller and display device 3210 which is coupled to the other components through the bus 3206 .
  • One or more input/output controllers 3212 are also coupled to the bus 3206 to provide an interface for input/output devices 3214 and to provide an interface for one or more sensors 3216 which are for sensing user activity.
  • the bus 3206 may include one or more buses connected to each other through various bridges, controllers, and/or adapters as is well known in the art.
  • the input/output devices 3214 may include a keypad or keyboard or a cursor control device such as a touch input panel. Furthermore, the input/output devices 3214 may include a network interface which is either for a wired network or a wireless network (e.g. an RF transceiver).
  • the sensors 3216 may be any one of the sensors described herein including, for example, a proximity sensor or an ambient light sensor.
  • the microprocessor 3202 may receive data from one or more sensors 3216 and may perform the analysis of that data in the manner described herein. For example, the data may be analyzed through an artificial intelligence process or in the other ways described herein. As a result of that analysis, the microprocessor 3202 may then automatically cause an adjustment in one or more settings of the device.
  • the device 3200 can be used to implement at least some of the methods discussed in the present disclosure.
  • FIGS. 33A-C show another example of a device according to at least certain embodiments of the disclosure.
  • FIG. 33A illustrates a laptop device 3300 with a keyboard 3302 , a body 3304 , a display frame 3306 , and a display 3308 .
  • the laptop device 3300 can be converted into a tablet device as illustrated in FIG. 33B and FIG. 33C .
  • FIG. 33B illustrates the conversion of the laptop device into a tablet device.
  • An edge of a display frame 3356 containing a display 3358 is slide within the body 3354 across the top of a keyboard 3352 until forming a tablet device as illustrated in FIG. 33C .
  • the tablet device with a display 2362 and a display frame 3366 rests on top of a body 3360 .
  • the laptop device 3300 can be used to implement at least some of the methods discussed in the present disclosure.
  • FIG. 34 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
  • the application programming interface operates in an environment with user interface software interacting with a software application.
  • a hierarchy of views operates on top of a hierarchy of layers within the user interface software.
  • the API operates as illustrated in method 3400 that includes constructing a hierarchy of views operating on top of a hierarchy of layers at block 3402 .
  • the method 3400 further includes providing access to the hierarchy of views without providing access to the hierarchy of layers at block 3404 .
  • An application may interact with the hierarchy of views via the API without accessing the hierarchy of layers operating below the hierarchy of views.
  • a platform provides various scrolling, gesturing, and animating operations.
  • the platform includes hardware components and an operating system.
  • the hardware components may include a processing unit coupled to an input panel and a memory coupled to the processor.
  • the operating system includes one or more programs that are stored in the memory and configured to be executed by the processing unit.
  • One or more programs include various instructions for transferring function calls or messages through an application programming interface in order to perform various scrolling, gesturing, and animating operations.
  • the one or more programs include instructions for transferring a scaling transform call through an API to determine a scaling transform for a view associated with a user input having a plurality of input points. In an embodiment, the one or more programs include instructions for transferring a rubberband call through an API to determine a rotation transform for a view associated with a user input having a plurality of input points.
  • the platform includes a framework containing a library of software code.
  • the framework interacts with the programs of the platform to provide application programming interfaces for performing various scrolling, gesturing, and animating operations.
  • the framework also includes associated resources (e.g., images, text, etc.) that are stored in a single directory.
  • the library of the framework provides an API for specifying a scaling transform for a view associated with a user input having a plurality of input points. In an embodiment, the library of the framework provides an API for specifying a scaling transform for a view associated with a user input having a plurality of input points.

Abstract

At least certain embodiments of the present disclosure include an environment with user interface software interacting with a software application to provide gesture operations for a display of a device. A method for operating through an application programming interface (API) in this environment includes transferring a scaling transform call. The gesture operations include performing a scaling transform such as a zoom in or zoom out in response to a user input having two or more input points. The gesture operations also include performing a rotation transform to rotate an image or view in response to a user input having two or more input points.

Description

This application is a continuation of co-pending U.S. application Ser. No. 13/221,836 filed on Aug. 30, 2011, which is a continuation of co-pending U.S. application Ser. No. 11/620,727 filed on Jan. 7, 2007.
FIELD OF THE DISCLOSURE
This disclosure relates to application programming interfaces that provide gesture operations.
COMPUTER PROGRAM LISTING
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent & Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
Applicant has submitted herewith Computer Program Listings which are included as Appendix A, attached.
BACKGROUND OF THE DISCLOSURE
An API is a source code interface that a computer system or program library provides in order to support requests for services from a software application. An API is specified in terms of a programming language that can be interpretative or compiled when an application is built, rather than an explicit low level description of how data is laid out in memory. The software that provides the functionality described by an API is said to be an implementation of the API.
Various devices such as electronic devices, computing systems, portable devices, and handheld devices have software applications. The API interfaces between the software applications and user interface software to provide a user of the device with certain features and operations. A user may desire certain operations such as scrolling, selecting, gesturing, and animating operations for a display of the device.
Scrolling is the act of sliding a directional (e.g., horizontal or vertical) presentation of content, such as text, drawings, or images, across a screen or display window. In a typical graphical user interface, scrolling is done with the help of a scrollbar or using keyboard shortcuts, often the arrow keys. Gesturing is a type of user input with two or more input points. Animating operations include changing content within a given time period.
The various types of devices may have a limited display size, user interface, software, API interface and/or processing capability which limits the ease of use of the devices. User interfaces of devices implement APIs in order to provide requested functionality and features. These user interfaces can have difficulty interpreting the various types of user inputs and providing the intended functionality associated with the user inputs.
SUMMARY OF THE DESCRIPTION
At least certain embodiments of the present disclosure include one or more application programming interfaces in an environment with user interface software interacting with a software application. Various function calls or messages are transferred via the application programming interfaces between the user interface software and software applications. Example application programming interfaces transfer function calls to implement scrolling, gesturing, and animating operations for a device.
At least certain embodiments of the present disclosure include an environment with user interface software interacting with a software application. A method for operating through an application programming interface (API) in this environment includes transferring a set bounce call. The method further includes setting at least one of maximum and minimum bounce values. The set bounce call causes a bounce of a scrolled region in an opposite direction of a scroll based on a region past an edge of the scrolled region being visible in a display region at the end of the scroll.
At least certain embodiments of the present disclosure include an environment with user interface software interacting with a software application. A method for operating through an application programming interface (API) in this environment includes transferring a rubberband call. Rubberbanding a scrolled region within a display region occurs by a predetermined maximum displacement when the scrolled region exceeds a display edge. The method further includes transferring an edge rubberband call to set displacement values for at least one edge of the display (e.g., top and bottom edges, left and right edges).
At least certain embodiments of the present disclosure include an environment with user interface software interacting with a software application to provide gesture operations for a display of a device. A method for operating through an application programming interface (API) in this environment includes transferring a scaling transform call. The gesture operations include performing a scaling transform such as a zoom in or zoom out in response to a user input having two or more input points. The gesture operations also include performing a rotation transform to rotate an image or view in response to a user input having two or more input points.
At least certain embodiments of the present disclosure include a method for performing animations for a display of a device. The method includes starting at least one animation. The method further includes determining the progress of each animation. The method further includes completing each animation based on a single timer. The single timer can be based on a redraw interval of the display hardware.
Various devices which perform one or more of the foregoing methods and machine readable media which, when executed by a processing system, cause the processing system to perform these methods, are also described.
Other methods, devices and machine readable media are also described.
BRIEF DESCRIPTION OF THE DRAWINGS
The disclosure is described by way of example with reference to the accompanying drawings, wherein:
FIG. 1 is flow chart of a method for responding to a user input of a data processing device;
FIG. 2 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 3 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 4 is a schematic diagram illustrating an embodiment of user interface of a portable electronic device 400 having a touch-sensitive display 408;
FIG. 5A-5C illustrate at least some embodiments of user interface of a portable electronic device 400 having a touch-sensitive display;
FIG. 6A-6D illustrate the scrolling of a list of items to a terminus of the list, at which point an area beyond the terminus is displayed and the list is then scrolled in an opposite direction until the area beyond the terminus is no longer displayed, in accordance with some embodiments;
FIG. 7 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 8 illustrates first and second scroll angles for locking a scroll of a display of a device in a horizontal or vertical direction according to certain teachings of the present disclosure;
FIG. 9 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 10 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 11 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 12 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 13 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 14 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 15 illustrates a display of a device having a scaling transform of a view;
FIGS. 16A and 16B illustrate a display of a device with a view having a first and a second scaling factor;
FIG. 16C illustrates changing a view from a scale factor of 2× to a scale factor of 1× in at least some embodiments of the present disclosure;
FIG. 17 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 18 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIG. 19 is flow chart of a method for animating views displayed on a display of a device;
FIG. 20 is flow chart of a method for animating views displayed on a display of a device;
FIG. 21 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure;
FIGS. 22A and 22B illustrate synchronizing the resizing of windows of a display of a device;
FIG. 23 illustrates a method for switching ownership of a view of an application displayed on a display of a data processing device;
FIG. 24 illustrates a method for memory management of a view of an application displayed on a display of a device;
FIGS. 25A and 25B illustrate a data structure having a hierarchy of layers with a layer being associated with a view;
FIG. 26 illustrates a method for compositing media and non-media content of user interface for display on a device;
FIG. 27 illustrates a data structure or layer tree having a hierarchy of layers;
FIG. 28 is a perspective view of a device in accordance with one embodiment of the present disclosure;
FIG. 29 is a perspective view of a device in accordance with one embodiment of the present disclosure;
FIGS. 30A and 30B are perspective views of a wireless device in accordance with one embodiment of the present disclosure;
FIG. 31 is a block diagram of a system in which embodiments of the present disclosure can be implemented;
FIG. 32 shows another example of a device in accordance with one embodiment of the present disclosure;
FIG. 33A is a perspective view of a device in a first configuration (e.g. in a laptop configuration) in accordance with one embodiment of the present disclosure;
FIG. 33B is a perspective view of the device of FIG. 33A in a second configuration (e.g. a transition configuration) in accordance with one embodiment of the present disclosure;
FIG. 33C is a perspective view of the device of FIG. 33A in a third configuration (e.g., a tablet configuration) in accordance with one embodiment of the present disclosure; and
FIG. 34 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure.
DETAILED DESCRIPTION
Various embodiments and aspects of the disclosure will be described with reference to details discussed below, and the accompanying drawings will illustrate the various embodiments. The following description and drawings are illustrative of the disclosure and are not to be construed as limiting the disclosure. Numerous specific details are described to provide a through understanding of various embodiments of the present disclosure. However, in certain instances, well-known or conventional details are not described in order to provide a concise discussion of embodiments of the present disclosure.
Some portions of the detailed descriptions which follow are presented in terms of algorithms which include operations on data stored within a computer memory. An algorithm is generally a self-consistent sequence of operations leading to a desired result. The operations typically require or involve physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms such as “processing” or “computing” or “calculating” or “determining” or “displaying” or the like, can refer to the action and processes of a data processing system, or similar electronic device, that manipulates and transforms data represented as physical (electronic) quantities within the system's registers and memories into other data similarly represented as physical quantities within the system's memories or registers or other such information storage, transmission or display devices.
The present disclosure can relate to an apparatus for performing one or more of the operations described herein. This apparatus may be specially constructed for the required purposes, or it may comprise a general purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a machine (e.g. computer) readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, and magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), erasable programmable ROMs (EPROMs), electrically erasable programmable ROMs (EEPROMs), flash memory, magnetic or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a bus.
A machine-readable medium includes any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer). For example, a machine-readable medium includes read only memory (“ROM”); random access memory (“RAM”); magnetic disk storage media; optical storage media; flash memory devices; electrical, optical, acoustical or other form of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.); etc.
At least certain embodiments of the present disclosure include one or application programming interfaces in an environment with user interface software interacting with a software application. Various function calls or messages are transferred via the application programming interfaces between the user interface software and software applications. Transferring the function calls or messages may include issuing, initiating, invoking or receiving the function calls or messages. Example application programming interfaces transfer function calls to implement scrolling, gesturing, and animating operations for a device having a display region. An API may also implement functions having parameters, variables, or pointers. An API may receive parameters as disclosed or other combinations of parameters. In addition to the APIs disclosed, other APIs individually or in combination can perform similar functionality as the disclosed APIs.
The display region is a form of a window. A window is a display region which may not have a border and may be the entire display region or area of a display. In some embodiments, a display region may have at least one window and/or at least one view (e.g., web, text, or image content). A window may have at least one view. The methods, systems, and apparatuses disclosed can be implemented with display regions, windows, and/or views.
At least certain embodiments of the present disclosure include scrolling operations for scrolling a display of a device. The scrolling operations include bouncing a scrolled region in an opposite direction of a scroll when a scroll completes, rubberbanding a scrolled region by a predetermined maximum displacement when the scrolled region exceeds a display edge, and setting a scrolling angle that locks the scroll in a horizontal or vertical direction.
At least certain embodiments of the present disclosure include gesture operations for a display of a device. The gesture operations include performing a scaling transform such as a zoom in or zoom out in response to a user input having two or more input points. The gesture operations also include performing a rotation transform to rotate an image or view in response to a user input having two or more input points.
At least certain embodiments of the present disclosure include a method for performing animations for a display of a device. The method includes starting at least one animation. The method further includes determining the progress of each animation. The method further includes completing each animation based on a single timer. The single timer can be based on a redraw interval of the display hardware.
At least certain embodiments of the disclosure may be part of a digital media player, such as a portable music and/or video media player, which may include a media processing system to present the media, a storage device to store the media and may further include a radio frequency (RF) transceiver (e.g., an RF transceiver for a cellular telephone) coupled with an antenna system and the media processing system. In certain embodiments, media stored on a remote storage device may be transmitted to the media player through the RF transceiver. The media may be, for example, one or more of music or other audio, still pictures, or motion pictures.
The portable media player may include a media selection device, such as a click wheel input device on an iPod® or iPod Nano® media player from Apple Computer, Inc. of Cupertino, Calif., a touch screen input device, pushbutton device, movable pointing input device or other input device. The media selection device may be used to select the media stored on the storage device and/or the remote storage device. The portable media player may, in at least certain embodiments, include a display device which is coupled to the media processing system to display titles or other indicators of media being selected through the input device and being presented, either through a speaker or earphone(s), or on the display device, or on both display device and a speaker or earphone(s). In some embodiments, the display device and input device are integrated while in other embodiments the display device and input device are separate devices. Examples of a portable media player are described in U.S. patent application Ser. No. 11/586,862, titled “Automated Response to and Sensing of User Activity in Devices” and published U.S. patent application numbers 2003/0095096 and 2004/0224638 which have been incorporated by reference into the present application.
Embodiments of the disclosure described herein may be part of other types of data processing systems, such as, for example, entertainment systems or personal digital assistants (PDAs), or general purpose computer systems, or special purpose computer systems, or an embedded device within another device, or cellular telephones which do not include media players, or multi touch tablet devices, or other multi touch devices, or devices which combine aspects or functions of these devices (e.g., a media player, such as an iPod®, combined with a PDA, an entertainment system, and a cellular telephone in one device). In this disclosure, electronic devices and consumer devices are types of devices.
FIG. 1 is flow chart of a method for responding to a user input of a device. The method 100 includes receiving a user input at block 102. The user input may be in the form of an input key, button, wheel, touch, or other means for interacting with the device. The method 100 further includes creating an event object in response to the user input at block 104. The method 100 further includes determining whether the event object invokes a scroll or gesture operation at block 106. For example, a single touch that drags a distance across a display of the device may be interpreted as a scroll operation. In one embodiment, a two or more finger touch of the display may be interpreted as a gesture operation. In certain embodiments, determining whether the event object invokes a scroll or gesture operation is based on receiving a drag user input for a certain time period. The method 100 further includes issuing at least one scroll or gesture call based on invoking the scroll or gesture operation at block 108. The method 100 further includes responding to at least one scroll call, if issued, by scrolling a window having a view (e.g., web, text, or image content) associated with the event object based on an amount of a scroll with the scroll stopped at a predetermined position in relation to the user input at block 110. For example, an input may end at a certain position on a display of the device. The scrolling may continue until reaching a predetermined position in relation to the last input received from the user. The method 100 further includes responding to at least one gesture call, if issued, by changing a view associated with the event object based on receiving a plurality of input points in the form of the user input at block 112.
In certain embodiments of the present disclosure, scroll operations include attaching scroll indicators to a content edge of a display. Alternatively, the scroll indicators can be attached to the display edge. In some embodiments, user input in the form of a mouse/finger down causes the scroll indicators to be displayed on the display edge, content edge, or window edge of the scrolled region. If a mouse/finger up is then detected, the scroll indicators are faded out from the display region, content edge, or window edge of the scrolled region.
In certain embodiments of the present disclosure, gesture operations include responding to at least one gesture call, if issued, by rotating a view associated with the event object based on receiving a plurality of input points in the form of the user input. Gesture operations may also include scaling a view associated with the event object by zooming in or zooming out based on receiving the user input.
In some embodiments, a device includes a display region having multiple views or windows. Each window may have a multiple views including superviews and subviews. It is necessary to determine which window, view, superview, or subview is contacted by a user input in the form of a mouse up, mouse down, or drag, etc. An API can set various modes for making this determination. In one embodiment, a pass mode sends mouse down, mouse up, and drag inputs to the nearest subview. In another embodiment, an intercept on drag mode sends a drag input to the superview while mouse up and down inputs are sent to the subview. In another embodiment, an intercept mode sends all drag, mouse up and down inputs to the superview. The superview may be scroller software operating as a subclass of a view software. The subview may be view software operating as a subclass of the user interface software.
FIG. 2 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a bounce operation. The method 200 for providing a bounce operation includes transferring a set bounce call at block 202. The method 200 further includes setting at least one of maximum and minimum bounce values at block 204. The minimum and maximum bounce values may be associated with at least one edge of a window that has received a user input. The method 200 further includes causing a bounce of a scrolled region in an opposite direction of a scroll based on a region past the scrolled region being visible in a display region at the end of the scroll at block 206. The scrolled region may be a content region.
In certain embodiments of the present disclosure, transferring the set bounce call is either one of issuing, initiating, invoking or receiving the set bounce call.
FIG. 3 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a rubberband operation. The method 300 for providing a rubberband operation includes transferring a rubberband call to cause rubberbanding a scrolled region displayed within a display at block 302. The method 300 further includes transferring an edge rubberband call to set displacement values for at least one edge of the display at block 304. In some embodiments, the displacement values are set for top and bottom edges, left and right edges, or all edges.
Rubberbanding a scrolled region according to the method 300 occurs by a predetermined maximum displacement value when the scrolled region exceeds a display edge of a display of a device based on the scroll. If a user scrolls content of the display making a region past the edge of the content visible in the display, then the displacement value limits the maximum amount for the region outside the content. At the end of the scroll, the content slides back making the region outside of the content no longer visible on the display.
In certain embodiments of the present disclosure, transferring the rubberband call is either one of issuing, initiating, invoking or receiving the rubberband call.
FIG. 4 is a schematic diagram illustrating an embodiment of user interface of a portable electronic device 400 having a touch-sensitive display 408. The display 408 may include a window 410. The window 410 may include one or more displayed objects, such as information objects 412-1 to 412-4. In an exemplary embodiment, the information objects 412 may correspond to contact information for one or more individuals in a list of items. The displayed objects may be moved in response to detecting or determining movement 414 of a point of contact with the display, such as that associated with one or more digits 416 of a user (which are not drawn to scale in FIG. 4). In some embodiments, movement of the displayed objects may be accelerated in response to detecting or determining accelerated movement of the point of contact. While embodiment 400 includes one window 410, in other embodiments there may be two or more display windows. In addition, while embodiment 400 illustrates movement 414 in a particular direction, in other embodiments movement of the displayed objects may be in response to movement 414 in one or more other directions, or in response to a scalar (i.e., a determined or detected movement independent of the direction).
FIGS. 5A-5C illustrate the scrolling of a list of items on a device to a terminus of the list, at which point one or more displayed items at the end of the list smoothly bounce off the end of the display, reverse direction, and then optionally come to a stop. FIG. 5A is a schematic diagram illustrating an embodiment of user interface of a portable electronic device 400 having a touch-sensitive display. One or more displayed objects, such as information object 412-1 may be a distance 512-1 from a terminus 514 of the list of items which is an edge of a scrolled region and may be moving with a velocity 510-1 while the list is being scrolled. Note that the terminus 514 is a virtual boundary associated with the displayed objects, as opposed to a physical boundary associated with the window 410 and/or the display 408. As illustrated in FIG. 5B, when the one or more displayed objects, such as the information object 412-1, reach or intersect with the terminus 514, the movement corresponding to the scrolling may stop, i.e., the scrolling velocity may be zero at an instant in time. As illustrated in FIG. 5C, the one or more displayed objects, such as the information 412-1, may subsequently reverse direction. At a time after the intersection with the terminus 514, the information object 412-1 may have velocity 510-2 and may be a distance 512-2 from the terminus 514. In some embodiments, the magnitude of velocity 510-2 may be less than the magnitude of velocity 510-1 when the distance 512-2 equals the distance 512-1, i.e., the motion of the one or more displayed objects is damped after the scrolling list reaches and “bounces” at its terminus.
In at least some embodiments of the present disclosure, the method 200 performs the bounce operations described in FIGS. 5A-5C. The bounce call transferred at block 202 determines whether a bounce operation is enabled. The maximum and minimum bounces values determine the amount of bouncing of the scrolled region in an opposite direction of the scroll.
FIGS. 6A-6D illustrate the scrolling of a list of items to a terminus of the list, at which point an area beyond the terminus is displayed and the list is then scrolled in an opposite direction until the area beyond the terminus is no longer displayed, in accordance with some embodiments. The rubberband operation of method 300 is illustrated in the example of FIGS. 6A-6D with the listed items being email messages. FIGS. 6A-6D illustrate an exemplary user interface 3500A for managing an inbox in accordance with some embodiments. An analogous user interface may be used to display and manage other mailboxes (e.g., drafts, sent, trash, personal, etc.). In addition, other types of lists are possible, including but not limited to lists of instant message conversations, favorite phone numbers, contact information, labels, email folders, email addresses, physical addresses, ringtones, or album names.
If the list of emails fills more than the allotted screen area, the user may scroll through the emails using vertically upward and/or vertically downward swipe gestures on the touch screen. In the example of FIG. 6A, a portion of a list of emails is displayed in the screen area, including a top displayed email 3530 from Bruce Walker and a bottom displayed email 3532 from Kim Brook. A user performs a vertically downward swipe gesture 3514 to scroll toward the top of the list. The vertically downward gesture 3514 need not be exactly vertical; a substantially vertical gesture is sufficient. In some embodiments, a gesture within a predetermined angle of being perfectly vertical results in vertical scrolling.
As a result of detecting the vertically downward gesture 3514, in FIG. 6B the displayed emails have shifted down, such that the previous bottom displayed email 3532 from Kim Brook is no longer displayed, the previous top displayed email 3530 from Bruce Walker is now second from the top, and the email 3534 from Aaron Jones, which was not displayed in FIG. 6A, is now displayed at the top of the list.
In this example, the email 3534 from Aaron Jones is the first email in the list and thus is the terminus of the list. Upon reaching this email 3534, in response to continued detection of the vertically downward gesture 3514, an area 3536 (FIG. 6C) above the first email 3534 (i.e., beyond the terminus of the list) is displayed. In some embodiments, the area displayed beyond the terminus of the list is visually indistinct from the background of the list. In FIG. 6C, both the area 3536 and the background of the emails (e.g., emails 3534 and 3530) are white and thus are visually indistinct.
Once vertically downward gesture 3514 is complete, such that a corresponding object is no longer detected on or near the touch screen display, the list is scrolled in an opposite direction until the area 3536 is no longer displayed. FIG. 6D illustrates the result of this scrolling in the opposite direction, the email 3534 from Aaron Jones is now displayed at the top of the screen area allotted to the list and the area 3536 is not displayed.
In the example of FIGS. 6A-6D, a vertically downward gesture resulted in display of an area beyond the first item in the list. As described in FIG. 3, the values for the predetermined maximum displacement (e.g., display of an area beyond the first item in the list) are set at block 304 for top and bottom edges or at block 306 for all edges of the window.
Similarly, a vertically upward gesture may result in display of an area beyond the last item of the list, if the vertically upward gesture continues once the list has been scrolled to the last item. The last item may be considered a terminus of the list, similar to the first item. As discussed above, the gesture need not be exactly vertical to result in vertical scrolling; a gesture within a predefined range of angles from perfectly vertical is sufficient.
FIG. 7 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a directional scrolling operation. The method 700 for operating through an application programming interface (API) includes transferring a directional scroll angle call to determine if directional scrolling is enabled at block 702. The method 700 further includes transferring a directional scroll angle call to set a scroll angle for locking the scrolling in at least one of a vertical or a horizontal direction at block 704. The method 700 further includes locking the scrolling in the horizontal direction if a user input forms an angle with a horizontal direction that is less than or equal to a first scroll angle at block 706. The method 700 further includes locking the scrolling in the vertical direction if a user input forms an angle with the vertical direction that is less than or equal to a second scroll angle at block 708.
In certain embodiments, a user input in the form of a drag forms an angle with the horizontal direction that is less than the first scroll angle. In this case, the user presumably intends to scroll in the horizontal direction. The scrolling will be locked in the horizontal direction until the user input exceeds the first scroll angle. A second scroll angle may be used for locking the user input in the vertical direction. The second scroll angle may be set equal to the first scroll angle.
FIG. 8 illustrates first and second scroll angles for locking a scroll of a display of a device in a horizontal or vertical direction. The horizontal direction 802 and vertical direction 804 are in reference to a window or a display of a device. As discussed in the method 700, a user input such as a drag movement forming an angle with the horizontal direction 802 less than or equal to the first scrolling angle 806 or 808 will lock the user input in the horizontal direction. In a similar manner, a user input forming an angle with the vertical direction 810 less than or equal to the second scrolling angle 810 or 812 will lock the user input in the vertical direction. The first and second scrolling angles may be set at the same angle or at different angles as well. For example, the first and second scrolling angles may be set at 25 degrees. A user input less than or equal to 25 degrees with respect to the horizontal or vertical direction will lock the scrolling in the appropriate direction.
In some embodiments, the horizontal and vertical locking angles can be determined in part by the aspect of the content. For example, content in the form of a tall page may receive a larger vertical locking angle compared to the horizontal locking angle.
FIG. 9 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a deceleration scroll operation. The method 900 for providing the deceleration scroll operation includes transferring a deceleration scroll call to set a deceleration factor for a drag user input at block 902. The method 900 further includes slowing the scroll to a stop based on the speed of the drag user input and the deceleration factor at block 904.
In certain embodiments, a user input in the form of a drag invokes a scroll operation for a certain time period. The user input has a certain speed. The scroll of the scrolled region of a window or a display region of a display of a device will be stopped after the user input stops by applying a deceleration factor to the speed of the user input during the drag movement.
FIG. 10 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a scroll hysteresis operation. The method 1000 for providing the scroll hysteresis operation includes transferring a scroll hysteresis call to determine whether a user input invokes a scroll at block 1002. The method 1000 further includes setting a hysteresis value for determining whether a user input invokes a scroll at block 1004.
In certain embodiments, a user input in the form of a drag over a certain distance across a display or window within a display of a device invokes a scroll operation. The hysteresis value determines the certain distance which the user input must drag across the display or window prior to invoking a scroll operation. A user input that does not drag the certain predetermined distance will not invoke a scroll operation and may be considered a mouse up or down input or other type of input.
FIG. 11 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to attach a scroll indicator to a scroll region edge or a window edge of a device. In some embodiments, the scroll region edge is associated with a content edge. The window or display edge may be associated with the edge of a display region. The method 1100 for providing the scroll indicator includes transferring a scroll indicator call to determine whether at least one scroll indicator attaches to an edge of a scroll region or a window edge at block 1102. A scroll indicator may be displayed on any display edge, window edge or scroll region edge. The method 1100 further includes optionally attaching at least one scroll indicator to the edge of the scroll region based on the scroll indicator call at block 1104. Alternatively, the method 1100 further includes optionally attaching at least one scroll indicator to the window edge of the view based on the scroll indicator call at block 1106.
In some embodiments, the operations of method 1100 can be altered, modified, combined, or deleted. For example, block 1104 can be deleted. Likewise, block 1106 can be deleted from the method 1100. Alternatively, the order of block 1104 and block 1106 can be switched. Other methods having various operations that have been disclosed within the present disclosure can also be altered, modified, rearranged, collapsed, combined, or deleted.
In certain embodiments of the present disclosure, transferring the scroll indicator call is either one of issuing, initiating, invoking or receiving the scroll indicator call. For example, the user interface software (e.g., software kit or library) may receive the scroll indicator call from the software application.
FIG. 12 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to determine if an inadvertent user input contacts a view of a display of a device. The method 1200 includes transferring an inadvertent user input call to determine whether the user input was inadvertent at block 1202. The method 1200 further includes ignoring the inadvertent user input based on the determination of the inadvertent user input call at block 1204. In one embodiment, the inadvertent user input call comprises a thumb detection call to determine whether the user input was an inadvertent thumb.
In certain embodiments of the present disclosure, transferring the inadvertent user input call is either one of issuing, initiating, invoking or receiving the inadvertent user input call.
A gesture API provides an interface between an application and user software in order to handle gesturing. Gesturing may include scaling, rotating, or other changes to a view, window, or display. A mask may merely permit certain changes while limiting or not permitting other changes. Events of all kinds come into the application via a graphics framework. They are enqueued, collaleced if necessary and dispatched. If the events are system level events (e.g., application should suspend, device orientation has changed, etc) they are routed to the application having an instance of a class of the user interface software. If the events are hand events based on a user input, the events are routed to the window they occurred over. The window then routes these events to the appropriate control by calling the instance's mouse and gesture methods. The control that receives a mouse down or mouse entered function will continue to get all future calls until the hand is lifted. If a second finger is detected, the gesture methods or functions are invoked. These functions may include start, change, and end gesture calls. The control that receives start gesture call will be sent all future change gesture calls until the gesture ends.
FIG. 13 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a gesture operation. The method 1300 for providing the gesture operation includes transferring a handle gesture event call at block 1302. The method 1300 further includes transferring a gesture change call in response to the handle gesture event call at block 1304.
In certain embodiments, a user input in the form of two or more points is received by a display of a device. A multi-touch driver of the device receives the user input and packages the event into an event object. A window server receives the event object and determines whether the event object is a gesture event object. If the window server determines that a gesture event object has been received, then user interface software issues or transfers the handle gesture call at block 1302 to a software application associated with the view. The software application confirms that a gesture event has been received and passes the handle gesture call to a library of the user interface software. The window server also associates the gesture event object with the view that received the user input. The library responds by transferring a gesture change call in response to the handle gesture event call at block 1304.
In one embodiment, a window or view associated with the user input receives the change call in order to perform the gesture event. The user software that provides the view receives a gesture start event call, a gesture changed event call, a zoom to scale setting for the view, and a gesture end call. The gesture calls receive an input of a gesture event which may be base event having a type such as a hand event, keyboard event, system event, etc. A delegate associated with the application receives a start gesture call, gesture did change call, and gesture did finish call. The user software is dynamically linking into the application during the run time of the gesture process.
In some embodiments, the gesture changed function call contains the following information about the gesture:
the number of fingers currently down;
the number of fingers initially down;
the rotation of the hand;
the scale of the hand;
the translation of the hand;
the position of the inner and outermost fingers; and
the pressure of the first finger.
In other embodiments, more information about each finger down may be included as follows.
the stage of the finger (just touch down, fully pressed, lifting off, etc);
the position of the finger;
the proximity of the finger (how hard you're touching);
the orientation of the finger (what angle the ovoid is at);
the length of the major and minor axis;
the velocity of the finger; and
the eccentricity of the finger's ovoid.
A gesture event object may be a chord event object having a chord count (e.g., number of fingers contacted the view or display), a chord start event, a chord change event, and a chord end event. A chord change event may include a scaling or rotation transform.
FIG. 14 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a scaling transform of a display region, window, or view of a display of a device. The method 1400 for providing the scaling transform includes transferring a scaling transform call to determine a scaling transform for a view associated with a user input having a plurality of input points at block 1402. The method 1400 further includes transferring a scaling gesture start call at block 1404. The method 1400 further includes transferring a scaling gesture progress call at block 1406. The method 1200 further includes transferring a scaling gesture end call at block 1408.
In certain embodiments, a user input in the form of two or more input points (e.g., fingers) moves together or apart to invoke a gesture event that performs a scaling transform on the view associated with the user input. A scale transform includes a minimum and maximum scale factor. FIG. 15 illustrates a display 1502 of a device having a scaling transform of a view. The view 1504 (e.g., web, text, or image content) has a first scale factor. A user input (e.g., two fingers moving apart) associated with the view 1504 is interpreted as a gesture event to zoom out from view 1504 to view 1508 having a second scale factor that exceeds the maximum scale factor of the view 1516. A snapback flag determines whether the zoom out can proceed past the maximum scale factor to view 1508 prior to snapping back to the maximum scale factor associated with view 1516.
FIG. 16A illustrates a display 1604 of a device having a first scaling factor of a view 1616. A user input (e.g., two fingers 1608 and 1610 moving together) associated with the view 1614 is interpreted as a gesture event to zoom in from view 1614 to view 1664 having a second scale factor as illustrated in FIG. 16B. The dashed regions 1602 and 1650 represent the total area of the content with the only content being displayed in the display area 1604 and 1652. In performing the scaling transform from FIG. 16A to FIG. 16B, the center of the gesture event, center 1612 for FIG. 16A and center 1660 for FIG. 16B, remains in the same position with respect to the display 1604. The scroll indicator 1606 shrinks to become scroll indicator 1654 during the transform to indicate that a smaller portion of the total content 1650 is being displayed on display 1604 as a result of the zoom in operation. The dashed region 1650 is larger than the dashed region 1602 to represent that a larger portion of content is not being displayed on display 1652 in FIG. 16B as a result of the zoom in operation.
In at least some embodiments of the present disclosure, a user desires to change a view 1670 from a scale factor of 2× to a scale factor of 1× as illustrated in FIG. 16C. A first set of user inputs 1672 and 1674 that move to the second set of user inputs 1676 and 1678 will decrease the scale factor from 2× to 1×. It may be desirable for the user to scale from 2× to 1× without having to move the user inputs a large distance across the view 1670. In an environment with user interface software interacting with a software application, a gesture scaling transform flag may be set in order to determine a scaling transform for a view associated with a user input having a plurality of input points. The scaling transform flag scales either from a current scale factor to a minimum scale factor or from the current scale factor to a maximum scale factor. For example, a flag may be set at the position associated with a 1.5× scale factor and a third set of user inputs 1680 and 1682. A user desiring to change the scale factor from 2× to 1× would only have to move his fingers, the user inputs, from the first set 1672 and 1674 to the third set 1680 and 1682 if the gesture scaling transform flag has been set at a scale factor of 1.5×.
FIG. 17 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to provide a rotation transform of a view, window, or display region of a display of a device. The method 1700 for providing the rotation transform includes transferring a rotation transform call to determine a rotation transform for a view associated with a user input having a plurality of input points at block 1702. The method 1700 further includes transferring a rotation gesture start call at block 1704. The method 1700 further includes transferring a rotation gesture progress call at block 1706. The method 1700 further includes transferring a rotation gesture end call at block 1708.
In certain embodiments, a user input in the form of two or more input points rotates to invoke a gesture event that performs a rotation transform on the view associated with the user input. The rotation transform includes a minimum and maximum degree of rotation for associated minimum and maximum rotation views. The user input may temporarily rotate a view past a maximum degree of rotation prior to the view snapping back to the maximum degree of rotation.
FIG. 18 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application in order to notify a delegate of at least one animation associated with a display region, window, or view of a display of a device. A delay in the animation may be specified by the API. Also, multiple animations may be assigned priority by the API. The method 1800 for notifying the delegate includes determining whether any animation occurs at block 1802. The method 1800 further includes checking the progress of an animation at block 1804. If progress has occurred, then the next state (e.g., position, opacity, or transform) of the animation can be calculated at block 1806. If progress has completed at block 1806, then at block 1808 it is determined whether the view associated with the completed animation is associated with a delegate. If so, a delegate call is transferred to notify the delegate of the animation for the view at block 1810. The delegate operating under the control of the software application can change other views in response to the view being modified by the animation.
In certain embodiments, software invokes an animation that performs a scaling transform on the view associated with the user input. A display may include numerous views. The view being increased in size by the scaling transform may obstruct other views in which case the other views may need to be reduced in size. Alternatively, the view being decreased in size by the scaling transform may create additional area for other views to increase in size.
FIG. 19 is flow chart of a method for animating a display region, windows, or views displayed on a display of a device. The method 1900 includes starting at least two animations at block 1902. The method 1900 further includes determining the progress of each animation at block 1904. The method 1900 further includes completing each animation based on a single timer at block 1906.
In certain embodiments of the present disclosure, the single timer includes a timer based on a redraw interval which is a time period between the display of a current frame and a next frame of the display of the device. In this case, changes in animation are updated to the display during the redraw interval in order to display the changes during the next frame of the display. The progress of each animation may be calculated periodically or based upon a progress call.
The method 1900 may further include determining whether each animation is associated with a delegate. The delegate is then notified of the animation. Other views not associated with an animation may be changed depending on the software application controlling the delegate.
FIG. 20 is flow chart of a method for animating a display region, windows, or views displayed on a display of a device. The method 2000 includes providing a single animation timer at block 2002. The method 2000 further includes animating a plurality of animations with the single animation timer at block 2004. For example, a single timer may control all animations which occur simultaneously. The animations may include a transform, a frame, and an opacity animation. A animation transform may include a scaling or rotation transform. A frame animation may include resizing of a frame. An opacity animation changes the opacity from opaque to transparent or vice versa.
FIG. 21 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with multiple software applications or processes in order to synchronize animations associated with multiple views or windows of a display of a device. The method 2100 for synchronizing the animations includes setting attributes of views independently with each view being associated with a process at block 2102. For example, an attribute or property of a view may include a position, size, opacity, etc. An animation alters one or more attributes from a first state to a second state. The method 2100 further includes transferring a synchronization call to synchronize animations for the multiple views of the display at block 2104. The synchronization call may include input parameters or arguments such as an identification of the synchronization of the processes and a list of the processes that are requesting animation of the multiple views. In one embodiment, the synchronization call includes the identification and the number of processes that are requesting animation. In one embodiment, each application or process sends a synchronization call at different times. The method 2100 further includes transferring a synchronization confirmation message when a synchronization flag is enabled at block 2106. The synchronization flag can be enabled when the processes to be synchronized have each sent messages to a window server operating the user interface software. The method 2100 further includes updating the attributes of the views from a first state to a second state independently at block 2108. In one embodiment, the window server receives the updated attributes from each process at different times. The method 2100 further includes transferring a start animation call to draw the requested animations when both processes have updated attributes associated with the second state at block 2110.
In some embodiments, a first data structure or layer tree represents a hierarchy of layers that correspond to the views or windows of the processes. A second data structure or render tree represents a similar copy of the layer tree. However, the render tree is not updated until the independent processes have completed their separate animations. At this time, the render tree updates and redraws the screen with the new animations.
FIGS. 22A and 22B illustrate synchronizing the resizing of views or windows of a display of a device. For example, a window 2210 associated with a first process with a size attribute may increase in size by changing from a first state, window 2210 in FIG. 22A, to a second state, window 2210 in FIG. 22B. At approximately the same time, a second window 2220 may decrease in size in proportion to the increase in size of the first window 2210. The method 2100 provides synchronization of the resizing of the windows 2210 and 2220 illustrated in FIGS. 22A and 22B. The animations in changing from the first state to the second state may occur incrementally and occur with the synchronization of method 2100.
FIG. 23 illustrates a method for switching ownership of a view of an application displayed on a display of a data processing device. The method 2300 includes constructing a data structure having a hierarchy of layers with a layer being associated with a view and owning the view at block 2302. The layers may be content, windows, video, images, text, media, or any other type of object for user interface of the application. The method 2300 further includes removing the layer from the data structure at block 2304. The method 2300 further includes switching ownership of the view from the layer to the view at block 2306.
In some embodiments, each layer from the data structure is associated with a view. The layer associated with the view sends a delegate function call to the view in order to generate content provided by the view. A first pointer reference points from the layer to the view. A second pointer reference points from the view to the layer. The number of references pointing to an object such as the view is defined as the retained count of the object. The view may receive notification that the layer will be removed from the data structure. Removing the layer from the data structure may occur based on the view associated with the layer being removed from the display of the device. When the layer is removed from the data structure or layer tree the pointer from the layer to the view will be removed. The view will have a retained count of zero and be deallocated or removed from memory if the ownership of the view is not reversed. The view will have a retained count of at least one if ownership is reversed.
FIG. 24 illustrates a method for memory management of a view of an application displayed on a display of a device. The method 2400 includes constructing a data structure having a hierarchy of layers with at least one layer being associated with the view at block 2402. The method 2400 further includes storing the data structure in memory at block 2404. The method 2400 further includes maintaining a retained count of the number of references to the view from other objects at block 2406. The method 2400 further includes deallocating the view from memory if the retained count is zero at block 2408. As discussed above, the retained count of the view will be decremented if the layer is removed from the data structure. Removing the layer from the data structure may occur based on the view associated with the layer being removed from the display of the device.
FIGS. 25A and 25B illustrate a data structure having a hierarchy of layers with a layer being associated with a view. The data structure includes layers 2502, 2504, and 2506. Layer 2506 is associated with the view 2510. The layer 2506 associated with the 2510 view sends a delegate call to the view in order to generate content provided by the view. A first pointer reference 2508 points from the layer 2506 to the view 2510. A second pointer reference 2512 points from the view 2510 to the layer 2506. A third pointer reference 2532 may point from user interface (UI) controller 2530 to the view 2510. The UI controller 2530 may control operations associated with the view 2510 such as scrolling the view 2510 in response to a user input. The view 2510 in FIG. 25A has a retained count of two based on the pointer references 2508 and 2532.
If the layer 2506 is removed from the data structure as illustrated in FIG. 25B, then the pointer 2508 is removed. View 2510 will have a lower retained count as illustrated in FIG. 25B. If view 2510 has a retained count of zero, then the memory storing the view 2510 will be deallocated.
FIG. 26 illustrates a method for compositing media and non-media content of user interface for display on a device. The method 2600 includes constructing a data structure having a hierarchy of layers associated with the user interface of the device at block 2602. The method 2600 further includes determining whether each layer of the data structure is associated with media or non-media content at block 2604. The data structure or layer tree is traversed in order to determine whether each of the layers of the data structure is associated with media or non-media content. The method 2600 further includes detaching a layer associated with media content from the data structure at block 2606. The method 2600 further includes storing media content in a first memory location at block 2606. The method 2600 further includes storing non-media content in a second memory location at block 2608. The method 2600 further includes compositing the media and non-media content for display on the device at block 2610.
In some embodiments, compositing the media and non-media content includes retrieving the media content from the first memory location, retrieving the non-media content from the second memory location, and scanning the media and non-media content directly to the display. The memory location can be any type of memory located in cache, main memory, a graphics processing unit, or other location within a device. The media content may include video, video plug-in, audio, image, or other time varying media. The media content may be in the form of a YUV model with the Y representing a luminance component (the brightness) and U and V representing chrominance (color) components. The media content may be scanned to the display at a rate of substantially twenty to forty frames per second. The media content may be scaled prior to being scanned to the display of the device.
The non-media content may include content, views, and images that do not require frequent updating. The non-media content may be in the form of a RGB model which is an additive model in which red, green, and blue (often used in additive light models) are combined in various ways to reproduce other colors. The non-media content may be scanned to the display at a slower rate compared to the media content.
FIG. 27 illustrates a data structure or layer tree having a hierarchy of layers. The layers can be associated with media and non-media content. For example, layer 2704 is associated with media content 2706 such as a video. Layer 2710 is associated with non-media content 2712 which may be user interface view for the video. Layers 2720, 2730, and 2740 are associated with non-media content 2722, 2732, and 2742, respectively, that forms the components of the non-media content 2712. The method 2600 will determine whether each layer of the data structure is associated with media or non-content. Any layers associated with media content such as layer 2704 will be removed from the data structure and processed in a separate memory location.
In some embodiments, the methods, systems, and apparatuses of the present disclosure can be implemented in various devices including electronic devices, consumer devices, data processing devices, desktop computers, portable computers, wireless devices, cellular devices, tablet devices, handheld devices, multi touch devices, multi touch data processing devices, any combination of these devices, or other like devices. FIGS. 4-6 and 28-33 illustrate examples of a few of these devices.
FIG. 28 illustrates a device 2800 according to one embodiment of the disclosure. FIG. 28 shows a wireless device in a telephone configuration having a “candy-bar” style. In FIG. 28, the wireless device 2800 may include a housing 2832, a display device 2834, an input device 2836 which may be an alphanumeric keypad, a speaker 2838, a microphone 2840 and an antenna 2842. The wireless device 2800 also may include a proximity sensor 2844 and an accelerometer 2846. It will be appreciated that the embodiment of FIG. 28 may use more or fewer sensors and may have a different form factor from the form factor shown in FIG. 28.
The display device 2834 is shown positioned at an upper portion of the housing 2832, and the input device 2836 is shown positioned at a lower portion of the housing 2832. The antenna 2842 is shown extending from the housing 2832 at an upper portion of the housing 2832. The speaker 2838 is also shown at an upper portion of the housing 2832 above the display device 2834. The microphone 2840 is shown at a lower portion of the housing 2832, below the input device 3286. It will be appreciated that the speaker 2838 and microphone 2840 can be positioned at any location on the housing, but are typically positioned in accordance with a user's ear and mouth, respectively.
The display device 2834 may be, for example, a liquid crystal display (LCD) which does not include the ability to accept inputs or a touch input screen which also includes an LCD. The input device 2836 may include, for example, buttons, switches, dials, sliders, keys or keypad, navigation pad, touch pad, touch screen, and the like. Any well-known speaker, microphone and antenna can be used for speaker 2838, microphone 2840 and antenna 2842, respectively.
The data acquired from the proximity sensor 2844 and the accelerometer 2846 can be combined together, or used alone, to gather information about the user's activities. The data from the proximity sensor 2844, the accelerometer 2846 or both can be used, for example, to activate/deactivate a display backlight, initiate commands, make selections, control scrolling, gesturing, animating or other movement in a display, control input device settings, or to make other changes to one or more settings of the device. In certain embodiments of the present disclosure, the device 2800 can be used to implement at least some of the methods discussed in the present disclosure.
FIG. 29 shows a device 2950 in accordance with one embodiment of the disclosure. The device 2950 may include a housing 2952, a display/input device 2954, a speaker 2956, a microphone 2958 and an optional antenna 2960 (which may be visible on the exterior of the housing or may be concealed within the housing). The device 2950 also may include a proximity sensor 2962 and an accelerometer 2964. The device 2950 may be a cellular telephone or a device which is an integrated PDA and a cellular telephone or a device which is an integrated media player and a cellular telephone or a device which is both an entertainment system (e.g. for playing games) and a cellular telephone, or the device 2950 may be other types of devices described herein. In one particular embodiment, the device 2950 may include a cellular telephone and a media player and a PDA, all contained within the housing 2952. The device 2950 may have a form factor which is small enough that it fits within the hand of a normal adult and is light enough that it can be carried in one hand by an adult. It will be appreciated that the term “portable” means the device can be easily held in an adult user's hands (one or both); for example, a laptop computer and an iPod are portable devices.
In one embodiment, the display/input device 2954 may include a multi-point touch input screen in addition to being a display, such as an LCD. In one embodiment, the multi-point touch screen is a capacitive sensing medium configured to detect multiple touches (e.g., blobs on the display from a user's face or multiple fingers concurrently touching or nearly touching the display) or near touches (e.g., blobs on the display) that occur at the same time and at distinct locations in the plane of the touch panel and to produce distinct signals representative of the location of the touches on the plane of the touch panel for each of the multiple touches.
In certain embodiments of the present disclosure, the device 2800 can be used to implement at least some of the methods discussed in the present disclosure.
FIGS. 30A and 30B illustrate a device 3070 according to one embodiment of the disclosure. The device 3070 may be a cellular telephone which includes a hinge 3087 that couples a display housing 3089 to a keypad housing 3091. The hinge 3087 allows a user to open and close the cellular telephone so that it can be placed in at least one of two different configurations shown in FIGS. 30A and 30B. In one particular embodiment, the hinge 3087 may rotatably couple the display housing to the keypad housing. In particular, a user can open the cellular telephone to place it in the open configuration shown in FIG. 30A and can close the cellular telephone to place it in the closed configuration shown in FIG. 30B. The keypad housing 3091 may include a keypad 3095 which receives inputs (e.g. telephone number inputs or other alphanumeric inputs) from a user and a microphone 3097 which receives voice input from the user. The display housing 3089 may include, on its interior surface, a display 3093 (e.g. an LCD) and a speaker 3098 and a proximity sensor 3084; on its exterior surface, the display housing 3089 may include a speaker 3096, a temperature sensor 3094, a display 3088 (e.g. another LCD), an ambient light sensor 3092, and a proximity sensor 3084A. Hence, in this embodiment, the display housing 3089 may include a first proximity sensor on its interior surface and a second proximity sensor on its exterior surface.
In at least certain embodiments, the device 3070 may contain components which provide one or more of the functions of a wireless communication device such as a cellular telephone, a media player, an entertainment system, a PDA, or other types of devices described herein. In one implementation of an embodiment, the device 3070 may be a cellular telephone integrated with a media player which plays MP3 files, such as MP3 music files.
Each of the devices shown in FIGS. 4, 5A, 5B, 5C, 6A, 6B, 6C, 6D, 28, 29, 30A and 30B may be a wireless communication device, such as a cellular telephone, and may include a plurality of components which provide a capability for wireless communication. FIG. 31 shows an embodiment of a wireless device 3070 which includes the capability for wireless communication. The wireless device 3070 may be included in any one of the devices shown in FIGS. 4, 5A, 5B, 5C, 6A, 6B, 6C, 6D, 28, 29, 30A and 30B, although alternative embodiments of those devices of FIGS. 4, 5A, 5B, 5C, 6A, 6B, 6C, 6D, 28, 29, 30A and 30B may include more or fewer components than the Wireless device 3070.
Wireless device 3070 may include an antenna system 3101. Wireless device 3070 may also include a digital and/or analog radio frequency (RF) transceiver 3102, coupled to the antenna system 3101, to transmit and/or receive voice, digital data and/or media signals through antenna system 3101.
Wireless device 3070 may also include a digital processing system 3103 to control the digital RF transceiver and to manage the voice, digital data and/or media signals. Digital processing system 3103 may be a general purpose processing device, such as a microprocessor or controller for example. Digital processing system 3103 may also be a special purpose processing device, such as an ASIC (application specific integrated circuit), FPGA (field-programmable gate array) or DSP (digital signal processor). Digital processing system 3103 may also include other devices, as are known in the art, to interface with other components of wireless device 3070. For example, digital processing system 3103 may include analog-to-digital and digital-to-analog converters to interface with other components of wireless device 3070. Digital processing system 3103 may include a media processing system 3109, which may also include a general purpose or special purpose processing device to manage media, such as files of audio data.
Wireless device 3070 may also include a storage device 3104, coupled to the digital processing system, to store data and/or operating programs for the Wireless device 3070. Storage device 3104 may be, for example, any type of solid-state or magnetic memory device.
Wireless device 3070 may also include one or more input devices 3105, coupled to the digital processing system 3103, to accept user inputs (e.g., telephone numbers, names, addresses, media selections, etc.) Input device 3105 may be, for example, one or more of a keypad, a touchpad, a touch screen, a pointing device in combination with a display device or similar input device.
Wireless device 3070 may also include at least one display device 33106, coupled to the digital processing system 3103, to display information such as messages, telephone call information, contact information, pictures, movies and/or titles or other indicators of media being selected via the input device 3105. Display device 3106 may be, for example, an LCD display device. In one embodiment, display device 3106 and input device 3105 may be integrated together in the same device (e.g., a touch screen LCD such as a multi-touch input panel which is integrated with a display device, such as an LCD display device). The display device 3106 may include a backlight 3106A to illuminate the display device 3106 under certain circumstances. It will be appreciated that the Wireless device 3070 may include multiple displays.
Wireless device 3070 may also include a battery 3107 to supply operating power to components of the system including digital RF transceiver 3102, digital processing system 3103, storage device 3104, input device 3105, microphone 3105A, audio transducer 3108, media processing system 3109, sensor(s) 3110, and display device 3106. Battery 3107 may be, for example, a rechargeable or non-rechargeable lithium or nickel metal hydride battery. Wireless device 3070 may also include audio transducers 3108, which may include one or more speakers, and at least one microphone 3105A. In certain embodiments of the present disclosure, the wireless device 3070 can be used to implement at least some of the methods discussed in the present disclosure.
FIG. 32 shows another example of a device according to an embodiment of the disclosure. This device 3200 may include a processor, such as microprocessor 3202, and a memory 3204, which are coupled to each other through a bus 3206. The device 3200 may optionally include a cache 3208 which is coupled to the microprocessor 3202. This device may also optionally include a display controller and display device 3210 which is coupled to the other components through the bus 3206. One or more input/output controllers 3212 are also coupled to the bus 3206 to provide an interface for input/output devices 3214 and to provide an interface for one or more sensors 3216 which are for sensing user activity. The bus 3206 may include one or more buses connected to each other through various bridges, controllers, and/or adapters as is well known in the art. The input/output devices 3214 may include a keypad or keyboard or a cursor control device such as a touch input panel. Furthermore, the input/output devices 3214 may include a network interface which is either for a wired network or a wireless network (e.g. an RF transceiver). The sensors 3216 may be any one of the sensors described herein including, for example, a proximity sensor or an ambient light sensor. In at least certain implementations of the device 3200, the microprocessor 3202 may receive data from one or more sensors 3216 and may perform the analysis of that data in the manner described herein. For example, the data may be analyzed through an artificial intelligence process or in the other ways described herein. As a result of that analysis, the microprocessor 3202 may then automatically cause an adjustment in one or more settings of the device.
In certain embodiments of the present disclosure, the device 3200 can be used to implement at least some of the methods discussed in the present disclosure.
FIGS. 33A-C show another example of a device according to at least certain embodiments of the disclosure. FIG. 33A illustrates a laptop device 3300 with a keyboard 3302, a body 3304, a display frame 3306, and a display 3308. The laptop device 3300 can be converted into a tablet device as illustrated in FIG. 33B and FIG. 33C. FIG. 33B illustrates the conversion of the laptop device into a tablet device. An edge of a display frame 3356 containing a display 3358 is slide within the body 3354 across the top of a keyboard 3352 until forming a tablet device as illustrated in FIG. 33C. The tablet device with a display 2362 and a display frame 3366 rests on top of a body 3360.
In certain embodiments of the present disclosure, the laptop device 3300 can be used to implement at least some of the methods discussed in the present disclosure.
FIG. 34 illustrates details of an application programming interface in flow chart form according to certain teachings of the present disclosure. The application programming interface operates in an environment with user interface software interacting with a software application. In some embodiments, a hierarchy of views operates on top of a hierarchy of layers within the user interface software. The API operates as illustrated in method 3400 that includes constructing a hierarchy of views operating on top of a hierarchy of layers at block 3402. The method 3400 further includes providing access to the hierarchy of views without providing access to the hierarchy of layers at block 3404. An application may interact with the hierarchy of views via the API without accessing the hierarchy of layers operating below the hierarchy of views.
In some embodiments, a platform provides various scrolling, gesturing, and animating operations. The platform includes hardware components and an operating system. The hardware components may include a processing unit coupled to an input panel and a memory coupled to the processor. The operating system includes one or more programs that are stored in the memory and configured to be executed by the processing unit. One or more programs include various instructions for transferring function calls or messages through an application programming interface in order to perform various scrolling, gesturing, and animating operations.
In an embodiment, the one or more programs include instructions for transferring a scaling transform call through an API to determine a scaling transform for a view associated with a user input having a plurality of input points. In an embodiment, the one or more programs include instructions for transferring a rubberband call through an API to determine a rotation transform for a view associated with a user input having a plurality of input points.
In some embodiments, the platform includes a framework containing a library of software code. The framework interacts with the programs of the platform to provide application programming interfaces for performing various scrolling, gesturing, and animating operations. The framework also includes associated resources (e.g., images, text, etc.) that are stored in a single directory.
In an embodiment, the library of the framework provides an API for specifying a scaling transform for a view associated with a user input having a plurality of input points. In an embodiment, the library of the framework provides an API for specifying a scaling transform for a view associated with a user input having a plurality of input points.
In the foregoing specification, the disclosure has been described with reference to specific exemplary embodiments thereof. It will be evident that various modifications may be made thereto without departing from the broader spirit and scope of the disclosure as set forth in the following claims. The specification and drawings are, accordingly, to be regarded in an illustrative sense rather than a restrictive sense.

Claims (26)

The invention claimed is:
1. A machine readable non-transitory medium storing executable program instructions, which, when executed, cause an electronic device with a display to perform a method comprising:
receiving a user input that comprises a plurality of input points touching the display, wherein the user input generates a gesture event;
transferring a gesture start event function call between user interface software and a software application based on the user input, wherein the gesture start event function call includes a first list of two or more input points touching the display at a first time; and
transferring a gesture changed event function call between the user interface software and the software application based on the user input, wherein the gesture changed event function call includes a second list of two or more input points touching the display at a second time.
2. The medium of claim 1, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises information for at least one of the following:
a rotation of at least one input point;
a scaling of the input points;
a translation of the input points;
a position of the inner and outermost input points; and
a pressure of a first input point.
3. The medium of claim 1, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises a stage of an input point including just touch down, fully pressed, or lifting off.
4. The medium of claim 1, wherein the first list further comprises a position of each input point of the first list and a first number of input points touching the display,
wherein the second list further comprises a position of each input point of the second list and a second number of input points touching the display.
5. The medium of claim 1, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises a proximity of an input point with respect to the display, which indicates a pressure of the input point.
6. The medium of claim 1, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises an orientation corresponding to a single input point of the plurality of input points touching the display.
7. The medium of claim 1, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises a length of a major axis or a minor axis of an input point.
8. The medium of claim 1, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises a velocity of an input point.
9. The medium of claim 1, wherein transferring a gesture start event function call between user interface software and a software application based on the user input includes transferring the gesture start event function call through an application programming interface between the user interface software and the software application based on the user input; transferring the gesture changed event function call between the user interface software and the software application includes transferring the gesture changed event function call through the application programming interface between the user interface software and the software application based on the user input; and the method includes transferring a gesture end function call through the application programming interface between the user interface software and the software application based on the user input.
10. A method, comprising:
receiving a user input that comprises a plurality of input points touching a display of an electronic device, wherein the user input generates a gesture event;
transferring a gesture start event function call between user interface software and a software application based on the user input, wherein the gesture start event function call includes a first list of two or more input points touching the display at a first time; and
transferring a gesture changed event function call between the user interface software and the software application based on the user input, wherein the gesture changed event function call includes a second list of two or more input points touching the display at a second time.
11. The method of claim 10, further comprising:
transferring a gesture end function call based on the gesture event.
12. The method of claim 10, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises a stage of an input point including just touch down, fully pressed, or lifting off.
13. The method of claim 10, wherein:
at least one of the gesture start event function call and the gesture changed event function call further comprises a proximity of an input point with respect to the touch device, which indicates a pressure of the input point,
at least the one of the gesture start event function call and the gesture changed event function call further comprises an orientation corresponding to a single input point of the plurality of input points touching the display,
at least the one of the gesture start event function call and the gesture changed event function call further comprises a length of a major axis or a minor axis of an input point, and
at least the one of the gesture start event function call and the gesture changed event function call further comprises a velocity of an input point.
14. The method of claim 10, wherein transferring the gesture start event function call between the user interface software and the software application based on the user input includes transferring the gesture start event function call through an application programming interface between the user interface software and the software application based on the user input, and transferring the gesture changed event function call between the user interface software and the software application based on the user input includes transferring the gesture changed event function call through the application programming interface between the user interface software and the software application based on the user input.
15. A device comprising:
an input panel which is configured to receive user inputs;
a display device integrated with the input panel;
one or more processors coupled to the input panel; and
a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including:
instructions for receiving a user input that comprises a plurality of input points touching or near the input panel, wherein the user input generates a gesture event;
instructions for transferring a gesture start event function call between user interface software and a software application based on the user input, wherein the gesture start event function call includes a first list of two or more input points touching or near the input panel at a first time; and
instructions for transferring a gesture changed event function call between the user interface software and the software application based on the user input, wherein the gesture changed event function call includes a second list of two or more input points touching or near the input panel at a second time.
16. The device of claim 15, wherein the one or more programs further include:
instructions for transferring a gesture end function call based on the gesture event.
17. The device of claim 16, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises:
a stage of an input point including just touch down, fully pressed, or lifting off.
18. The device of claim 16, wherein the first list further comprises a position of each input point of the first list and a first number of input points touching the input panel, wherein the second list further comprises a position of each input point of the second list and a second number of input points touching the input panel.
19. The device of claim 16, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises a proximity of an input point with respect to the display device, which indicates a pressure of the input point.
20. The device of claim 16, wherein at least one of the gesture start event function call and the gesture changed event function call further comprises:
an orientation corresponding to a single input point of the plurality of input points touching or near the input panel,
a length of a major axis or a minor axis of an input point, and
a velocity of an input point.
21. The device of claim 15, wherein the instructions for transferring the gesture start event function call between the user interface software and the software application based on the user input include instructions for transferring the gesture start event function call through an application programming interface between the user interface software and the software application based on the user input, and the instructions for transferring the gesture changed event function call between the user interface software and the software application based on the user input include instructions for transferring the gesture changed event function call through the application programming interface between the user interface software and the software application based on the user input.
22. A device comprising:
an input panel which is configured to receive user inputs
a display device integrated with the input panel;
one or more processors coupled to the input panel; and
a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including:
instructions for receiving a user input that comprises a plurality of input points touching the input panel;
instructions for generating an event object in response to the user input;
instructions for transferring a gesture changed event function call between user interface software and a software application in response to a change in the user input; and
instructions for transferring a gesture end function call between the user interface software and the software application when at least one input point, of the plurality of input points, associated with the user input is removed from the input panel.
23. The device of claim 22, wherein the one or more programs further include:
instructions for generating a zoom to scale setting for a window or a view of the display in response to the change in the user input.
24. The device of claim 22, wherein the change in the user input comprises a rotation to invoke a gesture event that performs a rotation transform on a view associated with the user input.
25. The device of claim 24, wherein the rotation transform sets a start rotation angle and an end rotation angle.
26. The device of claim 22, wherein the one or more programs include:
instructions for transferring the gesture changed event function call, through an application programming interface between the user interface software and the software application, in response to the change in the user input; and
instructions for transferring the gesture end function call, through the application programming interface between the user interface software and the software application, when the at least one input point, of the plurality of input points, associated with the user input is removed from the input panel.
US13/251,150 2007-01-07 2011-09-30 Application programming interfaces for gesture operations Active 2028-06-10 US9639260B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/251,150 US9639260B2 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11/620,727 US20080168402A1 (en) 2007-01-07 2007-01-07 Application Programming Interfaces for Gesture Operations
US13/221,836 US9665265B2 (en) 2007-01-07 2011-08-30 Application programming interfaces for gesture operations
US13/251,150 US9639260B2 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/221,836 Continuation US9665265B2 (en) 2007-01-07 2011-08-30 Application programming interfaces for gesture operations

Publications (2)

Publication Number Publication Date
US20120023461A1 US20120023461A1 (en) 2012-01-26
US9639260B2 true US9639260B2 (en) 2017-05-02

Family

ID=39272573

Family Applications (11)

Application Number Title Priority Date Filing Date
US11/620,727 Abandoned US20080168402A1 (en) 2007-01-07 2007-01-07 Application Programming Interfaces for Gesture Operations
US13/221,836 Active 2027-12-26 US9665265B2 (en) 2007-01-07 2011-08-30 Application programming interfaces for gesture operations
US13/221,837 Abandoned US20110314430A1 (en) 2007-01-07 2011-08-30 Application programming interfaces for gesture operations
US13/251,150 Active 2028-06-10 US9639260B2 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations
US13/251,146 Abandoned US20120023509A1 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations
US13/251,121 Active 2028-01-25 US9529519B2 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations
US13/251,152 Active 2027-09-23 US9575648B2 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations
US15/139,260 Active 2027-07-22 US10175876B2 (en) 2007-01-07 2016-04-26 Application programming interfaces for gesture operations
US16/240,662 Active US10613741B2 (en) 2007-01-07 2019-01-04 Application programming interface for gesture operations
US16/840,190 Active US11449217B2 (en) 2007-01-07 2020-04-03 Application programming interfaces for gesture operations
US17/945,962 Pending US20230021869A1 (en) 2007-01-07 2022-09-15 Application Programming Interface for Gesture Operations

Family Applications Before (3)

Application Number Title Priority Date Filing Date
US11/620,727 Abandoned US20080168402A1 (en) 2007-01-07 2007-01-07 Application Programming Interfaces for Gesture Operations
US13/221,836 Active 2027-12-26 US9665265B2 (en) 2007-01-07 2011-08-30 Application programming interfaces for gesture operations
US13/221,837 Abandoned US20110314430A1 (en) 2007-01-07 2011-08-30 Application programming interfaces for gesture operations

Family Applications After (7)

Application Number Title Priority Date Filing Date
US13/251,146 Abandoned US20120023509A1 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations
US13/251,121 Active 2028-01-25 US9529519B2 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations
US13/251,152 Active 2027-09-23 US9575648B2 (en) 2007-01-07 2011-09-30 Application programming interfaces for gesture operations
US15/139,260 Active 2027-07-22 US10175876B2 (en) 2007-01-07 2016-04-26 Application programming interfaces for gesture operations
US16/240,662 Active US10613741B2 (en) 2007-01-07 2019-01-04 Application programming interface for gesture operations
US16/840,190 Active US11449217B2 (en) 2007-01-07 2020-04-03 Application programming interfaces for gesture operations
US17/945,962 Pending US20230021869A1 (en) 2007-01-07 2022-09-15 Application Programming Interface for Gesture Operations

Country Status (5)

Country Link
US (11) US20080168402A1 (en)
EP (1) EP2109809A1 (en)
CN (4) CN102750083B (en)
HK (1) HK1177017A1 (en)
WO (1) WO2008085848A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10324619B2 (en) * 2014-07-17 2019-06-18 Facebook, Inc. Touch-based gesture recognition and application navigation

Families Citing this family (224)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9722766D0 (en) 1997-10-28 1997-12-24 British Telecomm Portable computers
US7469381B2 (en) 2007-01-07 2008-12-23 Apple Inc. List scrolling and document translation, scaling, and rotation on a touch-screen display
US7296243B2 (en) 2002-03-19 2007-11-13 Aol Llc Animating display motion
EP1723505A4 (en) * 2004-03-11 2007-04-18 Redsky Mobile Inc Restricted user interface navigation
US8225231B2 (en) 2005-08-30 2012-07-17 Microsoft Corporation Aggregation of PC settings
US10048860B2 (en) 2006-04-06 2018-08-14 Google Technology Holdings LLC Method and apparatus for user interface adaptation
WO2007121557A1 (en) * 2006-04-21 2007-11-01 Anand Agarawala System for organizing and visualizing display objects
US8106856B2 (en) 2006-09-06 2012-01-31 Apple Inc. Portable electronic device for photo management
US7844915B2 (en) 2007-01-07 2010-11-30 Apple Inc. Application programming interfaces for scrolling operations
US8656311B1 (en) 2007-01-07 2014-02-18 Apple Inc. Method and apparatus for compositing various types of content
US20080168402A1 (en) 2007-01-07 2008-07-10 Christopher Blumenberg Application Programming Interfaces for Gesture Operations
US8813100B1 (en) 2007-01-07 2014-08-19 Apple Inc. Memory management
US20080168478A1 (en) 2007-01-07 2008-07-10 Andrew Platzer Application Programming Interfaces for Scrolling
US7903115B2 (en) 2007-01-07 2011-03-08 Apple Inc. Animations
US7872652B2 (en) 2007-01-07 2011-01-18 Apple Inc. Application programming interfaces for synchronization
US8555180B2 (en) * 2007-03-27 2013-10-08 Amulet Technologies, Llc Smart peripheral architecture for portable media players
US8643653B2 (en) * 2007-06-08 2014-02-04 Apple Inc. Web-based animation
CN101399897B (en) * 2007-09-30 2010-12-29 宏达国际电子股份有限公司 Image processing method
US8762892B2 (en) * 2008-01-30 2014-06-24 Microsoft Corporation Controlling an integrated messaging system using gestures
US8717305B2 (en) 2008-03-04 2014-05-06 Apple Inc. Touch event model for web pages
US8416196B2 (en) 2008-03-04 2013-04-09 Apple Inc. Touch event model programming interface
US8645827B2 (en) 2008-03-04 2014-02-04 Apple Inc. Touch event model
US8174502B2 (en) 2008-03-04 2012-05-08 Apple Inc. Touch event processing for web pages
US9503562B2 (en) 2008-03-19 2016-11-22 Universal Electronics Inc. System and method for appliance control via a personal communication or entertainment device
TWI366776B (en) * 2008-04-21 2012-06-21 Htc Corp Operating method and system and stroage device using the same
US8074181B2 (en) * 2008-09-15 2011-12-06 Microsoft Corporation Screen magnifier panning model with dynamically resizable panning regions
US9372590B2 (en) * 2008-09-26 2016-06-21 Microsoft Technology Licensing, Llc Magnifier panning interface for natural input devices
US8176438B2 (en) * 2008-09-26 2012-05-08 Microsoft Corporation Multi-modal interaction for a screen magnifier
US8086275B2 (en) 2008-10-23 2011-12-27 Microsoft Corporation Alternative inputs of a mobile communications device
US8411046B2 (en) 2008-10-23 2013-04-02 Microsoft Corporation Column organization of content
US8466879B2 (en) 2008-10-26 2013-06-18 Microsoft Corporation Multi-touch manipulation of application objects
US8477103B2 (en) 2008-10-26 2013-07-02 Microsoft Corporation Multi-touch object inertia simulation
US8610673B2 (en) * 2008-12-03 2013-12-17 Microsoft Corporation Manipulation of list on a multi-touch display
US20100162181A1 (en) * 2008-12-22 2010-06-24 Palm, Inc. Interpreting Gesture Input Including Introduction Or Removal Of A Point Of Contact While A Gesture Is In Progress
US8566045B2 (en) 2009-03-16 2013-10-22 Apple Inc. Event recognition
US9684521B2 (en) * 2010-01-26 2017-06-20 Apple Inc. Systems having discrete and continuous gesture recognizers
US9311112B2 (en) 2009-03-16 2016-04-12 Apple Inc. Event recognition
US8285499B2 (en) 2009-03-16 2012-10-09 Apple Inc. Event recognition
US8566044B2 (en) 2009-03-16 2013-10-22 Apple Inc. Event recognition
US8238876B2 (en) 2009-03-30 2012-08-07 Microsoft Corporation Notifications
US8175653B2 (en) 2009-03-30 2012-05-08 Microsoft Corporation Chromeless user interface
US8677282B2 (en) * 2009-05-13 2014-03-18 International Business Machines Corporation Multi-finger touch adaptations for medical imaging systems
US8836648B2 (en) 2009-05-27 2014-09-16 Microsoft Corporation Touch pull-in gesture
US8223945B2 (en) * 2009-06-12 2012-07-17 T-Mobile Usa, Inc. Communication acceptance time extender
CA2771918C (en) 2009-08-25 2015-06-09 Google Inc. Direct manipulation gestures
US8677283B2 (en) * 2009-10-21 2014-03-18 Microsoft Corporation Displaying lists as reacting against barriers
CN101702111B (en) * 2009-11-13 2013-07-03 宇龙计算机通信科技(深圳)有限公司 Method for realizing content scaling of touch screen and terminal
US8786559B2 (en) * 2010-01-06 2014-07-22 Apple Inc. Device, method, and graphical user interface for manipulating tables using multi-contact gestures
US8698762B2 (en) 2010-01-06 2014-04-15 Apple Inc. Device, method, and graphical user interface for navigating and displaying content in context
US8570286B2 (en) * 2010-02-12 2013-10-29 Honeywell International Inc. Gestures on a touch-sensitive display
US20110199386A1 (en) * 2010-02-12 2011-08-18 Honeywell International Inc. Overlay feature to provide user assistance in a multi-touch interactive display environment
US8638371B2 (en) * 2010-02-12 2014-01-28 Honeywell International Inc. Method of manipulating assets shown on a touch-sensitive display
US20110199516A1 (en) * 2010-02-12 2011-08-18 Honeywell International Inc. Method of showing video on a touch-sensitive display
US20110199517A1 (en) * 2010-02-12 2011-08-18 Honeywell International Inc. Method of showing video on a touch-sensitive display
CN102169404A (en) * 2010-02-26 2011-08-31 易搜比控股公司 Display method for article displacement on screen of electronic device
JP5409896B2 (en) 2010-03-23 2014-02-05 シャープ株式会社 Information display device and document data editing method
CN102236442B (en) * 2010-04-28 2015-04-15 赛恩倍吉科技顾问(深圳)有限公司 Touchpad control system and method
US8776091B2 (en) * 2010-04-30 2014-07-08 Microsoft Corporation Reducing feedback latency
CN102270081B (en) * 2010-06-03 2015-09-23 腾讯科技(深圳)有限公司 A kind of method and device adjusting size of list element
US10216408B2 (en) 2010-06-14 2019-02-26 Apple Inc. Devices and methods for identifying user interface objects based on view hierarchy
KR20120013727A (en) 2010-08-06 2012-02-15 삼성전자주식회사 Display apparatus and control method thereof
KR101731843B1 (en) * 2010-09-02 2017-05-02 삼성전자 주식회사 Method and Apparatus for displaying items
CN102169383A (en) * 2010-11-26 2011-08-31 苏州瀚瑞微电子有限公司 Identification method for rotating gestures of touch screen
US20120159395A1 (en) 2010-12-20 2012-06-21 Microsoft Corporation Application-launching interface for multiple modes
US20120159383A1 (en) 2010-12-20 2012-06-21 Microsoft Corporation Customization of an immersive environment
US8612874B2 (en) 2010-12-23 2013-12-17 Microsoft Corporation Presenting an application change through a tile
US8689123B2 (en) 2010-12-23 2014-04-01 Microsoft Corporation Application reporting in an application-selectable user interface
US9423951B2 (en) 2010-12-31 2016-08-23 Microsoft Technology Licensing, Llc Content-based snap point
US9015639B2 (en) 2011-02-11 2015-04-21 Linkedin Corporation Methods and systems for navigating a list with gestures
US9134899B2 (en) * 2011-03-14 2015-09-15 Microsoft Technology Licensing, Llc Touch gesture indicating a scroll on a touch-sensitive display in a single direction
US8836802B2 (en) 2011-03-21 2014-09-16 Honeywell International Inc. Method of defining camera scan movements using gestures
US9383917B2 (en) 2011-03-28 2016-07-05 Microsoft Technology Licensing, Llc Predictive tiling
US9298363B2 (en) 2011-04-11 2016-03-29 Apple Inc. Region activation for touch sensitive surface
US9658766B2 (en) 2011-05-27 2017-05-23 Microsoft Technology Licensing, Llc Edge gesture
US8893033B2 (en) 2011-05-27 2014-11-18 Microsoft Corporation Application notifications
US20120304132A1 (en) 2011-05-27 2012-11-29 Chaitanya Dev Sareen Switching back to a previously-interacted-with application
US9104440B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US9158445B2 (en) 2011-05-27 2015-10-13 Microsoft Technology Licensing, Llc Managing an immersive interface in a multi-application immersive environment
US9104307B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US20120306930A1 (en) * 2011-06-05 2012-12-06 Apple Inc. Techniques for zooming in and out with dynamic content
US9552376B2 (en) 2011-06-09 2017-01-24 MemoryWeb, LLC Method and apparatus for managing digital files
US8687023B2 (en) 2011-08-02 2014-04-01 Microsoft Corporation Cross-slide gesture to select and rearrange
US20130057587A1 (en) 2011-09-01 2013-03-07 Microsoft Corporation Arranging tiles
US10353566B2 (en) * 2011-09-09 2019-07-16 Microsoft Technology Licensing, Llc Semantic zoom animations
US20130067390A1 (en) * 2011-09-09 2013-03-14 Paul J. Kwiatkowski Programming Interface for Semantic Zoom
JP5602115B2 (en) * 2011-09-09 2014-10-08 株式会社ソニー・コンピュータエンタテインメント GAME DEVICE, GAME CONTROL METHOD, AND GAME CONTROL PROGRAM
US20130067398A1 (en) * 2011-09-09 2013-03-14 Theresa B. Pittappilly Semantic Zoom
US8922575B2 (en) 2011-09-09 2014-12-30 Microsoft Corporation Tile cache
US9557909B2 (en) 2011-09-09 2017-01-31 Microsoft Technology Licensing, Llc Semantic zoom linguistic helpers
US8933952B2 (en) 2011-09-10 2015-01-13 Microsoft Corporation Pre-rendering new content for an application-selectable user interface
US9244802B2 (en) 2011-09-10 2016-01-26 Microsoft Technology Licensing, Llc Resource user interface
US9146670B2 (en) 2011-09-10 2015-09-29 Microsoft Technology Licensing, Llc Progressively indicating new content in an application-selectable user interface
US9223472B2 (en) 2011-12-22 2015-12-29 Microsoft Technology Licensing, Llc Closing applications
US9367085B2 (en) 2012-01-26 2016-06-14 Google Technology Holdings LLC Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device
US9524272B2 (en) * 2012-02-05 2016-12-20 Apple Inc. Navigating among content items in a browser using an array mode
US9128605B2 (en) 2012-02-16 2015-09-08 Microsoft Technology Licensing, Llc Thumbnail-image selection of applications
US9131192B2 (en) 2012-03-06 2015-09-08 Apple Inc. Unified slider control for modifying multiple image properties
US9569078B2 (en) 2012-03-06 2017-02-14 Apple Inc. User interface tools for cropping and straightening image
US20130238747A1 (en) 2012-03-06 2013-09-12 Apple Inc. Image beaming for a media editing application
EP2850610B1 (en) * 2012-05-18 2020-11-04 BlackBerry Limited Systems and methods to manage zooming
US8504934B1 (en) * 2012-08-30 2013-08-06 Google Inc. Displaying a graphical keyboard
US9959038B2 (en) 2012-08-30 2018-05-01 Google Llc Displaying a graphic keyboard
US9483155B2 (en) 2012-09-13 2016-11-01 Microsoft Technology Licensing, Llc Pointer unification
JP6025473B2 (en) * 2012-09-14 2016-11-16 キヤノン株式会社 Information processing apparatus, information processing method, and program
KR20140039762A (en) * 2012-09-25 2014-04-02 삼성전자주식회사 Image processing apparatus and control method thereof
EP2911393B1 (en) * 2012-10-16 2018-06-06 Jae Woong Jeon Method and system for controlling virtual camera in virtual 3d space and computer-readable recording medium
US9229632B2 (en) 2012-10-29 2016-01-05 Facebook, Inc. Animation sequence associated with image
US9501140B2 (en) 2012-11-05 2016-11-22 Onysus Software Ltd Method and apparatus for developing and playing natural user interface applications
CN102929490B (en) * 2012-11-09 2017-03-15 东莞宇龙通信科技有限公司 Mobile terminal and tray setup method
US9507483B2 (en) 2012-11-14 2016-11-29 Facebook, Inc. Photographs with location or time information
US9507757B2 (en) 2012-11-14 2016-11-29 Facebook, Inc. Generating multiple versions of a content item for multiple platforms
US9606695B2 (en) 2012-11-14 2017-03-28 Facebook, Inc. Event notification
US9245312B2 (en) 2012-11-14 2016-01-26 Facebook, Inc. Image panning and zooming effect
US9547416B2 (en) 2012-11-14 2017-01-17 Facebook, Inc. Image presentation
US9081410B2 (en) 2012-11-14 2015-07-14 Facebook, Inc. Loading content on electronic device
US9547627B2 (en) 2012-11-14 2017-01-17 Facebook, Inc. Comment presentation
US9235321B2 (en) 2012-11-14 2016-01-12 Facebook, Inc. Animation sequence associated with content item
US9607289B2 (en) 2012-11-14 2017-03-28 Facebook, Inc. Content type filter
US9684935B2 (en) 2012-11-14 2017-06-20 Facebook, Inc. Content composer for third-party applications
US9696898B2 (en) * 2012-11-14 2017-07-04 Facebook, Inc. Scrolling through a series of content items
US9218188B2 (en) 2012-11-14 2015-12-22 Facebook, Inc. Animation sequence associated with feedback user-interface element
KR102174916B1 (en) * 2012-11-30 2020-11-05 삼성전자주식회사 Mobile apparatus displaying end effect and cotrol method there of
CN103853442B (en) * 2012-12-03 2017-07-25 联想(北京)有限公司 A kind of information processing method and electronic equipment
US9652131B2 (en) * 2012-12-18 2017-05-16 Microsoft Technology Licensing, Llc Directional selection
USD732558S1 (en) * 2013-03-11 2015-06-23 Arris Technology, Inc. Display screen with graphical user interface
CN104077273A (en) * 2013-03-27 2014-10-01 腾讯科技(深圳)有限公司 Method and device for extracting webpage contents
US9450952B2 (en) 2013-05-29 2016-09-20 Microsoft Technology Licensing, Llc Live tiles without application-code execution
US9215302B2 (en) 2013-05-10 2015-12-15 Google Technology Holdings LLC Method and device for determining user handedness and controlling a user interface
CN103345359B (en) * 2013-06-03 2016-05-11 珠海金山办公软件有限公司 A kind of gesture is switched the mthods, systems and devices of chart ranks
US9733716B2 (en) 2013-06-09 2017-08-15 Apple Inc. Proxy gesture recognizer
AU2014278636B2 (en) * 2013-06-09 2017-09-07 Apple Inc. Device, method, and graphical user interface for moving user interface objects
USD757103S1 (en) * 2013-06-18 2016-05-24 Huawei Technologies Co., Ltd. Display screen or portion thereof with icon
US9423913B2 (en) 2013-07-01 2016-08-23 Blackberry Limited Performance control of ambient light sensors
US9489051B2 (en) 2013-07-01 2016-11-08 Blackberry Limited Display navigation using touch-less gestures
US9367137B2 (en) 2013-07-01 2016-06-14 Blackberry Limited Alarm operation by touch-less gesture
US9342671B2 (en) 2013-07-01 2016-05-17 Blackberry Limited Password by touch-less gesture
US9256290B2 (en) 2013-07-01 2016-02-09 Blackberry Limited Gesture detection using ambient light sensors
US9398221B2 (en) 2013-07-01 2016-07-19 Blackberry Limited Camera control using ambient light sensors
US9323336B2 (en) 2013-07-01 2016-04-26 Blackberry Limited Gesture detection using ambient light sensors
US9405461B2 (en) 2013-07-09 2016-08-02 Blackberry Limited Operating a device using touchless and touchscreen gestures
US9465448B2 (en) 2013-07-24 2016-10-11 Blackberry Limited Backlight for touchless gesture detection
US9304596B2 (en) 2013-07-24 2016-04-05 Blackberry Limited Backlight for touchless gesture detection
FR3009198B1 (en) * 2013-08-01 2015-07-17 Techniplast DEVICE FOR DIFFUSING A FRAGRANCE SUCH AS A FRAGRANCE
US9194741B2 (en) 2013-09-06 2015-11-24 Blackberry Limited Device having light intensity measurement in presence of shadows
US8869062B1 (en) 2013-11-27 2014-10-21 Freedom Scientific, Inc. Gesture-based screen-magnified touchscreen navigation
JP5924555B2 (en) * 2014-01-06 2016-05-25 コニカミノルタ株式会社 Object stop position control method, operation display device, and program
EP3126969A4 (en) 2014-04-04 2017-04-12 Microsoft Technology Licensing, LLC Expandable application representation
CN105378582B (en) 2014-04-10 2019-07-23 微软技术许可有限责任公司 Calculate the foldable cap of equipment
CN105359055A (en) 2014-04-10 2016-02-24 微软技术许可有限责任公司 Slider cover for computing device
US9547433B1 (en) 2014-05-07 2017-01-17 Google Inc. Systems and methods for changing control functions during an input gesture
US9977505B2 (en) * 2014-06-06 2018-05-22 International Business Machines Corporation Controlling inadvertent inputs to a mobile device
US10254942B2 (en) 2014-07-31 2019-04-09 Microsoft Technology Licensing, Llc Adaptive sizing and positioning of application windows
US10592080B2 (en) 2014-07-31 2020-03-17 Microsoft Technology Licensing, Llc Assisted presentation of application windows
US10678412B2 (en) 2014-07-31 2020-06-09 Microsoft Technology Licensing, Llc Dynamic joint dividers for application windows
US9971496B2 (en) 2014-08-04 2018-05-15 Google Technology Holdings LLC Method and apparatus for adjusting a graphical user interface on an electronic device
US10642365B2 (en) 2014-09-09 2020-05-05 Microsoft Technology Licensing, Llc Parametric inertia and APIs
USD788787S1 (en) * 2014-09-10 2017-06-06 Baidu Online Network Technology (Beijing) Co., Ltd. Display screen or portion thereof with animated graphical user interface
WO2016065568A1 (en) 2014-10-30 2016-05-06 Microsoft Technology Licensing, Llc Multi-configuration input device
US9733734B2 (en) 2014-11-13 2017-08-15 Grayhill, Inc. Method for using a two-dimensional touchpad to manipulate a three-dimensional image
CN104850340B (en) * 2015-01-30 2018-11-30 小米科技有限责任公司 Document display method and device on touching display screen
US10489033B2 (en) 2015-06-07 2019-11-26 Apple Inc. Device, method, and graphical user interface for providing and interacting with a virtual drawing aid
AU2017100670C4 (en) 2016-06-12 2019-11-21 Apple Inc. User interfaces for retrieving contextually relevant media content
DK201670608A1 (en) 2016-06-12 2018-01-02 Apple Inc User interfaces for retrieving contextually relevant media content
US20170357672A1 (en) 2016-06-12 2017-12-14 Apple Inc. Relating digital assets using notable moments
JP2018032075A (en) * 2016-08-22 2018-03-01 キヤノン株式会社 Display control device and control method thereof
US10369988B2 (en) 2017-01-13 2019-08-06 Ford Global Technologies, Llc Autonomous parking of vehicles inperpendicular parking spots
US10683034B2 (en) 2017-06-06 2020-06-16 Ford Global Technologies, Llc Vehicle remote parking systems and methods
US10234868B2 (en) 2017-06-16 2019-03-19 Ford Global Technologies, Llc Mobile device initiation of vehicle remote-parking
US10775781B2 (en) 2017-06-16 2020-09-15 Ford Global Technologies, Llc Interface verification for vehicle remote park-assist
US10585430B2 (en) 2017-06-16 2020-03-10 Ford Global Technologies, Llc Remote park-assist authentication for vehicles
US10580304B2 (en) 2017-10-02 2020-03-03 Ford Global Technologies, Llc Accelerometer-based external sound monitoring for voice controlled autonomous parking
US10281921B2 (en) 2017-10-02 2019-05-07 Ford Global Technologies, Llc Autonomous parking of vehicles in perpendicular parking spots
US10627811B2 (en) 2017-11-07 2020-04-21 Ford Global Technologies, Llc Audio alerts for remote park-assist tethering
US10336320B2 (en) 2017-11-22 2019-07-02 Ford Global Technologies, Llc Monitoring of communication for vehicle remote park-assist
US10578676B2 (en) 2017-11-28 2020-03-03 Ford Global Technologies, Llc Vehicle monitoring of mobile device state-of-charge
CN108304237A (en) * 2017-12-29 2018-07-20 维沃移动通信有限公司 A kind of image processing method and device, mobile terminal of mobile terminal
US10688918B2 (en) 2018-01-02 2020-06-23 Ford Global Technologies, Llc Mobile device tethering for a remote parking assist system of a vehicle
US10737690B2 (en) 2018-01-02 2020-08-11 Ford Global Technologies, Llc Mobile device tethering for a remote parking assist system of a vehicle
US10814864B2 (en) 2018-01-02 2020-10-27 Ford Global Technologies, Llc Mobile device tethering for a remote parking assist system of a vehicle
US10585431B2 (en) 2018-01-02 2020-03-10 Ford Global Technologies, Llc Mobile device tethering for a remote parking assist system of a vehicle
US10583830B2 (en) 2018-01-02 2020-03-10 Ford Global Technologies, Llc Mobile device tethering for a remote parking assist system of a vehicle
US10974717B2 (en) 2018-01-02 2021-04-13 Ford Global Technologies, I.LC Mobile device tethering for a remote parking assist system of a vehicle
US11148661B2 (en) 2018-01-02 2021-10-19 Ford Global Technologies, Llc Mobile device tethering for a remote parking assist system of a vehicle
US10684773B2 (en) 2018-01-03 2020-06-16 Ford Global Technologies, Llc Mobile device interface for trailer backup-assist
US10747218B2 (en) 2018-01-12 2020-08-18 Ford Global Technologies, Llc Mobile device tethering for remote parking assist
US10917748B2 (en) 2018-01-25 2021-02-09 Ford Global Technologies, Llc Mobile device tethering for vehicle systems based on variable time-of-flight and dead reckoning
US10684627B2 (en) 2018-02-06 2020-06-16 Ford Global Technologies, Llc Accelerometer-based external sound monitoring for position aware autonomous parking
US11188070B2 (en) 2018-02-19 2021-11-30 Ford Global Technologies, Llc Mitigating key fob unavailability for remote parking assist systems
US10507868B2 (en) 2018-02-22 2019-12-17 Ford Global Technologies, Llc Tire pressure monitoring for vehicle park-assist
US10732622B2 (en) 2018-04-05 2020-08-04 Ford Global Technologies, Llc Advanced user interaction features for remote park assist
US10793144B2 (en) 2018-04-09 2020-10-06 Ford Global Technologies, Llc Vehicle remote park-assist communication counters
US10493981B2 (en) 2018-04-09 2019-12-03 Ford Global Technologies, Llc Input signal management for vehicle park-assist
US10683004B2 (en) 2018-04-09 2020-06-16 Ford Global Technologies, Llc Input signal management for vehicle park-assist
US10759417B2 (en) 2018-04-09 2020-09-01 Ford Global Technologies, Llc Input signal management for vehicle park-assist
US11086935B2 (en) 2018-05-07 2021-08-10 Apple Inc. Smart updates from historical database changes
US11243996B2 (en) 2018-05-07 2022-02-08 Apple Inc. Digital asset search user interface
DK180171B1 (en) 2018-05-07 2020-07-14 Apple Inc USER INTERFACES FOR SHARING CONTEXTUALLY RELEVANT MEDIA CONTENT
US10232673B1 (en) 2018-06-01 2019-03-19 Ford Global Technologies, Llc Tire pressure monitoring with vehicle park-assist
US10384605B1 (en) 2018-09-04 2019-08-20 Ford Global Technologies, Llc Methods and apparatus to facilitate pedestrian detection during remote-controlled maneuvers
US10803135B2 (en) 2018-09-11 2020-10-13 Apple Inc. Techniques for disambiguating clustered occurrence identifiers
US10846343B2 (en) 2018-09-11 2020-11-24 Apple Inc. Techniques for disambiguating clustered location identifiers
US10821972B2 (en) 2018-09-13 2020-11-03 Ford Global Technologies, Llc Vehicle remote parking assist systems and methods
US10717432B2 (en) 2018-09-13 2020-07-21 Ford Global Technologies, Llc Park-assist based on vehicle door open positions
US10529233B1 (en) 2018-09-24 2020-01-07 Ford Global Technologies Llc Vehicle and method for detecting a parking space via a drone
US10967851B2 (en) 2018-09-24 2021-04-06 Ford Global Technologies, Llc Vehicle system and method for setting variable virtual boundary
US10908603B2 (en) 2018-10-08 2021-02-02 Ford Global Technologies, Llc Methods and apparatus to facilitate remote-controlled maneuvers
US10628687B1 (en) 2018-10-12 2020-04-21 Ford Global Technologies, Llc Parking spot identification for vehicle park-assist
US11097723B2 (en) 2018-10-17 2021-08-24 Ford Global Technologies, Llc User interfaces for vehicle remote park assist
US11137754B2 (en) 2018-10-24 2021-10-05 Ford Global Technologies, Llc Intermittent delay mitigation for remote vehicle operation
US10936178B2 (en) 2019-01-07 2021-03-02 MemoryWeb, LLC Systems and methods for analyzing and organizing digital photos and videos
US11789442B2 (en) 2019-02-07 2023-10-17 Ford Global Technologies, Llc Anomalous input detection
US11195344B2 (en) 2019-03-15 2021-12-07 Ford Global Technologies, Llc High phone BLE or CPU burden detection and notification
CN109976861B (en) 2019-03-28 2023-01-10 北京小米移动软件有限公司 Interactive interface display method and device and storage medium
US11275368B2 (en) 2019-04-01 2022-03-15 Ford Global Technologies, Llc Key fobs for vehicle remote park-assist
US11169517B2 (en) 2019-04-01 2021-11-09 Ford Global Technologies, Llc Initiation of vehicle remote park-assist with key fob
US11385785B2 (en) * 2019-05-01 2022-07-12 Google Llc Interface for multiple simultaneous interactive views
US11520469B2 (en) 2019-05-01 2022-12-06 Google Llc Interface for multiple simultaneous interactive views
CN113646740A (en) 2019-05-01 2021-11-12 谷歌有限责任公司 Interface for multiple simultaneous interactive views
DK201970535A1 (en) 2019-05-06 2020-12-21 Apple Inc Media browsing user interface with intelligently selected representative media items
CN110673913B (en) * 2019-09-23 2022-02-01 维沃移动通信有限公司 Notification message display method and mobile terminal
US11216172B1 (en) * 2019-10-22 2022-01-04 Twitter, Inc. Scrolling feed while maintaining expanded size of post in feed
CN110908581B (en) * 2019-11-20 2021-04-23 网易(杭州)网络有限公司 Gesture recognition method and device, computer storage medium and electronic equipment
CN114416241B (en) * 2021-12-30 2023-10-27 北京奇艺世纪科技有限公司 Service identifier display method and device, electronic equipment and storage medium
CN114706515A (en) * 2022-04-26 2022-07-05 长沙朗源电子科技有限公司 Figure three-finger rotation method and device based on electronic whiteboard

Citations (285)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4455452A (en) 1982-09-13 1984-06-19 Touch Activated Switch Arrays, Inc. Touch activated controller for generating X-Y output information
US4674066A (en) 1983-02-18 1987-06-16 Houghton Mifflin Company Textual database system using skeletonization and phonetic replacement to retrieve words matching or similar to query words
US5252951A (en) 1989-04-28 1993-10-12 International Business Machines Corporation Graphical user interface with gesture recognition in a multiapplication environment
JPH05298002A (en) 1992-04-15 1993-11-12 Oki Electric Ind Co Ltd Keyboard
US5488204A (en) 1992-06-08 1996-01-30 Synaptics, Incorporated Paintbrush stylus for capacitive touch sensor pad
US5513309A (en) 1993-01-05 1996-04-30 Apple Computer, Inc. Graphic editor user interface for a pointer-based computer system
US5530861A (en) 1991-08-26 1996-06-25 Hewlett-Packard Company Process enaction and tool integration via a task oriented paradigm
US5534893A (en) 1993-12-15 1996-07-09 Apple Computer, Inc. Method and apparatus for using stylus-tablet input in a computer system
US5566337A (en) 1994-05-13 1996-10-15 Apple Computer, Inc. Method and apparatus for distributing events in an operating system
US5589856A (en) 1993-04-29 1996-12-31 International Business Machines Corporation System & method for dynamically labeled touch sensitive buttons in a digitizing display
US5627567A (en) 1993-04-27 1997-05-06 Hewlett-Packard Company Method and apparatus for adaptive touch recognition in a touch sensitive user interface
US5627959A (en) 1993-09-20 1997-05-06 Oracle Corporation Method for manipulating graphic objects
US5686940A (en) 1993-12-24 1997-11-11 Rohm Co., Ltd. Display apparatus
US5708460A (en) 1995-06-02 1998-01-13 Avi Systems, Inc. Touch screen
US5745116A (en) 1996-09-09 1998-04-28 Motorola, Inc. Intuitive gesture-based graphical user interface
GB2319591A (en) 1996-11-20 1998-05-27 Alps Electric Co Ltd Coordinates input apparatus
US5818455A (en) 1993-07-21 1998-10-06 Xerox Corporation Method and apparatus for operating on the model data structure of an image to produce human perceptible output using a viewing operation region having explicit multiple regions
US5854853A (en) 1993-12-22 1998-12-29 Canon Kabushika Kaisha Method and apparatus for selecting blocks of image data from image data having both horizontally- and vertically-oriented blocks
US5880411A (en) 1992-06-08 1999-03-09 Synaptics, Incorporated Object position detector with edge motion feature and gesture recognition
US5903902A (en) 1996-09-09 1999-05-11 Design Intelligence, Inc. Design engine with tree and component structure
US5917477A (en) 1997-02-28 1999-06-29 Samsung Electronics Co., Ltd. Touch screen input apparatus for chip mounter, chip mounter including the same and method for controlling the chip mounter
US5959629A (en) 1996-11-25 1999-09-28 Sony Corporation Text input device and method
US6028602A (en) 1997-05-30 2000-02-22 Telefonaktiebolaget Lm Ericsson Method for managing contents of a hierarchical data model
US6035343A (en) 1993-06-11 2000-03-07 Fujitsu Limited Method for executing software formed of software components and a system for executing such software
WO2000038042A1 (en) 1998-12-22 2000-06-29 Ericsson Inc. Apparatus and method for determining selection of touchable items on a computer touchscreen by an imprecise touch
JP2000222130A (en) 1999-02-02 2000-08-11 Toshiba Corp Input device and method and storage medium
US6188391B1 (en) 1998-07-09 2001-02-13 Synaptics, Inc. Two-layer capacitive touchpad and method of making same
US20010011998A1 (en) 1997-04-09 2001-08-09 Hiroaki Agata Embedded keyboard pointing device with keyboard unit and information processing apparatus
US20010012001A1 (en) 1997-07-07 2001-08-09 Junichi Rekimoto Information input apparatus
JP2001290585A (en) 2000-01-31 2001-10-19 Canon Inc Position information processor, position information processing method and program, and operation device and its method and program
US6323846B1 (en) 1998-01-26 2001-11-27 University Of Delaware Method and apparatus for integrating manual input
US20010045949A1 (en) 2000-03-29 2001-11-29 Autodesk, Inc. Single gesture map navigation graphical user interface for a personal digital assistant
WO2002008881A2 (en) 2000-07-21 2002-01-31 Qinetiq Limited Human-computer interface
WO2002013176A2 (en) 2000-08-07 2002-02-14 Zframe, Inc Visual content browsing using rasterized representations
US6369821B2 (en) 1997-05-19 2002-04-09 Microsoft Corporation Method and system for synchronizing scripted animations
US6377965B1 (en) 1997-11-07 2002-04-23 Microsoft Corporation Automatic word completion system for partially entered data
US6446083B1 (en) 2000-05-12 2002-09-03 Vastvideo, Inc. System and method for classifying media items
US6486896B1 (en) 1999-04-07 2002-11-26 Apple Computer, Inc. Scalable scroll controller
US20020194589A1 (en) 2001-05-08 2002-12-19 Cristofalo Michael Technique for optimizing the delivery of advertisements and other programming segments by making bandwidth tradeoffs
US20020191029A1 (en) 2001-05-16 2002-12-19 Synaptics, Inc. Touch screen with user interface enhancement
US20030071850A1 (en) 2001-10-12 2003-04-17 Microsoft Corporation In-place adaptive handwriting input method and system
US20030071858A1 (en) 2001-09-28 2003-04-17 Hiroshi Morohoshi Information input and output system, method, storage medium, and carrier wave
US20030080946A1 (en) 2001-10-25 2003-05-01 Wei-Pin Chuang Portable computer and related method for preventing input interruption by write-tracking an input region
US20030095096A1 (en) 2001-10-22 2003-05-22 Apple Computer, Inc. Method and apparatus for use of rotational user inputs
US6570557B1 (en) 2001-02-10 2003-05-27 Finger Works, Inc. Multi-touch system and method for emulating modifier keys via fingertip chords
US6570594B1 (en) 1998-06-30 2003-05-27 Sun Microsystems, Inc. User interface with non-intrusive display element
US20030122787A1 (en) 2001-12-28 2003-07-03 Philips Electronics North America Corporation Touch-screen image scrolling system and method
US6590595B1 (en) 2000-02-08 2003-07-08 Sun Microsystems, Inc. Mechanism for providing intuitive scrolling feedback
US20030132959A1 (en) 2002-01-16 2003-07-17 Simister J. Bret Interface engine providing a continuous user interface
US20030146941A1 (en) 2002-02-05 2003-08-07 Bailey Richard St.Clair Systems and methods for creating and managing graphical user interface lists
US20030160832A1 (en) 1998-07-14 2003-08-28 Brad Ridgley Method and device for finding, collecting and acting upon units of information
US20030174149A1 (en) 2002-02-06 2003-09-18 Hitomi Fujisaki Apparatus and method for data-processing
US6631501B1 (en) 1999-06-30 2003-10-07 Microsoft Corporation Method and system for automatic type and replace of characters in a sequence of characters
JP2003296024A (en) 2002-04-01 2003-10-17 Nec Engineering Ltd Method of touch panel control
US6636242B2 (en) 1999-08-31 2003-10-21 Accenture Llp View configurer in a presentation services patterns environment
US20030197689A1 (en) 2002-04-23 2003-10-23 May Gregory J. Input device that allows multiple touch key input
US6639584B1 (en) 1999-07-06 2003-10-28 Chuang Li Methods and apparatus for controlling a portable electronic device using a touchpad
US20030222917A1 (en) 2002-05-30 2003-12-04 Intel Corporation Mobile virtual desktop
US6664989B1 (en) 1999-10-18 2003-12-16 Honeywell International Inc. Methods and apparatus for graphical display interaction
US6677932B1 (en) 2001-01-28 2004-01-13 Finger Works, Inc. System and method for recognizing touch typing under limited tactile feedback conditions
US6677965B1 (en) 2000-07-13 2004-01-13 International Business Machines Corporation Rubber band graphical user interface control
US20040021698A1 (en) 2002-08-05 2004-02-05 Baldwin Amanda K. Intuitive touchscreen interface for a multifunction device and method therefor
US20040021676A1 (en) 2002-08-01 2004-02-05 Tatung Co., Ltd. Method and apparatus of view window scrolling
US20040027398A1 (en) 2001-02-15 2004-02-12 Denny Jaeger Intuitive graphic user interface with universal tools
US20040039474A1 (en) 2002-08-26 2004-02-26 Tsudakoma Kogyo Kabushiki Kaisha Information display apparatus of a loom
US6714936B1 (en) 1999-05-25 2004-03-30 Nevin, Iii Rocky Harry W. Method and apparatus for displaying data stored in linked nodes
US6735583B1 (en) 2000-11-01 2004-05-11 Getty Images, Inc. Method and system for classifying and locating media content
US20040095387A1 (en) 2002-11-19 2004-05-20 Demsey Seth M. Virtualized and realized user interface controls
US6741996B1 (en) 2001-04-18 2004-05-25 Microsoft Corporation Managing user clips
US20040100479A1 (en) 2002-05-13 2004-05-27 Masao Nakano Portable information terminal, display control device, display control method, and computer readable program therefor
US20040125136A1 (en) 2002-12-30 2004-07-01 Jukka Wallenius Provision of services through a display system
US6765557B1 (en) 2000-04-10 2004-07-20 Interlink Electronics, Inc. Remote control having touch pad to screen mapping
US6778992B1 (en) 1999-12-21 2004-08-17 Lockstream Corporation Flexible and hierarchical user interfaces defined using a data definition language
US20040160419A1 (en) 2003-02-11 2004-08-19 Terradigital Systems Llc. Method for entering alphanumeric characters into a graphical user interface
US20040210847A1 (en) 2003-04-17 2004-10-21 Supersonic Aerospace International, Llc System and method for customizing multiple windows of information on a display
US20040221168A1 (en) 2000-12-28 2004-11-04 Girard Luke E. System and method for protected messaging
US20040225965A1 (en) 2003-05-06 2004-11-11 Microsoft Corporation Insertion location tracking for controlling a user interface
US20040224638A1 (en) 2003-04-25 2004-11-11 Apple Computer, Inc. Media player system
US20040222992A1 (en) 2003-05-09 2004-11-11 Microsoft Corporation System supporting animation of graphical display elements through animation object instances
US6839721B2 (en) 2001-01-12 2005-01-04 Hewlett-Packard Development Company, L.P. Integration of a database into file management software for protecting, tracking, and retrieving data
US20050005241A1 (en) 2003-05-08 2005-01-06 Hunleth Frank A. Methods and systems for generating a zoomable graphical user interface
US20050008343A1 (en) 2003-04-30 2005-01-13 Frohlich David Mark Producing video and audio-photos from a static digital image
US20050017957A1 (en) 2003-07-25 2005-01-27 Samsung Electronics Co., Ltd. Touch screen system and control method therefor capable of setting active regions
US20050027666A1 (en) 2003-07-15 2005-02-03 Vente, Inc Interactive online research system and method
US20050024341A1 (en) 2001-05-16 2005-02-03 Synaptics, Inc. Touch screen with user interface enhancement
JP2005056286A (en) 2003-08-07 2005-03-03 Nec Engineering Ltd Display enlarging method and display enlarging program in web browser
US20050057524A1 (en) 2003-09-16 2005-03-17 Hill Douglas B. Gesture recognition method and touch system incorporating the same
JP2005082086A (en) 2003-09-10 2005-03-31 Fujitsu Ten Ltd Input device in information terminal
US20050088443A1 (en) 2003-10-24 2005-04-28 Leonardo Blanco Communication protocol for synchronizing animation systems
US6903927B2 (en) 2002-12-17 2005-06-07 Nokia Corporation Convertible mobile computing device
US20050162402A1 (en) 2004-01-27 2005-07-28 Watanachote Susornpol J. Methods of interacting with a computer using a finger(s) touch sensing input device with visual feedback
US20050183035A1 (en) 2003-11-20 2005-08-18 Ringel Meredith J. Conflict resolution for graphic multi-user interface
US20050193015A1 (en) 2004-02-19 2005-09-01 Sandraic Logic, Llc A California Limited Liability Company Method and apparatus for organizing, sorting and navigating multimedia content
JP2005242669A (en) 2004-02-26 2005-09-08 Seiko Epson Corp Display processing device, display method, and display program for structured document
US20050210419A1 (en) * 2004-02-06 2005-09-22 Nokia Corporation Gesture control system
US6958749B1 (en) 1999-11-04 2005-10-25 Sony Corporation Apparatus and method for manipulating a touch-sensitive display panel
US6963937B1 (en) 1998-12-17 2005-11-08 International Business Machines Corporation Method and apparatus for providing configurability and customization of adaptive user-input filtration
JP2005322088A (en) 2004-05-10 2005-11-17 Namco Ltd Program, information storage medium and electronic equipment
US20050268247A1 (en) 2004-05-27 2005-12-01 Baneth Robin C System and method for controlling a user interface
US6985178B1 (en) 1998-09-30 2006-01-10 Canon Kabushiki Kaisha Camera control system, image pick-up server, client, control method and storage medium therefor
US6985137B2 (en) 2001-08-13 2006-01-10 Nokia Mobile Phones Ltd. Method for preventing unintended touch pad input due to accidental touching
US20060010400A1 (en) 2004-06-28 2006-01-12 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
US20060026536A1 (en) * 2004-07-30 2006-02-02 Apple Computer, Inc. Gestures for touch sensitive input devices
US20060026676A1 (en) 2004-07-30 2006-02-02 Nokia Corporation Method for the monitoring of system security in electronic devices
US20060028455A1 (en) 2001-08-29 2006-02-09 Microsoft Corp. Touch-sensitive device for scrolling a document on a display
US20060031786A1 (en) * 2004-08-06 2006-02-09 Hillis W D Method and apparatus continuing action of user gestures performed upon a touch sensitive interactive display in simulation of inertia
US20060036955A1 (en) 2004-08-12 2006-02-16 Microsoft Corporation System and method of displaying content on small screen computing devices
WO2006020305A2 (en) 2004-07-30 2006-02-23 Apple Computer, Inc. Gestures for touch sensitive input devices
US20060038796A1 (en) 2001-08-29 2006-02-23 Microsoft Corporation Enhanced scrolling
WO2006020304A2 (en) 2004-07-30 2006-02-23 Apple Computer, Inc. Mode-based graphical user interfaces for touch sensitive input devices
US7009626B2 (en) 2000-04-14 2006-03-07 Picsel Technologies Limited Systems and methods for generating visual representations of graphical data and digital document processing
US7013435B2 (en) 2000-03-17 2006-03-14 Vizible.Com Inc. Three dimensional spatial user interface
US20060066588A1 (en) 2004-09-24 2006-03-30 Apple Computer, Inc. System and method for processing raw data of track pad device
US7023427B2 (en) 2002-06-28 2006-04-04 Microsoft Corporation Method and system for detecting multiple touches on a touch-sensitive screen
US7030863B2 (en) 2000-05-26 2006-04-18 America Online, Incorporated Virtual keyboard system with automatic correction
JP2006102275A (en) 2004-10-06 2006-04-20 Namco Ltd Game system, program and information storage medium
US20060097991A1 (en) 2004-05-06 2006-05-11 Apple Computer, Inc. Multipoint touchscreen
US20060112335A1 (en) 2004-11-18 2006-05-25 Microsoft Corporation Method and system for providing multiple input connecting user interface
US20060123353A1 (en) 2004-12-08 2006-06-08 Microsoft Corporation Method and system of taskbar button interfaces
US20060125803A1 (en) 2001-02-10 2006-06-15 Wayne Westerman System and method for packing multitouch gestures onto a hand
US20060125799A1 (en) * 2004-08-06 2006-06-15 Hillis W D Touch driven method and apparatus to integrate and display multiple image layers forming alternate depictions of same subject matter
US20060136833A1 (en) 2004-12-15 2006-06-22 International Business Machines Corporation Apparatus and method for chaining objects in a pointer drag path
WO2006067711A2 (en) 2004-12-21 2006-06-29 Koninklijke Philips Electronics N.V. Method and device for displaying animated buttons
US20060161871A1 (en) * 2004-07-30 2006-07-20 Apple Computer, Inc. Proximity detector in handheld device
US7084859B1 (en) 1992-09-18 2006-08-01 Pryor Timothy R Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US7088374B2 (en) 2003-03-27 2006-08-08 Microsoft Corporation System and method for managing visual structure, timing, and animation in a graphics processing system
US20060190833A1 (en) 2005-02-18 2006-08-24 Microsoft Corporation Single-handed approach for navigation of application tiles using panning and zooming
US20060197753A1 (en) 2005-03-04 2006-09-07 Hotelling Steven P Multi-functional hand-held device
WO2006094308A2 (en) 2005-03-04 2006-09-08 Apple Computer, Inc. Multi-functional hand-held device
US7117453B2 (en) 2003-01-21 2006-10-03 Microsoft Corporation Media frame object visualization system
CN1841284A (en) 2005-03-28 2006-10-04 上海桐港信息科技有限公司 Touch screen type mobile apparatus micro-browser webpage displaying and drifting method
US20060236263A1 (en) 2005-04-15 2006-10-19 Microsoft Corporation Tactile device for scrolling
US20060242602A1 (en) 2005-04-22 2006-10-26 Microsoft Corporation Interface and system for manipulating thumbnails of live windows in a window manager
US20060242607A1 (en) 2003-06-13 2006-10-26 University Of Lancaster User interface
US20060247915A1 (en) 1998-12-04 2006-11-02 Tegic Communications, Inc. Contextual Prediction of User Words and User Actions
WO2006128248A1 (en) 2005-06-02 2006-12-07 National Ict Australia Limited Multimodal computer navigation
US20060279548A1 (en) 2005-06-08 2006-12-14 Geaghan Bernard O Touch location determination involving multiple touch location processes
US7152210B1 (en) 1999-10-20 2006-12-19 Koninklijke Philips Electronics N.V. Device and method of browsing an image collection
US20060284792A1 (en) 2000-01-28 2006-12-21 Intersense, Inc., A Delaware Corporation Self-referenced tracking
US20070050469A1 (en) 2005-08-30 2007-03-01 Microsoft Corporation Commanding
US20070046643A1 (en) 2004-08-06 2007-03-01 Hillis W Daniel State-Based Approach to Gesture Identification
US20070055967A1 (en) 1997-05-08 2007-03-08 Poff Thomas C Offload system, method, and computer program product for port-related processing
US20070061126A1 (en) 2005-09-01 2007-03-15 Anthony Russo System for and method of emulating electronic input devices
US20070064004A1 (en) * 2005-09-21 2007-03-22 Hewlett-Packard Development Company, L.P. Moving a graphic element
WO2007037806A1 (en) 2005-09-15 2007-04-05 Apple Inc. System and method for processing raw data of track pad device
US20070075965A1 (en) 2005-09-30 2007-04-05 Brian Huppi Automated response to and sensing of user activity in portable devices
US20070132789A1 (en) 2005-12-08 2007-06-14 Bas Ording List scrolling in response to moving contact over list of index symbols
US7237199B1 (en) 1997-12-01 2007-06-26 Cedara Software Corp. Architecture for an application framework
US20070152976A1 (en) 2005-12-30 2007-07-05 Microsoft Corporation Unintentional touch rejection
US20070152984A1 (en) 2005-12-30 2007-07-05 Bas Ording Portable electronic device with multi-touch input
US20070174257A1 (en) 2006-01-18 2007-07-26 Bruce Thomas Howard Systems and methods for providing sorted search results
US20070176903A1 (en) 2006-01-31 2007-08-02 Dahlin Jeffrey J Capacitive touch sensor button activation
US20070177804A1 (en) * 2006-01-30 2007-08-02 Apple Computer, Inc. Multi-touch gesture dictionary
US20070185876A1 (en) 2005-02-07 2007-08-09 Mendis Venura C Data handling system
US20070198926A1 (en) 2004-02-23 2007-08-23 Jazzmutant Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen
US20070214462A1 (en) 2006-03-08 2007-09-13 Navisense. Llc Application programming interface (api)for sensory events
US20070236472A1 (en) * 2006-04-10 2007-10-11 Microsoft Corporation Universal user interface device
US20070242056A1 (en) 2006-04-12 2007-10-18 N-Trig Ltd. Gesture recognition feedback for a dual mode digitizer
US20070247435A1 (en) 2006-04-19 2007-10-25 Microsoft Corporation Precise selection techniques for multi-touch screens
US20070247442A1 (en) 2004-07-30 2007-10-25 Andre Bartley K Activating virtual keys of a touch-screen virtual keyboard
US20070252821A1 (en) 2004-06-17 2007-11-01 Koninklijke Philips Electronics, N.V. Use of a Two Finger Input on Touch Screens
US20070262964A1 (en) * 2006-05-12 2007-11-15 Microsoft Corporation Multi-touch uses, gestures, and implementation
US20070277124A1 (en) 2006-05-24 2007-11-29 Sang Hyun Shin Touch screen device and operating method thereof
US20070288856A1 (en) 2004-02-19 2007-12-13 Butlin Stefan G Layered User Interface
US20070291009A1 (en) 2006-06-19 2007-12-20 Cypress Semiconductor Corporation Apparatus and method for detecting a touch-sensor pad gesture
US20080005703A1 (en) 2006-06-28 2008-01-03 Nokia Corporation Apparatus, Methods and computer program products providing finger-based and hand-based gesture commands for portable electronic device applications
US20080001923A1 (en) 2006-06-28 2008-01-03 Microsoft Corporation Input Simulation System For Touch Based Devices
US20080016096A1 (en) 2001-12-21 2008-01-17 International Business Machines Corporation Dynamic status tree facility
US20080012835A1 (en) 2006-07-12 2008-01-17 N-Trig Ltd. Hover and touch detection for digitizer
US20080028327A1 (en) 2006-07-27 2008-01-31 Canon Kabushiki Kaisha Information processing apparatus and user interface control method
US20080034029A1 (en) 2006-06-15 2008-02-07 Microsoft Corporation Composition of local media playback with remotely generated user interface
US20080036743A1 (en) 1998-01-26 2008-02-14 Apple Computer, Inc. Gesturing with a multipoint sensing device
US20080043020A1 (en) 2006-08-18 2008-02-21 Microsoft Corporation User interface for viewing street side imagery
WO2008020446A1 (en) 2006-08-15 2008-02-21 N-Trig Ltd. Gesture detection for a digitizer
US7337412B2 (en) 2003-12-15 2008-02-26 International Business Machines Corporation Methods, systems and computer program products for providing multi-dimensional tree diagram graphical user interfaces
US20080048978A1 (en) 2002-04-11 2008-02-28 Synaptics Incorporated Closed-loop sensor on a solid-state object position detector
WO2008030879A2 (en) 2006-09-06 2008-03-13 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
WO2008030779A2 (en) 2006-09-06 2008-03-13 Apple Inc. Portable electronic device for photo management
WO2008030880A1 (en) 2006-09-06 2008-03-13 Apple Inc. Methods for determining a cursor position from a finger contact with a touch screen display
US7346850B2 (en) 1998-06-12 2008-03-18 Cygnus Systems, Inc. System and method for iconic software environment management
US20080072143A1 (en) 2005-05-18 2008-03-20 Ramin Assadollahi Method and device incorporating improved text input mechanism
US20080114614A1 (en) 2006-11-15 2008-05-15 General Electric Company Methods and systems for healthcare application interaction using gesture-based interaction enhanced with pressure sensitivity
US20080120576A1 (en) 2006-11-22 2008-05-22 General Electric Company Methods and systems for creation of hanging protocols using graffiti-enabled devices
JP2008146165A (en) 2006-12-06 2008-06-26 Sony Corp Display device, control method for display device, and program
US20080162751A1 (en) 2007-01-03 2008-07-03 Apple Inc. Multi buffer asynchronous scheme for processing incoming information
US20080158191A1 (en) 2006-12-29 2008-07-03 Inventec Appliances Corp. Method for zooming image
US20080168395A1 (en) 2007-01-07 2008-07-10 Bas Ording Positioning a Slider Icon on a Portable Multifunction Device
US20080168405A1 (en) 2007-01-07 2008-07-10 Francisco Ryan Tolmasky Portable Multifunction Device, Method, and Graphical User Interface for Translating Displayed Content
US20080165140A1 (en) * 2007-01-05 2008-07-10 Apple Inc. Detecting gestures on multi-event sensitive devices
US20080165141A1 (en) * 2007-01-05 2008-07-10 Apple Inc. Gestures for controlling, manipulating, and editing of media files using touch sensitive devices
US20080168402A1 (en) 2007-01-07 2008-07-10 Christopher Blumenberg Application Programming Interfaces for Gesture Operations
US20080165160A1 (en) 2007-01-07 2008-07-10 Kenneth Kocienda Portable Multifunction Device, Method, and Graphical User Interface for Interpreting a Finger Gesture on a Touch Screen Display
US20080165136A1 (en) 2007-01-07 2008-07-10 Greg Christie System and Method for Managing Lists
US20080165132A1 (en) 2007-01-05 2008-07-10 Microsoft Corporation Recognizing multiple input point gestures
US20080172633A1 (en) 2006-04-19 2008-07-17 Lg Electronics Inc. Touch screen device and method of displaying and selecting menus thereof
WO2008085846A2 (en) 2007-01-07 2008-07-17 Apple Inc. Application programming interfaces for synchronization
WO2008085877A1 (en) 2007-01-07 2008-07-17 Apple Inc. Animations
WO2008085855A1 (en) 2007-01-07 2008-07-17 Apple Inc. Application programming interfaces for scrolling
WO2008085871A1 (en) 2007-01-07 2008-07-17 Apple Inc. Application programming interfaces for scrolling operations
US20080195388A1 (en) 2007-02-08 2008-08-14 Microsoft Corporation Context based word prediction
US20080207130A1 (en) 2007-02-28 2008-08-28 Brother Kogyo Kabushiki Kaisha Communication Apparatus And Communication System
US7420543B2 (en) 2002-01-03 2008-09-02 Mahesh Jayachandra User-friendly Brahmi-derived Hindi keyboard
US20080218489A1 (en) 2007-03-07 2008-09-11 Jong-Woung Park Display device and method of driving the same
WO2008148021A2 (en) 2007-05-25 2008-12-04 Microsoft Corporation Selective enabling of multi-input controls
JP2008312153A (en) 2007-06-18 2008-12-25 Pioneer Electronic Corp Operation control system for av equipment
US7487447B1 (en) 2005-05-25 2009-02-03 Google Inc. Web page zoom feature
WO2009018314A2 (en) 2007-07-30 2009-02-05 Perceptive Pixel, Inc. Graphical user interface for large-scale, multi-user, multi-touch systems
US20090051671A1 (en) 2007-08-22 2009-02-26 Jason Antony Konstas Recognizing the motion of two or more touches on a touch-sensing surface
US7499027B2 (en) 2005-04-29 2009-03-03 Microsoft Corporation Using a light pointer for input on an interactive display surface
US20090063135A1 (en) 2007-08-31 2009-03-05 Vadim Fux Handheld Electronic Device and Method Employing Logical Proximity of Characters in Spell Checking
US20090058830A1 (en) 2007-01-07 2009-03-05 Scott Herz Portable multifunction device, method, and graphical user interface for interpreting a finger gesture
US7561159B2 (en) 2005-05-31 2009-07-14 Magnifi Group Inc. Control of animation timeline
US7576732B2 (en) 2005-06-23 2009-08-18 Elan Microelectronics Corporation Scroll control method using a touchpad
US20090207140A1 (en) 2008-02-19 2009-08-20 Sony Ericsson Mobile Communications Ab Identifying and responding to multiple time-overlapping touches on a touch panel
US20090211891A1 (en) 2008-02-21 2009-08-27 Wintek Corporation Touch panel and driving method of touch panel
US20090228901A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model
US20090228828A1 (en) 2008-03-06 2009-09-10 Microsoft Corporation Adjustment of range of content displayed on graphical user interface
US20090225038A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event processing for web pages
US20090225039A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model programming interface
US20090225037A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model for web pages
US20090231281A1 (en) 2008-03-11 2009-09-17 Microsoft Corporation Multi-touch virtual keyboard
US20090251434A1 (en) 2008-04-03 2009-10-08 N-Tring Ltd. Multi-touch and single touch detection
US20090259969A1 (en) 2003-07-14 2009-10-15 Matt Pallakoff Multimedia client interface devices and methods
US20090262087A1 (en) 2008-04-22 2009-10-22 Lg Electronics Inc. Terminal and method for recognizing image therein
US7614008B2 (en) 2004-07-30 2009-11-03 Apple Inc. Operation of a computer with touch screen interface
US20090273571A1 (en) 2008-05-01 2009-11-05 Alan Bowens Gesture Recognition
US20090282332A1 (en) 2008-05-12 2009-11-12 Nokia Corporation Apparatus, method and computer program product for selecting multiple items using multi-touch
US20090284479A1 (en) 2008-05-16 2009-11-19 Microsoft Corporation Multi-Touch Input Platform
US20090309847A1 (en) 2008-06-12 2009-12-17 You I Labs, Inc. Apparatus and method for providing multi-touch interface capability
US20090322687A1 (en) 2008-06-27 2009-12-31 Microsoft Corporation Virtual touchpad
US20090322699A1 (en) 2008-06-25 2009-12-31 Sony Ericsson Mobile Communications Ab Multiple input detection for resistive touch panel
US20090322700A1 (en) 2008-06-30 2009-12-31 Tyco Electronics Corporation Method and apparatus for detecting two simultaneous touches and gestures on a resistive touchscreen
EP2141576A2 (en) 2008-07-01 2010-01-06 Sony Corporation Information processing apparatus and method for displaying auxiliary information
US20100013676A1 (en) 2008-07-15 2010-01-21 International Business Machines Corporation Presence recognition control of electronic devices using a multi-touch device
US20100020025A1 (en) 2008-07-25 2010-01-28 Intuilab Continuous recognition of multi-touch gestures
US20100020221A1 (en) 2008-07-24 2010-01-28 David John Tupman Camera Interface in a Portable Handheld Electronic Device
US20100030612A1 (en) 2008-08-01 2010-02-04 Lg Electronics Inc. Mobile terminal capable of managing schedule and method of controlling the mobile terminal
US20100046850A1 (en) 2008-08-19 2010-02-25 Chen-Hsiang Ho Multipoint Tracking Method and Related Device
US20100085323A1 (en) 2009-12-04 2010-04-08 Adam Bogue Segmenting a Multi-Touch Input Region by User
US20100107116A1 (en) 2008-10-27 2010-04-29 Nokia Corporation Input on touch user interfaces
EP2184673A1 (en) 2008-10-30 2010-05-12 Sony Corporation Information processing apparatus, information processing method and program
US20100146458A1 (en) 2008-12-04 2010-06-10 Nvidia Corporation Operating System Providing Multi-Touch Support For Applications In A Mobile Device
US20100149122A1 (en) 2008-12-12 2010-06-17 Asustek Computer Inc. Touch Panel with Multi-Touch Function and Method for Detecting Multi-Touch Thereof
US20100156804A1 (en) 2008-12-19 2010-06-24 Cypress Semiconductor Corporation Multi-finger sub-gesture reporting for a user interface device
US7750893B2 (en) 2005-04-06 2010-07-06 Nintendo Co., Ltd. Storage medium storing input position processing program, and input position processing device
US20100177053A2 (en) 2008-05-09 2010-07-15 Taizo Yasutake Method and apparatus for control of multiple degrees of freedom of a display
US20100182248A1 (en) 2009-01-19 2010-07-22 Chun Jin-Woo Terminal and control method thereof
US20100235118A1 (en) 2009-03-16 2010-09-16 Bradford Allen Moore Event Recognition
US20100245267A1 (en) 2009-03-31 2010-09-30 Lg Electronics Inc. Mobile terminal and method of controlling the same
US20100267449A1 (en) 2007-11-09 2010-10-21 Wms Gaming, Inc. Interface for wagering game environments
US20100281435A1 (en) 2009-04-30 2010-11-04 At&T Intellectual Property I, L.P. System and method for multimodal interaction using robust gesture processing
US20100283739A1 (en) 2009-05-05 2010-11-11 Microsoft Corporation Contact grouping and gesture recognition for surface computing
US20100299594A1 (en) 2009-05-21 2010-11-25 Sony Computer Entertainment America Inc. Touch control with dynamically determined buffer region and active perimeter
US7864037B2 (en) 2008-06-16 2011-01-04 International Business Machines Corporation Pattern-driven communication architecture
US20110037714A1 (en) 2009-08-11 2011-02-17 Lg Electronics Inc. Method for displaying data and mobile terminal thereof
US20110047459A1 (en) 2007-10-08 2011-02-24 Willem Morkel Van Der Westhuizen User interface
US20110069021A1 (en) 2009-06-12 2011-03-24 Hill Jared C Reducing false touchpad data by ignoring input when area gesture does not behave as predicted
US7917584B2 (en) 2007-10-22 2011-03-29 Xcerion Aktiebolag Gesture-based collaboration
US20110090257A1 (en) 2009-10-20 2011-04-21 Chueh-Pin Ko Touch Display Device, Touch Display System, and Method for Adjusting Touch Area Thereof
US20110102336A1 (en) 2009-10-30 2011-05-05 Pantech Co., Ltd. User interface apparatus and method
US7941760B2 (en) 2006-09-06 2011-05-10 Apple Inc. Soft keyboard display for a portable multifunction device
US20110115745A1 (en) 2009-11-13 2011-05-19 Microsoft Corporation Interactive display system with contact geometry interface
US20110167391A1 (en) 2010-01-06 2011-07-07 Brian Momeyer User interface methods and systems for providing force-sensitive input
US20110179386A1 (en) 2009-03-16 2011-07-21 Shaffer Joshua L Event Recognition
US20110179380A1 (en) 2009-03-16 2011-07-21 Shaffer Joshua L Event Recognition
US20110179387A1 (en) 2009-03-16 2011-07-21 Shaffer Joshua L Event Recognition
US20110181526A1 (en) 2010-01-26 2011-07-28 Shaffer Joshua H Gesture Recognizers with Delegates for Controlling and Modifying Gesture Recognition
US20110252368A1 (en) 2010-04-07 2011-10-13 Freddy Allen Anzures Device, Method, and Graphical User Interface for Navigation of Multiple Applications
US8051406B2 (en) 2004-04-30 2011-11-01 Microsoft Corporation Rich end-user data views
EP2390766A1 (en) 2010-05-28 2011-11-30 Research In Motion Limited Electronic device including touch-sensitive display and method of controlling same
US20110295596A1 (en) 2010-05-31 2011-12-01 Hon Hai Precision Industry Co., Ltd. Digital voice recording device with marking function and method thereof
US20110291951A1 (en) 2010-05-28 2011-12-01 Research In Motion Limited Electronic device including touch-sensitive display and method of controlling same
US20110321125A1 (en) 2009-02-10 2011-12-29 Satoshi Kyohgoku Authentication device, authentication method and program for causing computer to execute the same
JP2012014299A (en) 2010-06-29 2012-01-19 Brother Ind Ltd Image processing apparatus
US8115744B2 (en) 2008-08-27 2012-02-14 Byd Company, Ltd. Multi-point touch-sensitive system
US8140570B2 (en) 2010-03-11 2012-03-20 Apple Inc. Automatic discovery of metadata
US8171432B2 (en) 2008-01-06 2012-05-01 Apple Inc. Touch screen device, method, and graphical user interface for displaying and selecting application options
US8214768B2 (en) 2007-01-05 2012-07-03 Apple Inc. Method, system, and graphical user interface for viewing multiple application windows
US8253695B2 (en) 2006-09-06 2012-08-28 Apple Inc. Email client for a portable multifunction device
US8291344B2 (en) 2010-04-07 2012-10-16 Apple Inc. Device, method, and graphical user interface for managing concurrently open software applications
US8296332B2 (en) 2010-04-01 2012-10-23 Apple Inc. Visual manipulation of database schema
US20120278725A1 (en) 2011-04-29 2012-11-01 Frequency Networks, Inc. Multiple-carousel selective digital service feeds
US8310459B2 (en) 2009-09-23 2012-11-13 Nokia Corporation Touch detection
US20130009986A1 (en) 2010-05-27 2013-01-10 Adobe Systems Incorporated Event Handling In An Integrated Execution Environment
US20160018981A1 (en) 2014-07-17 2016-01-21 Facebook, Inc. Touch-Based Gesture Recognition and Application Navigation

Family Cites Families (299)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1517521A (en) 1975-09-01 1978-07-12 Tilgate Pallets Ltd Pallets
US4914624A (en) 1988-05-06 1990-04-03 Dunthorn David I Virtual button for touch screen
JPH02140822A (en) 1988-11-22 1990-05-30 Nec Corp Multi-window display system
JPH02140822U (en) 1989-04-26 1990-11-26
JP2862626B2 (en) 1990-03-22 1999-03-03 株式会社東芝 Electronic dictionary and information retrieval method
US5046434A (en) 1990-05-02 1991-09-10 Penda Corporation Plastic reinforced thermoformed pallet
JP3145735B2 (en) 1991-07-17 2001-03-12 富士通株式会社 Input control method
JP2827612B2 (en) 1991-10-07 1998-11-25 富士通株式会社 A touch panel device and a method for displaying an object on the touch panel device.
US5233547A (en) 1991-11-12 1993-08-03 Ncr Corporation Electronic checking account apparatus and method having a digitizer to receive information as a check is being written
JPH0816314B2 (en) 1992-09-12 1996-02-21 グンゼ株式会社 Continuous dyeing method for tubular knitted fabrics
US5583543A (en) 1992-11-05 1996-12-10 Sharp Kabushiki Kaisha Pen input processing apparatus
JP2999335B2 (en) 1992-11-05 2000-01-17 シャープ株式会社 Gesture processing device and gesture processing method
US5612719A (en) 1992-12-03 1997-03-18 Apple Computer, Inc. Gesture sensitive buttons for graphical user interfaces
US5463725A (en) 1992-12-31 1995-10-31 International Business Machines Corp. Data processing system graphical user interface which emulates printed material
JP3147572B2 (en) 1993-03-22 2001-03-19 株式会社日立製作所 Program generation method
DE69432199T2 (en) 1993-05-24 2004-01-08 Sun Microsystems, Inc., Mountain View Graphical user interface with methods for interfacing with remote control devices
US5581670A (en) 1993-07-21 1996-12-03 Xerox Corporation User interface having movable sheet with click-through tools
CA2124505C (en) 1993-07-21 2000-01-04 William A. S. Buxton User interface having simultaneously movable tools and cursor
US5564112A (en) 1993-10-14 1996-10-08 Xerox Corporation System and method for generating place holders to temporarily suspend execution of a selected command
US5454960A (en) 1993-11-10 1995-10-03 Advanced Building Technologies, Inc. Oil change and recycling system
JP2939119B2 (en) 1994-05-16 1999-08-25 シャープ株式会社 Handwritten character input display device and method
US5570113A (en) 1994-06-29 1996-10-29 International Business Machines Corporation Computer based pen system and method for automatically cancelling unwanted gestures and preventing anomalous signals as inputs to such system
US5510061A (en) 1994-07-26 1996-04-23 Norton Chemical Process Products Corp. Non-welded support plate member
EP0701220B1 (en) 1994-09-12 2001-07-04 Adobe Systems Inc. Method and apparatus for viewing electronic documents
ES2115166T3 (en) 1994-11-15 1998-06-16 Uop Inc IMPROVED ADSORPTION SEPARATION OF META-XYLENE FROM AROMATIC HYDROCARBONS.
US5495566A (en) 1994-11-22 1996-02-27 Microsoft Corporation Scrolling contents of a window
JP2944439B2 (en) 1994-12-27 1999-09-06 シャープ株式会社 Handwritten character input device and method
JPH08307954A (en) 1995-05-12 1996-11-22 Sony Corp Device and method for coordinate input and information processor
US6496182B1 (en) 1995-06-07 2002-12-17 Microsoft Corporation Method and system for providing touch-sensitive screens for the visually impaired
JPH0944285A (en) 1995-07-28 1997-02-14 Hitachi Ltd Information processor
JPH0969037A (en) 1995-08-31 1997-03-11 Sharp Corp Data processor
US5655094A (en) 1995-09-29 1997-08-05 International Business Machines Corporation Pop up scroll bar
JP3636792B2 (en) 1995-10-18 2005-04-06 株式会社リコー Nib coordinate input device
JP3845890B2 (en) 1996-02-23 2006-11-15 カシオ計算機株式会社 Electronics
US5676064A (en) 1996-04-22 1997-10-14 Shuert; Lyle H. Pallet and pallet package
JP3839877B2 (en) 1996-07-05 2006-11-01 キヤノン株式会社 Handwritten pattern processing apparatus and handwritten pattern processing method
US6141018A (en) 1997-03-12 2000-10-31 Microsoft Corporation Method and system for displaying hypertext documents with visual effects
KR100368353B1 (en) 1997-03-13 2003-01-24 인터내셔널 비지네스 머신즈 코포레이션 Kiosk and server connected to computer network
US5999176A (en) 1997-04-04 1999-12-07 International Business Machines Corporation Method to provide a single scrolling control for a multi-window interface
US6049326A (en) 1997-05-12 2000-04-11 Siemens Information And Communication Networks, Inc. System and method for dual browser modes
FI115689B (en) 1997-05-21 2005-06-15 Nokia Corp Procedure and arrangement for scrolling information presented on mobile display
US6034688A (en) 1997-09-15 2000-03-07 Sony Corporation Scrolling navigational display system
JP4074431B2 (en) 1997-12-16 2008-04-09 マイクロソフト コーポレーション Soft input panel system and method
US7840912B2 (en) 2006-01-30 2010-11-23 Apple Inc. Multi-touch gesture dictionary
US7834855B2 (en) 2004-08-25 2010-11-16 Apple Inc. Wide touchpad on a portable computer
US20040080541A1 (en) 1998-03-20 2004-04-29 Hisashi Saiga Data displaying device
US6005575A (en) * 1998-03-23 1999-12-21 Microsoft Corporation Foreground window determination through process and thread initialization
US6429846B2 (en) 1998-06-23 2002-08-06 Immersion Corporation Haptic feedback for touchpads and other touch controls
US6061063A (en) 1998-06-30 2000-05-09 Sun Microsystems, Inc. Method and apparatus for providing feedback while scrolling
CA2244431C (en) 1998-07-30 2002-02-19 Ibm Canada Limited-Ibm Canada Limitee Touchscreen keyboard support for multi-byte character languages
US7036094B1 (en) 1998-08-10 2006-04-25 Cybernet Systems Corporation Behavior recognition system
US6068124A (en) 1998-08-27 2000-05-30 Nanya Plastics Plastic pallet and separator for packaging yarn spools
US6628835B1 (en) 1998-08-31 2003-09-30 Texas Instruments Incorporated Method and system for defining and recognizing complex events in a video sequence
US20020018051A1 (en) * 1998-09-15 2002-02-14 Mona Singh Apparatus and method for moving objects on a touchscreen display
JP4159674B2 (en) 1998-10-22 2008-10-01 富士通株式会社 Object-oriented business system and method
JP4542637B2 (en) 1998-11-25 2010-09-15 セイコーエプソン株式会社 Portable information device and information storage medium
JP2000163443A (en) 1998-11-25 2000-06-16 Seiko Epson Corp Portable information device and information storage medium
US6643824B1 (en) 1999-01-15 2003-11-04 International Business Machines Corporation Touch screen region assist for hypertext links
US7469381B2 (en) 2007-01-07 2008-12-23 Apple Inc. List scrolling and document translation, scaling, and rotation on a touch-screen display
US20060061551A1 (en) 1999-02-12 2006-03-23 Vega Vista, Inc. Motion detection and tracking system to control navigation and display of portable displays including on-chip gesture detection
AU765579B2 (en) 1999-04-21 2003-09-25 Barrie Weatherall Stabiliser for ladders
JP4939682B2 (en) 1999-04-27 2012-05-30 エーユー オプトロニクス コーポレイション Display device
US7164413B2 (en) * 1999-05-19 2007-01-16 Digimarc Corporation Enhanced input peripheral
AUPQ439299A0 (en) 1999-12-01 1999-12-23 Silverbrook Research Pty Ltd Interface system
US7286115B2 (en) 2000-05-26 2007-10-23 Tegic Communications, Inc. Directional input system with automatic correction
US6335725B1 (en) 1999-07-14 2002-01-01 Hewlett-Packard Company Method of partitioning a touch screen for data input
JP2001027924A (en) 1999-07-14 2001-01-30 Sharp Corp Input device using display screen
US6448986B1 (en) 1999-09-07 2002-09-10 Spotware Technologies Llc Method and system for displaying graphical objects on a display screen
JP2001167227A (en) 1999-12-07 2001-06-22 Hitachi Ltd Information terminal equipment
US6664991B1 (en) 2000-01-06 2003-12-16 Microsoft Corporation Method and apparatus for providing context menus on a pen-based device
US6809724B1 (en) 2000-01-18 2004-10-26 Seiko Epson Corporation Display apparatus and portable information processing apparatus
US6820237B1 (en) 2000-01-21 2004-11-16 Amikanow! Corporation Apparatus and method for context-based highlighting of an electronic document
US6856326B1 (en) 2000-01-28 2005-02-15 International Business Machines Corporation Smooth scrolling system and method
US7138983B2 (en) 2000-01-31 2006-11-21 Canon Kabushiki Kaisha Method and apparatus for detecting and interpreting path of designated position
US6922810B1 (en) 2000-03-07 2005-07-26 Microsoft Corporation Grammar-based automatic data completion and suggestion for user input
EP1273154A2 (en) * 2000-03-30 2003-01-08 QUALCOMM Incorporated Method and apparatus for notifying a mobile station application of specified events
JP4124402B2 (en) 2000-03-31 2008-07-23 株式会社リコー Image input device
WO2001077792A2 (en) 2000-04-07 2001-10-18 Rsa Security Inc. System and method for authenticating a user
AU2001259091A1 (en) 2000-04-19 2001-11-07 Analogic Corporation Backlash-resistant drive assembly for collimator in a ct scanner
JP2001299733A (en) 2000-04-27 2001-10-30 Konica Corp Pci radiation beam image processing apparatus, pci radiation beam image detecting and processing apparatus, pci radiation beam image outputting apparatus and pci radiation beam image diagnosis supporting apparatus
US6559869B1 (en) 2000-05-04 2003-05-06 Microsoft Corporation Adaptive auto-scrolling merge for hand written input
EP1285330B1 (en) 2000-05-11 2006-08-30 Nes Stewart Irvine Zeroclick
US6912694B1 (en) 2000-06-28 2005-06-28 Intel Corporation Providing a scrolling function for a multiple frame web page
JP2002041242A (en) 2000-07-27 2002-02-08 Nec Corp Input device with drawing fade-out function and method
US6714221B1 (en) 2000-08-03 2004-03-30 Apple Computer, Inc. Depicting and setting scroll amount
US20020015064A1 (en) 2000-08-07 2002-02-07 Robotham John S. Gesture-based user interface to multi-level and multi-modal sets of bit-maps
JP2002062983A (en) 2000-08-21 2002-02-28 Hitachi Ltd Pointing device
US6791530B2 (en) 2000-08-29 2004-09-14 Mitsubishi Electric Research Laboratories, Inc. Circular graphical user interfaces
EP1184414A3 (en) 2000-08-30 2003-08-06 JSR Corporation Conjugated diene-based rubber and method of producing the same, oil extended rubber and rubber composition containing the same
US6912462B2 (en) 2000-08-31 2005-06-28 Sony Corporation Information processing apparatus, information processing method and program storage media
US20020138617A1 (en) 2000-09-06 2002-09-26 Jacob Christfort Providing content from multiple services
US6757673B2 (en) 2000-10-09 2004-06-29 Town Compass Llc Displaying hierarchial relationship of data accessed via subject index
US7761541B1 (en) 2000-10-25 2010-07-20 Nortel Networks Limited Service enabling technology
US7072501B2 (en) 2000-11-22 2006-07-04 R2 Technology, Inc. Graphical user interface for display of anatomical information
US7184796B2 (en) 2000-12-04 2007-02-27 International Business Machines Corporation Personal communication device having a built in projection display
US7240291B2 (en) 2000-12-21 2007-07-03 Xerox Corporation Methods, systems, and computer program products for display of information relating to a virtual three-dimensional book
JP3881179B2 (en) 2001-02-14 2007-02-14 三菱電機株式会社 User interface design device
US6972776B2 (en) 2001-03-20 2005-12-06 Agilent Technologies, Inc. Scrolling method using screen pointing device
GB2373778B (en) 2001-03-30 2003-08-06 Robin Lewis Corner elements for packaging
EP1393189A4 (en) 2001-05-02 2007-06-13 Bitstream Inc Methods, systems, and programming for displaying media scaled-down by a variable scale factor
US20020171675A1 (en) 2001-05-15 2002-11-21 International Business Machines Corporation Method and system for graphical user interface (GUI) widget having user-selectable mass
US6498590B1 (en) 2001-05-24 2002-12-24 Mitsubishi Electric Research Laboratories, Inc. Multi-user touch surface
TW521205B (en) 2001-06-05 2003-02-21 Compal Electronics Inc Touch screen capable of controlling amplification with pressure
US6868383B1 (en) 2001-07-12 2005-03-15 At&T Corp. Systems and methods for extracting meaning from multimodal inputs using finite-state devices
US6661409B2 (en) 2001-08-22 2003-12-09 Motorola, Inc. Automatically scrolling handwritten input user interface for personal digital assistants and the like
US6907575B2 (en) 2001-09-06 2005-06-14 Danger, Inc. Method of scrolling a display window
US7254775B2 (en) 2001-10-03 2007-08-07 3M Innovative Properties Company Touch panel system and method for distinguishing multiple touch inputs
US7046230B2 (en) 2001-10-22 2006-05-16 Apple Computer, Inc. Touch pad handheld device
US7009599B2 (en) 2001-11-20 2006-03-07 Nokia Corporation Form factor for portable device
GB0201074D0 (en) 2002-01-18 2002-03-06 3G Lab Ltd Graphic user interface for data processing device
US7197143B2 (en) * 2002-01-18 2007-03-27 The Johns Hopkins University Digital video authenticator
US7075512B1 (en) 2002-02-07 2006-07-11 Palmsource, Inc. Method and system for navigating a display screen for locating a desired item of information
AU2003220400A1 (en) 2002-03-19 2003-10-08 America Online, Inc. Controlling content display
US20030184525A1 (en) 2002-03-29 2003-10-02 Mitac International Corp. Method and apparatus for image processing
US7203911B2 (en) 2002-05-13 2007-04-10 Microsoft Corporation Altering a display on a viewing device based upon a user proximity to the viewing device
US20030214553A1 (en) * 2002-05-14 2003-11-20 Microsoft Corporation Ink regions in an overlay control
US8166388B2 (en) * 2002-05-14 2012-04-24 Microsoft Corporation Overlaying electronic ink
US7158675B2 (en) 2002-05-14 2007-01-02 Microsoft Corporation Interfacing with ink
US20030214531A1 (en) 2002-05-14 2003-11-20 Microsoft Corporation Ink input mechanisms
KR100980902B1 (en) 2002-05-16 2010-09-07 소니 주식회사 Inputting method and inputting apparatus
FI20021655A (en) 2002-06-19 2003-12-20 Nokia Corp Method of deactivating locking and a portable electronic device
US7062090B2 (en) 2002-06-28 2006-06-13 Microsoft Corporation Writing guide for a free-form document editor
JP4338364B2 (en) 2002-07-02 2009-10-07 ソニー株式会社 Portable information communication terminal, program, and recording medium recording the program
EP1394692A1 (en) 2002-08-05 2004-03-03 Alcatel Method, terminal, browser application, and mark-up language for multimodal interaction between a user and a terminal
US7263721B2 (en) 2002-08-09 2007-08-28 International Business Machines Corporation Password protection
US7739604B1 (en) 2002-09-25 2010-06-15 Apple Inc. Method and apparatus for managing windows
US7002560B2 (en) 2002-10-04 2006-02-21 Human Interface Technologies Inc. Method of combining data entry of handwritten symbols with displayed character data
GB0223883D0 (en) 2002-10-15 2002-11-20 Seamless Display Ltd Visual display screen arrangement
ATE332528T1 (en) 2002-11-20 2006-07-15 Nokia Corp METHOD AND USER INTERFACE FOR CHARACTER ENTRY
CA2414047A1 (en) 2002-12-09 2004-06-09 Corel Corporation System and method of extending scalable vector graphics capabilities
US20040135817A1 (en) 2003-01-14 2004-07-15 Daughtery Joey L. Interface for selecting and performing operations on objects
US7490296B2 (en) 2003-01-31 2009-02-10 Microsoft Corporation Utility object for specialized data entry
US20040155888A1 (en) 2003-02-11 2004-08-12 Padgitt David Gary Method for displaying the contents of a collection of media objects
US7894177B2 (en) 2005-12-29 2011-02-22 Apple Inc. Light activated hold switch
US7187801B2 (en) 2003-03-31 2007-03-06 Microsoft Corporation Multiple handwriting recognition engine selection
KR100465969B1 (en) 2003-04-11 2005-01-13 (주)모비솔 Pointing device using the surface of a finger
US7098776B2 (en) * 2003-04-16 2006-08-29 Massachusetts Institute Of Technology Methods and apparatus for vibrotactile communication
US7102626B2 (en) 2003-04-25 2006-09-05 Hewlett-Packard Development Company, L.P. Multi-function pointing device
US7738916B2 (en) 2003-05-21 2010-06-15 Hitachi High-Technologies Corporation Portable terminal device with built-in fingerprint sensor
US7567239B2 (en) 2003-06-26 2009-07-28 Motorola, Inc. Method and system for message and note composition on small screen devices
EP1656660A4 (en) 2003-08-21 2006-09-13 Microsoft Corp Focus management using in-air points
US9024884B2 (en) 2003-09-02 2015-05-05 Apple Inc. Touch-sensitive electronic apparatus for media applications, and methods therefor
US20050052427A1 (en) 2003-09-10 2005-03-10 Wu Michael Chi Hung Hand gesture interaction with touch surface
JP2005092476A (en) 2003-09-17 2005-04-07 Elo Touchsystems Inc Multi-user/multi-pointing device graphical user interface system
WO2005031552A2 (en) * 2003-09-30 2005-04-07 Koninklijke Philips Electronics, N.V. Gesture to define location, size, and/or content of content window on a display
US7962862B2 (en) 2003-11-24 2011-06-14 International Business Machines Corporation Method and data processing system for providing an improved graphics design tool
US7298367B2 (en) 2003-11-25 2007-11-20 3M Innovative Properties Company Light emitting stylus and user input device using same
US7814419B2 (en) 2003-11-26 2010-10-12 Nokia Corporation Changing an orientation of a user interface via a course of motion
JP3962718B2 (en) 2003-12-01 2007-08-22 キヤノン株式会社 Information processing apparatus, control method therefor, and program
US7366995B2 (en) 2004-02-03 2008-04-29 Roland Wescott Montague Combination tool that zooms in, zooms out, pans, rotates, draws, or manipulates during a drag
US7319457B2 (en) 2004-02-12 2008-01-15 Sentelic Corporation Method of scrolling window screen by means of controlling electronic device
US7358965B2 (en) 2004-02-18 2008-04-15 Microsoft Corporation Tapping to create writing
US7406696B2 (en) 2004-02-24 2008-07-29 Dialogic Corporation System and method for providing user input information to multiple independent, concurrent applications
US7327349B2 (en) 2004-03-02 2008-02-05 Microsoft Corporation Advanced navigation techniques for portable devices
US20050210369A1 (en) 2004-03-18 2005-09-22 Damm John A Jr Methods of updating spreadsheets
US7301529B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Context dependent gesture response
JP2005275652A (en) 2004-03-24 2005-10-06 Canon Inc Apparatus and method for processing input trajectory
CN100407223C (en) 2004-04-02 2008-07-30 诺基亚公司 Apparatus and method for handwriting recognition
US7623119B2 (en) 2004-04-21 2009-11-24 Nokia Corporation Graphical functions by gestures
JP4855654B2 (en) * 2004-05-31 2012-01-18 ソニー株式会社 On-vehicle device, on-vehicle device information providing method, on-vehicle device information providing method program, and on-vehicle device information providing method program
US7358962B2 (en) 2004-06-15 2008-04-15 Microsoft Corporation Manipulating association of data with a physical object
US7773950B2 (en) 2004-06-16 2010-08-10 Telefonaktiebolaget Lm Ericsson (Publ) Benign interference suppression for received signal quality estimation
GB2431500B (en) * 2004-06-18 2009-03-25 Microth Inc Stroke-based data entry device, system, and method
EP1763732A2 (en) 2004-06-29 2007-03-21 Koninklijke Philips Electronics N.V. Discontinuous zoom
US7786980B2 (en) 2004-06-29 2010-08-31 Koninklijke Philips Electronics N.V. Method and device for preventing staining of a display device
JP4210936B2 (en) 2004-07-08 2009-01-21 ソニー株式会社 Information processing apparatus and program used therefor
JP4903371B2 (en) 2004-07-29 2012-03-28 任天堂株式会社 Game device and game program using touch panel
US7719523B2 (en) 2004-08-06 2010-05-18 Touchtable, Inc. Bounding box gesture recognition on a touch detecting interactive display
US7181373B2 (en) 2004-08-13 2007-02-20 Agilent Technologies, Inc. System and methods for navigating and visualizing multi-dimensional biological data
US7434173B2 (en) 2004-08-30 2008-10-07 Microsoft Corporation Scrolling web pages using direct interaction
US7761814B2 (en) 2004-09-13 2010-07-20 Microsoft Corporation Flick gesture
JP4366695B2 (en) 2004-09-13 2009-11-18 日本ビクター株式会社 Menu image display method and electronic information device
US20060055669A1 (en) 2004-09-13 2006-03-16 Mita Das Fluent user interface for text entry on touch-sensitive display
JP4355639B2 (en) 2004-09-15 2009-11-04 キヤノン株式会社 Image processing apparatus and control method thereof
US20060077183A1 (en) 2004-10-08 2006-04-13 Studt Peter C Methods and systems for converting touchscreen events into application formatted data
WO2006045530A2 (en) 2004-10-22 2006-05-04 Novo Nordisk A/S An apparatus and a method of providing information to a user
JP3770499B1 (en) 2004-11-02 2006-04-26 任天堂株式会社 GAME DEVICE AND GAME PROGRAM
US7461348B2 (en) * 2004-11-19 2008-12-02 Microsoft Corporation Systems and methods for processing input data before, during, and/or after an input focus change event
CN100377055C (en) 2004-12-22 2008-03-26 盛群半导体股份有限公司 Interpretation method for touch controlled induction system
CA2594428A1 (en) 2005-01-05 2006-07-13 Jaewoo Ahn Method and apparatus for inputting character through pointing device
WO2006074267A2 (en) 2005-01-05 2006-07-13 Hillcrest Laboratories, Inc. Distributed software construction for user interfaces
US20060156249A1 (en) 2005-01-12 2006-07-13 Blythe Michael M Rotate a user interface
GB0503253D0 (en) 2005-02-17 2005-03-23 Univ Northumbria Newcastle User control of a hand-held device
JP4613078B2 (en) 2005-03-01 2011-01-12 学校法人 名城大学 Manufacturing method of semiconductor substrate
US20060221061A1 (en) 2005-03-31 2006-10-05 Tyco Electronic Corporation Touch sensor and control with random pulse spacing
CN1845046A (en) * 2005-04-07 2006-10-11 技嘉科技股份有限公司 Keyboard and mouse with touch type functional key
US7692637B2 (en) 2005-04-26 2010-04-06 Nokia Corporation User input device for electronic device
JP4490326B2 (en) 2005-05-09 2010-06-23 株式会社土井製作所 Protecting method and device for underground change for underground cables etc.
CN101278422B (en) 2005-05-16 2012-05-30 通用汽车环球科技运作公司 Catalyst for fuel cell electrode
US20060262104A1 (en) 2005-05-19 2006-11-23 Sullivan Darius M Systems and methods for distinguishing contact-induced plate vibrations from acoustic noise-induced plate vibrations
US20070024646A1 (en) 2005-05-23 2007-02-01 Kalle Saarinen Portable electronic apparatus and associated method
US9785329B2 (en) 2005-05-23 2017-10-10 Nokia Technologies Oy Pocket computer and associated methods
US20060271520A1 (en) 2005-05-27 2006-11-30 Ragan Gene Z Content-based implicit search query
US7710397B2 (en) * 2005-06-03 2010-05-04 Apple Inc. Mouse with improved input mechanisms using touch sensors
JP4849300B2 (en) 2005-06-14 2012-01-11 ソニー株式会社 Display signal processing apparatus and method, recording medium, and program
KR20060133389A (en) 2005-06-20 2006-12-26 엘지전자 주식회사 Method and apparatus for processing data of mobile terminal
US20070006078A1 (en) * 2005-07-01 2007-01-04 Microsoft Corporation Declaratively responding to state changes in an interactive multimedia environment
US7463263B2 (en) 2005-07-15 2008-12-09 Sap Portals Israel Ltd. Declarative specification of model visualizations
CN101228570B (en) 2005-07-22 2010-05-19 马特·帕尔拉科夫 System and method for a thumb-optimized touch-screen user interface
US7808478B2 (en) 2005-08-22 2010-10-05 Samsung Electronics Co., Ltd. Autonomous handheld device having a drawing tool
US7603143B2 (en) 2005-08-26 2009-10-13 Lg Electronics Inc. Mobile telecommunication handset having touch pad
US20070152980A1 (en) 2006-01-05 2007-07-05 Kenneth Kocienda Touch Screen Keyboards for Portable Electronic Devices
US7694231B2 (en) 2006-01-05 2010-04-06 Apple Inc. Keyboards for portable electronic devices
CN1949161B (en) 2005-10-14 2010-05-26 鸿富锦精密工业(深圳)有限公司 Multi gradation menu displaying device and display controlling method
KR100717047B1 (en) 2005-10-20 2007-05-10 삼성전자주식회사 Method and apparatus for displaying web page conveniently
US20070109275A1 (en) 2005-11-16 2007-05-17 Chen-Ting Chuang Method for controlling a touch screen user interface and device thereof
US9182837B2 (en) * 2005-11-28 2015-11-10 Synaptics Incorporated Methods and systems for implementing modal changes in a device in response to proximity and force indications
JP2007148927A (en) 2005-11-29 2007-06-14 Alps Electric Co Ltd Input device and scrolling control method using the same
US9069877B2 (en) 2005-12-07 2015-06-30 Ziilabs Inc., Ltd. User interface with variable sized icons
US8428359B2 (en) 2005-12-08 2013-04-23 Core Wireless Licensing S.A.R.L. Text entry for electronic devices
US7480870B2 (en) 2005-12-23 2009-01-20 Apple Inc. Indication of progress towards satisfaction of a user input condition
US7650137B2 (en) 2005-12-23 2010-01-19 Apple Inc. Account information display for portable communication device
US7786975B2 (en) 2005-12-23 2010-08-31 Apple Inc. Continuous scrolling list with acceleration
US7657849B2 (en) 2005-12-23 2010-02-02 Apple Inc. Unlocking a device by performing gestures on an unlock image
US20070152983A1 (en) 2005-12-30 2007-07-05 Apple Computer, Inc. Touch pad with symbols based on mode
US7509588B2 (en) 2005-12-30 2009-03-24 Apple Inc. Portable electronic device with interface reconfiguration mode
US7860536B2 (en) 2006-01-05 2010-12-28 Apple Inc. Telephone interface for a portable communication device
US7574672B2 (en) 2006-01-05 2009-08-11 Apple Inc. Text entry interface for a portable communication device
US9910497B2 (en) * 2006-02-08 2018-03-06 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems
US20070214436A1 (en) 2006-03-13 2007-09-13 Myers Raymond L Jr Positional navigation graphic link system
US7620901B2 (en) 2006-03-21 2009-11-17 Microsoft Corporation Simultaneous input across multiple applications
US20070242607A1 (en) 2006-04-13 2007-10-18 Tellabs Operations, Inc. Method and system for controlling distribution of network topology information
US20070259685A1 (en) * 2006-05-08 2007-11-08 Goran Engblom Electronic equipment with keylock function using motion and method
JP2007312823A (en) 2006-05-23 2007-12-06 Pentax Corp Touch panel input unit and endoscope processor
US8775820B1 (en) 2006-06-02 2014-07-08 Sprint Communications Company L.P. System and method of enterprise administrative password generation and control
KR101277256B1 (en) 2006-06-16 2013-07-05 삼성전자주식회사 Apparatus and method for user interface
KR100748469B1 (en) 2006-06-26 2007-08-10 삼성전자주식회사 User interface method based on keypad touch and mobile device thereof
GB0612624D0 (en) 2006-06-26 2006-08-02 Symbian Software Ltd Speed of gesture
EP2035777A2 (en) 2006-06-30 2009-03-18 Tele Atlas North America, Inc. Method and system for collecting user update requests regarding geographic data to support automated analysis, processing and geographic data updates
JP4762070B2 (en) 2006-07-19 2011-08-31 富士通株式会社 Handwriting input device, handwriting input method, and computer program
CN101356493A (en) 2006-09-06 2009-01-28 苹果公司 Portable electronic device for photo management
US20080084400A1 (en) 2006-10-10 2008-04-10 Outland Research, Llc Touch-gesture control of video media play on handheld media players
US8056007B2 (en) 2006-11-15 2011-11-08 Yahoo! Inc. System and method for recognizing and storing information and associated context
US20080119217A1 (en) * 2006-11-16 2008-05-22 Sony Ericsson Mobile Communications Ab Portable communication having accidental key press filtering
CN101206659B (en) 2006-12-15 2013-09-18 谷歌股份有限公司 Automatic search query correction
US7777732B2 (en) 2007-01-03 2010-08-17 Apple Inc. Multi-event input system
US8656295B2 (en) 2007-01-05 2014-02-18 Apple Inc. Selecting and manipulating web content
US8656311B1 (en) 2007-01-07 2014-02-18 Apple Inc. Method and apparatus for compositing various types of content
US7671756B2 (en) 2007-01-07 2010-03-02 Apple Inc. Portable electronic device with alert silencing
JP4866262B2 (en) 2007-02-16 2012-02-01 ソフトバンクモバイル株式会社 Operation input processing method and portable information processing apparatus
EP1970799B1 (en) 2007-03-15 2017-08-16 LG Electronics Inc. Electronic device and method of controlling mode thereof and mobile communication terminal
US8350815B2 (en) 2007-06-20 2013-01-08 Sony Mobile Communications Portable communication device including touch input with scrolling function
US8059101B2 (en) 2007-06-22 2011-11-15 Apple Inc. Swipe gestures for touch screen keyboards
US8896529B2 (en) 2007-08-01 2014-11-25 Nokia Corporation Apparatus, methods, and computer program products providing context-dependent gesture recognition
US8471823B2 (en) 2007-08-16 2013-06-25 Sony Corporation Systems and methods for providing a user interface
US8315362B2 (en) 2007-08-22 2012-11-20 Citrix Systems, Inc. Systems and methods for voicemail avoidance
KR101348721B1 (en) 2007-09-03 2014-01-08 엘지전자 주식회사 Mobile terminal and it's touch recognition method
KR20090024541A (en) 2007-09-04 2009-03-09 삼성전자주식회사 Method for selecting hyperlink and mobile communication terminal using the same
US20090058820A1 (en) 2007-09-04 2009-03-05 Microsoft Corporation Flick-based in situ search from ink, text, or an empty selection region
US8667412B2 (en) 2007-09-06 2014-03-04 Google Inc. Dynamic virtual input device configuration
JP2009110286A (en) 2007-10-30 2009-05-21 Toshiba Corp Information processor, launcher start control program, and launcher start control method
JP2009169825A (en) 2008-01-18 2009-07-30 Kyocera Mita Corp Display input device, electronic device, and display input control program
US8289283B2 (en) 2008-03-04 2012-10-16 Apple Inc. Language input interface on a device
US8261190B2 (en) 2008-04-24 2012-09-04 Burlington Education Ltd. Displaying help sensitive areas of a computer application
US8584048B2 (en) 2008-05-29 2013-11-12 Telcordia Technologies, Inc. Method and system for multi-touch-based browsing of media summarizations on a handheld device
US20090322671A1 (en) 2008-06-04 2009-12-31 Cybernet Systems Corporation Touch screen augmented reality system and method
KR100978929B1 (en) 2008-06-24 2010-08-30 한국전자통신연구원 Registration method of reference gesture data, operation method of mobile terminal and mobile terminal
CN101339453B (en) 2008-08-15 2012-05-23 广东威创视讯科技股份有限公司 Simulated mouse input method based on interactive input apparatus
US8279241B2 (en) 2008-09-09 2012-10-02 Microsoft Corporation Zooming graphical user interface
US20100073303A1 (en) 2008-09-24 2010-03-25 Compal Electronics, Inc. Method of operating a user interface
US20100088628A1 (en) 2008-10-07 2010-04-08 Sony Ericsson Mobile Communications Ab Live preview of open windows
US8707170B2 (en) 2008-12-15 2014-04-22 Hewlett-Packard Development Company, L.P. Gesture based edit mode
US8869070B2 (en) 2008-12-30 2014-10-21 T-Mobile Usa, Inc. Handwriting manipulation for conducting a search over multiple databases
US8319736B2 (en) 2009-01-19 2012-11-27 Microsoft Corporation Touch sensitive computing device and method
US8704767B2 (en) 2009-01-29 2014-04-22 Microsoft Corporation Environmental gesture recognition
US20100235745A1 (en) 2009-03-10 2010-09-16 Sony Corporation Accessibility system for consumer devices
US8493344B2 (en) 2009-06-07 2013-07-23 Apple Inc. Devices, methods, and graphical user interfaces for accessibility using a touch-sensitive surface
DE102009024656A1 (en) 2009-06-12 2011-03-24 Volkswagen Ag A method of controlling a graphical user interface and graphical user interface operator
US9223590B2 (en) 2010-01-06 2015-12-29 Apple Inc. System and method for issuing commands to applications based on contextual information
US8957918B2 (en) 2009-11-03 2015-02-17 Qualcomm Incorporated Methods for implementing multi-touch gestures on a single-touch touch surface
US8436821B1 (en) 2009-11-20 2013-05-07 Adobe Systems Incorporated System and method for developing and classifying touch gestures
US20110151974A1 (en) 2009-12-18 2011-06-23 Microsoft Corporation Gesture style recognition and reward
KR20110110940A (en) 2010-04-02 2011-10-10 삼성전자주식회사 Method and apparatus for touch input in portable communication system
US20130120280A1 (en) 2010-05-28 2013-05-16 Tim Kukulski System and Method for Evaluating Interoperability of Gesture Recognizers
CN101853105A (en) 2010-06-02 2010-10-06 友达光电股份有限公司 Computer with touch screen and operating method thereof
US8749499B2 (en) 2010-06-08 2014-06-10 Sap Ag Touch screen for bridging multi and/or single touch points to applications
US8836643B2 (en) 2010-06-10 2014-09-16 Qualcomm Incorporated Auto-morphing adaptive user interface device and methods
US10216408B2 (en) 2010-06-14 2019-02-26 Apple Inc. Devices and methods for identifying user interface objects based on view hierarchy
TWI407346B (en) 2010-07-30 2013-09-01 Ind Tech Res Inst Track compensation methods and systems for touch-sensitive input devices, and computer program products thereof
KR20120024247A (en) 2010-09-06 2012-03-14 삼성전자주식회사 Method for operating a mobile device by recognizing a user gesture and the mobile device thereof
US20120092286A1 (en) 2010-10-19 2012-04-19 Microsoft Corporation Synthetic Gesture Trace Generator
US20120133579A1 (en) 2010-11-30 2012-05-31 Microsoft Corporation Gesture recognition management
CN106095418B (en) 2010-12-20 2019-09-13 苹果公司 Event recognition
US8438473B2 (en) 2011-01-05 2013-05-07 Research In Motion Limited Handling of touch events in a browser environment
US20120242584A1 (en) 2011-03-22 2012-09-27 Nokia Corporation Method and apparatus for providing sight independent activity reports responsive to a touch gesture
US9298363B2 (en) 2011-04-11 2016-03-29 Apple Inc. Region activation for touch sensitive surface
US9658766B2 (en) 2011-05-27 2017-05-23 Microsoft Technology Licensing, Llc Edge gesture
TWI467463B (en) 2011-05-27 2015-01-01 Asustek Comp Inc Computer system with touch screen and associated gesture response enhancing method
US9389679B2 (en) 2011-11-30 2016-07-12 Microsoft Technology Licensing, Llc Application programming interface for a multi-pointer indirect touch input device
US9071970B2 (en) 2011-12-05 2015-06-30 Sony Corporation Terminal device
US10983625B2 (en) 2011-12-22 2021-04-20 Adobe Inc. Systems and methods for measurement of unsupported user interface actions
US8411060B1 (en) 2012-01-13 2013-04-02 Google Inc. Swipe gesture classification
US9046958B2 (en) 2012-03-15 2015-06-02 Nokia Technologies Oy Method, apparatus and computer program product for user input interpretation and input error mitigation
US20140160085A1 (en) 2012-12-07 2014-06-12 Qualcomm Incorporated Adaptive analog-front-end to optimize touch processing
CN104903834B (en) 2012-12-29 2019-07-05 苹果公司 For equipment, method and the graphic user interface in touch input to transition between display output relation
US9626100B2 (en) 2013-04-15 2017-04-18 Microsoft Technology Licensing, Llc Dynamic management of edge inputs by users on a touch device
US9733716B2 (en) 2013-06-09 2017-08-15 Apple Inc. Proxy gesture recognizer
JP6215933B2 (en) 2013-06-18 2017-10-18 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Input device and method for inputting operation request
US9886190B2 (en) 2014-09-26 2018-02-06 The Florida International University Board Of Trustees Gesture discernment and processing system

Patent Citations (333)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4455452A (en) 1982-09-13 1984-06-19 Touch Activated Switch Arrays, Inc. Touch activated controller for generating X-Y output information
US4674066A (en) 1983-02-18 1987-06-16 Houghton Mifflin Company Textual database system using skeletonization and phonetic replacement to retrieve words matching or similar to query words
US5252951A (en) 1989-04-28 1993-10-12 International Business Machines Corporation Graphical user interface with gesture recognition in a multiapplication environment
US5530861A (en) 1991-08-26 1996-06-25 Hewlett-Packard Company Process enaction and tool integration via a task oriented paradigm
JPH05298002A (en) 1992-04-15 1993-11-12 Oki Electric Ind Co Ltd Keyboard
US5880411A (en) 1992-06-08 1999-03-09 Synaptics, Incorporated Object position detector with edge motion feature and gesture recognition
US5488204A (en) 1992-06-08 1996-01-30 Synaptics, Incorporated Paintbrush stylus for capacitive touch sensor pad
US7084859B1 (en) 1992-09-18 2006-08-01 Pryor Timothy R Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US5513309A (en) 1993-01-05 1996-04-30 Apple Computer, Inc. Graphic editor user interface for a pointer-based computer system
US5627567A (en) 1993-04-27 1997-05-06 Hewlett-Packard Company Method and apparatus for adaptive touch recognition in a touch sensitive user interface
US5589856A (en) 1993-04-29 1996-12-31 International Business Machines Corporation System & method for dynamically labeled touch sensitive buttons in a digitizing display
US6035343A (en) 1993-06-11 2000-03-07 Fujitsu Limited Method for executing software formed of software components and a system for executing such software
US5818455A (en) 1993-07-21 1998-10-06 Xerox Corporation Method and apparatus for operating on the model data structure of an image to produce human perceptible output using a viewing operation region having explicit multiple regions
US5627959A (en) 1993-09-20 1997-05-06 Oracle Corporation Method for manipulating graphic objects
US5534893A (en) 1993-12-15 1996-07-09 Apple Computer, Inc. Method and apparatus for using stylus-tablet input in a computer system
US5854853A (en) 1993-12-22 1998-12-29 Canon Kabushika Kaisha Method and apparatus for selecting blocks of image data from image data having both horizontally- and vertically-oriented blocks
US5686940A (en) 1993-12-24 1997-11-11 Rohm Co., Ltd. Display apparatus
US5566337A (en) 1994-05-13 1996-10-15 Apple Computer, Inc. Method and apparatus for distributing events in an operating system
US5708460A (en) 1995-06-02 1998-01-13 Avi Systems, Inc. Touch screen
US5745116A (en) 1996-09-09 1998-04-28 Motorola, Inc. Intuitive gesture-based graphical user interface
US5903902A (en) 1996-09-09 1999-05-11 Design Intelligence, Inc. Design engine with tree and component structure
GB2319591A (en) 1996-11-20 1998-05-27 Alps Electric Co Ltd Coordinates input apparatus
US5959629A (en) 1996-11-25 1999-09-28 Sony Corporation Text input device and method
US5917477A (en) 1997-02-28 1999-06-29 Samsung Electronics Co., Ltd. Touch screen input apparatus for chip mounter, chip mounter including the same and method for controlling the chip mounter
US20010011998A1 (en) 1997-04-09 2001-08-09 Hiroaki Agata Embedded keyboard pointing device with keyboard unit and information processing apparatus
US20070055967A1 (en) 1997-05-08 2007-03-08 Poff Thomas C Offload system, method, and computer program product for port-related processing
US6369821B2 (en) 1997-05-19 2002-04-09 Microsoft Corporation Method and system for synchronizing scripted animations
US6028602A (en) 1997-05-30 2000-02-22 Telefonaktiebolaget Lm Ericsson Method for managing contents of a hierarchical data model
US20010012001A1 (en) 1997-07-07 2001-08-09 Junichi Rekimoto Information input apparatus
US6377965B1 (en) 1997-11-07 2002-04-23 Microsoft Corporation Automatic word completion system for partially entered data
US7237199B1 (en) 1997-12-01 2007-06-26 Cedara Software Corp. Architecture for an application framework
US20070081726A1 (en) 1998-01-26 2007-04-12 Fingerworks, Inc. Multi-touch contact tracking algorithm
US20080036743A1 (en) 1998-01-26 2008-02-14 Apple Computer, Inc. Gesturing with a multipoint sensing device
US20020015024A1 (en) * 1998-01-26 2002-02-07 University Of Delaware Method and apparatus for integrating manual input
US6323846B1 (en) 1998-01-26 2001-11-27 University Of Delaware Method and apparatus for integrating manual input
US8314775B2 (en) 1998-01-26 2012-11-20 Apple Inc. Multi-touch touch surface
US7346850B2 (en) 1998-06-12 2008-03-18 Cygnus Systems, Inc. System and method for iconic software environment management
US6570594B1 (en) 1998-06-30 2003-05-27 Sun Microsystems, Inc. User interface with non-intrusive display element
US6188391B1 (en) 1998-07-09 2001-02-13 Synaptics, Inc. Two-layer capacitive touchpad and method of making same
US20030160832A1 (en) 1998-07-14 2003-08-28 Brad Ridgley Method and device for finding, collecting and acting upon units of information
US6985178B1 (en) 1998-09-30 2006-01-10 Canon Kabushiki Kaisha Camera control system, image pick-up server, client, control method and storage medium therefor
US20060247915A1 (en) 1998-12-04 2006-11-02 Tegic Communications, Inc. Contextual Prediction of User Words and User Actions
US6963937B1 (en) 1998-12-17 2005-11-08 International Business Machines Corporation Method and apparatus for providing configurability and customization of adaptive user-input filtration
WO2000038042A1 (en) 1998-12-22 2000-06-29 Ericsson Inc. Apparatus and method for determining selection of touchable items on a computer touchscreen by an imprecise touch
US6259436B1 (en) 1998-12-22 2001-07-10 Ericsson Inc. Apparatus and method for determining selection of touchable items on a computer touchscreen by an imprecise touch
JP2000222130A (en) 1999-02-02 2000-08-11 Toshiba Corp Input device and method and storage medium
US6486896B1 (en) 1999-04-07 2002-11-26 Apple Computer, Inc. Scalable scroll controller
US6714936B1 (en) 1999-05-25 2004-03-30 Nevin, Iii Rocky Harry W. Method and apparatus for displaying data stored in linked nodes
US6631501B1 (en) 1999-06-30 2003-10-07 Microsoft Corporation Method and system for automatic type and replace of characters in a sequence of characters
US6639584B1 (en) 1999-07-06 2003-10-28 Chuang Li Methods and apparatus for controlling a portable electronic device using a touchpad
US6636242B2 (en) 1999-08-31 2003-10-21 Accenture Llp View configurer in a presentation services patterns environment
US6664989B1 (en) 1999-10-18 2003-12-16 Honeywell International Inc. Methods and apparatus for graphical display interaction
US7152210B1 (en) 1999-10-20 2006-12-19 Koninklijke Philips Electronics N.V. Device and method of browsing an image collection
US6958749B1 (en) 1999-11-04 2005-10-25 Sony Corporation Apparatus and method for manipulating a touch-sensitive display panel
US6778992B1 (en) 1999-12-21 2004-08-17 Lockstream Corporation Flexible and hierarchical user interfaces defined using a data definition language
US20060284792A1 (en) 2000-01-28 2006-12-21 Intersense, Inc., A Delaware Corporation Self-referenced tracking
JP2001290585A (en) 2000-01-31 2001-10-19 Canon Inc Position information processor, position information processing method and program, and operation device and its method and program
US6590595B1 (en) 2000-02-08 2003-07-08 Sun Microsystems, Inc. Mechanism for providing intuitive scrolling feedback
US7013435B2 (en) 2000-03-17 2006-03-14 Vizible.Com Inc. Three dimensional spatial user interface
US20010045949A1 (en) 2000-03-29 2001-11-29 Autodesk, Inc. Single gesture map navigation graphical user interface for a personal digital assistant
US6765557B1 (en) 2000-04-10 2004-07-20 Interlink Electronics, Inc. Remote control having touch pad to screen mapping
US7009626B2 (en) 2000-04-14 2006-03-07 Picsel Technologies Limited Systems and methods for generating visual representations of graphical data and digital document processing
US6446083B1 (en) 2000-05-12 2002-09-03 Vastvideo, Inc. System and method for classifying media items
US7030863B2 (en) 2000-05-26 2006-04-18 America Online, Incorporated Virtual keyboard system with automatic correction
US6677965B1 (en) 2000-07-13 2004-01-13 International Business Machines Corporation Rubber band graphical user interface control
WO2002008881A2 (en) 2000-07-21 2002-01-31 Qinetiq Limited Human-computer interface
WO2002013176A2 (en) 2000-08-07 2002-02-14 Zframe, Inc Visual content browsing using rasterized representations
US6735583B1 (en) 2000-11-01 2004-05-11 Getty Images, Inc. Method and system for classifying and locating media content
US20040221168A1 (en) 2000-12-28 2004-11-04 Girard Luke E. System and method for protected messaging
US6839721B2 (en) 2001-01-12 2005-01-04 Hewlett-Packard Development Company, L.P. Integration of a database into file management software for protecting, tracking, and retrieving data
US6677932B1 (en) 2001-01-28 2004-01-13 Finger Works, Inc. System and method for recognizing touch typing under limited tactile feedback conditions
US6570557B1 (en) 2001-02-10 2003-05-27 Finger Works, Inc. Multi-touch system and method for emulating modifier keys via fingertip chords
US20060125803A1 (en) 2001-02-10 2006-06-15 Wayne Westerman System and method for packing multitouch gestures onto a hand
US20040027398A1 (en) 2001-02-15 2004-02-12 Denny Jaeger Intuitive graphic user interface with universal tools
US6741996B1 (en) 2001-04-18 2004-05-25 Microsoft Corporation Managing user clips
US20040215643A1 (en) 2001-04-18 2004-10-28 Microsoft Corporation Managing user clips
US20020194589A1 (en) 2001-05-08 2002-12-19 Cristofalo Michael Technique for optimizing the delivery of advertisements and other programming segments by making bandwidth tradeoffs
US20020191029A1 (en) 2001-05-16 2002-12-19 Synaptics, Inc. Touch screen with user interface enhancement
US20050024341A1 (en) 2001-05-16 2005-02-03 Synaptics, Inc. Touch screen with user interface enhancement
US6985137B2 (en) 2001-08-13 2006-01-10 Nokia Mobile Phones Ltd. Method for preventing unintended touch pad input due to accidental touching
US20060028455A1 (en) 2001-08-29 2006-02-09 Microsoft Corp. Touch-sensitive device for scrolling a document on a display
US20060038796A1 (en) 2001-08-29 2006-02-23 Microsoft Corporation Enhanced scrolling
US20030071858A1 (en) 2001-09-28 2003-04-17 Hiroshi Morohoshi Information input and output system, method, storage medium, and carrier wave
US20030071850A1 (en) 2001-10-12 2003-04-17 Microsoft Corporation In-place adaptive handwriting input method and system
US20030095096A1 (en) 2001-10-22 2003-05-22 Apple Computer, Inc. Method and apparatus for use of rotational user inputs
US20030080946A1 (en) 2001-10-25 2003-05-01 Wei-Pin Chuang Portable computer and related method for preventing input interruption by write-tracking an input region
US20080016096A1 (en) 2001-12-21 2008-01-17 International Business Machines Corporation Dynamic status tree facility
US20030122787A1 (en) 2001-12-28 2003-07-03 Philips Electronics North America Corporation Touch-screen image scrolling system and method
US7420543B2 (en) 2002-01-03 2008-09-02 Mahesh Jayachandra User-friendly Brahmi-derived Hindi keyboard
US20030132959A1 (en) 2002-01-16 2003-07-17 Simister J. Bret Interface engine providing a continuous user interface
US6957392B2 (en) 2002-01-16 2005-10-18 Laszlo Systems, Inc. Interface engine providing a continuous user interface
US20030146941A1 (en) 2002-02-05 2003-08-07 Bailey Richard St.Clair Systems and methods for creating and managing graphical user interface lists
US20030174149A1 (en) 2002-02-06 2003-09-18 Hitomi Fujisaki Apparatus and method for data-processing
JP2003296024A (en) 2002-04-01 2003-10-17 Nec Engineering Ltd Method of touch panel control
US20080048978A1 (en) 2002-04-11 2008-02-28 Synaptics Incorporated Closed-loop sensor on a solid-state object position detector
US20030197689A1 (en) 2002-04-23 2003-10-23 May Gregory J. Input device that allows multiple touch key input
US20040100479A1 (en) 2002-05-13 2004-05-27 Masao Nakano Portable information terminal, display control device, display control method, and computer readable program therefor
US20030222917A1 (en) 2002-05-30 2003-12-04 Intel Corporation Mobile virtual desktop
US7023427B2 (en) 2002-06-28 2006-04-04 Microsoft Corporation Method and system for detecting multiple touches on a touch-sensitive screen
US20040021676A1 (en) 2002-08-01 2004-02-05 Tatung Co., Ltd. Method and apparatus of view window scrolling
US20040021698A1 (en) 2002-08-05 2004-02-05 Baldwin Amanda K. Intuitive touchscreen interface for a multifunction device and method therefor
US20040039474A1 (en) 2002-08-26 2004-02-26 Tsudakoma Kogyo Kabushiki Kaisha Information display apparatus of a loom
US20040095387A1 (en) 2002-11-19 2004-05-20 Demsey Seth M. Virtualized and realized user interface controls
US6903927B2 (en) 2002-12-17 2005-06-07 Nokia Corporation Convertible mobile computing device
US20040125136A1 (en) 2002-12-30 2004-07-01 Jukka Wallenius Provision of services through a display system
US7117453B2 (en) 2003-01-21 2006-10-03 Microsoft Corporation Media frame object visualization system
US20040160419A1 (en) 2003-02-11 2004-08-19 Terradigital Systems Llc. Method for entering alphanumeric characters into a graphical user interface
US7088374B2 (en) 2003-03-27 2006-08-08 Microsoft Corporation System and method for managing visual structure, timing, and animation in a graphics processing system
US20040210847A1 (en) 2003-04-17 2004-10-21 Supersonic Aerospace International, Llc System and method for customizing multiple windows of information on a display
US20040224638A1 (en) 2003-04-25 2004-11-11 Apple Computer, Inc. Media player system
US20050008343A1 (en) 2003-04-30 2005-01-13 Frohlich David Mark Producing video and audio-photos from a static digital image
US20040225965A1 (en) 2003-05-06 2004-11-11 Microsoft Corporation Insertion location tracking for controlling a user interface
US20050005241A1 (en) 2003-05-08 2005-01-06 Hunleth Frank A. Methods and systems for generating a zoomable graphical user interface
US7173623B2 (en) 2003-05-09 2007-02-06 Microsoft Corporation System supporting animation of graphical display elements through animation object instances
US20040222992A1 (en) 2003-05-09 2004-11-11 Microsoft Corporation System supporting animation of graphical display elements through animation object instances
US20060242607A1 (en) 2003-06-13 2006-10-26 University Of Lancaster User interface
US20090259969A1 (en) 2003-07-14 2009-10-15 Matt Pallakoff Multimedia client interface devices and methods
US20050027666A1 (en) 2003-07-15 2005-02-03 Vente, Inc Interactive online research system and method
US20050017957A1 (en) 2003-07-25 2005-01-27 Samsung Electronics Co., Ltd. Touch screen system and control method therefor capable of setting active regions
GB2404547A (en) 2003-07-25 2005-02-02 Samsung Electronics Co Ltd A touch screen system for reducing input errors
JP2005056286A (en) 2003-08-07 2005-03-03 Nec Engineering Ltd Display enlarging method and display enlarging program in web browser
JP2005082086A (en) 2003-09-10 2005-03-31 Fujitsu Ten Ltd Input device in information terminal
EP1517228A2 (en) 2003-09-16 2005-03-23 Smart Technologies, Inc. Gesture recognition method and touch system incorporating the same
US20050057524A1 (en) 2003-09-16 2005-03-17 Hill Douglas B. Gesture recognition method and touch system incorporating the same
US20050088443A1 (en) 2003-10-24 2005-04-28 Leonardo Blanco Communication protocol for synchronizing animation systems
US20050183035A1 (en) 2003-11-20 2005-08-18 Ringel Meredith J. Conflict resolution for graphic multi-user interface
US7337412B2 (en) 2003-12-15 2008-02-26 International Business Machines Corporation Methods, systems and computer program products for providing multi-dimensional tree diagram graphical user interfaces
US20050162402A1 (en) 2004-01-27 2005-07-28 Watanachote Susornpol J. Methods of interacting with a computer using a finger(s) touch sensing input device with visual feedback
US20050210419A1 (en) * 2004-02-06 2005-09-22 Nokia Corporation Gesture control system
US20070288856A1 (en) 2004-02-19 2007-12-13 Butlin Stefan G Layered User Interface
US20050193015A1 (en) 2004-02-19 2005-09-01 Sandraic Logic, Llc A California Limited Liability Company Method and apparatus for organizing, sorting and navigating multimedia content
US20070198926A1 (en) 2004-02-23 2007-08-23 Jazzmutant Devices and methods of controlling manipulation of virtual objects on a multi-contact tactile screen
JP2005242669A (en) 2004-02-26 2005-09-08 Seiko Epson Corp Display processing device, display method, and display program for structured document
US8051406B2 (en) 2004-04-30 2011-11-01 Microsoft Corporation Rich end-user data views
US7663607B2 (en) 2004-05-06 2010-02-16 Apple Inc. Multipoint touchscreen
US20060097991A1 (en) 2004-05-06 2006-05-11 Apple Computer, Inc. Multipoint touchscreen
JP2005322088A (en) 2004-05-10 2005-11-17 Namco Ltd Program, information storage medium and electronic equipment
US20050268247A1 (en) 2004-05-27 2005-12-01 Baneth Robin C System and method for controlling a user interface
US20070252821A1 (en) 2004-06-17 2007-11-01 Koninklijke Philips Electronics, N.V. Use of a Two Finger Input on Touch Screens
US20060010400A1 (en) 2004-06-28 2006-01-12 Microsoft Corporation Recognizing gestures and using gestures for interacting with software applications
US7653883B2 (en) 2004-07-30 2010-01-26 Apple Inc. Proximity detector in handheld device
US7900156B2 (en) 2004-07-30 2011-03-01 Apple Inc. Activating virtual keys of a touch-screen virtual keyboard
US20060161871A1 (en) * 2004-07-30 2006-07-20 Apple Computer, Inc. Proximity detector in handheld device
WO2006020304A2 (en) 2004-07-30 2006-02-23 Apple Computer, Inc. Mode-based graphical user interfaces for touch sensitive input devices
US7614008B2 (en) 2004-07-30 2009-11-03 Apple Inc. Operation of a computer with touch screen interface
US20070247442A1 (en) 2004-07-30 2007-10-25 Andre Bartley K Activating virtual keys of a touch-screen virtual keyboard
US20060026521A1 (en) * 2004-07-30 2006-02-02 Apple Computer, Inc. Gestures for touch sensitive input devices
WO2006020305A2 (en) 2004-07-30 2006-02-23 Apple Computer, Inc. Gestures for touch sensitive input devices
US20060026535A1 (en) 2004-07-30 2006-02-02 Apple Computer Inc. Mode-based graphical user interfaces for touch sensitive input devices
US20060026676A1 (en) 2004-07-30 2006-02-02 Nokia Corporation Method for the monitoring of system security in electronic devices
US8239784B2 (en) 2004-07-30 2012-08-07 Apple Inc. Mode-based graphical user interfaces for touch sensitive input devices
US20080231610A1 (en) 2004-07-30 2008-09-25 Apple Inc. Gestures for touch sensitive input devices
US20060026536A1 (en) * 2004-07-30 2006-02-02 Apple Computer, Inc. Gestures for touch sensitive input devices
US20060125799A1 (en) * 2004-08-06 2006-06-15 Hillis W D Touch driven method and apparatus to integrate and display multiple image layers forming alternate depictions of same subject matter
US20070046643A1 (en) 2004-08-06 2007-03-01 Hillis W Daniel State-Based Approach to Gesture Identification
US20060031786A1 (en) * 2004-08-06 2006-02-09 Hillis W D Method and apparatus continuing action of user gestures performed upon a touch sensitive interactive display in simulation of inertia
US20060036955A1 (en) 2004-08-12 2006-02-16 Microsoft Corporation System and method of displaying content on small screen computing devices
US20060066588A1 (en) 2004-09-24 2006-03-30 Apple Computer, Inc. System and method for processing raw data of track pad device
JP2006102275A (en) 2004-10-06 2006-04-20 Namco Ltd Game system, program and information storage medium
US20060112335A1 (en) 2004-11-18 2006-05-25 Microsoft Corporation Method and system for providing multiple input connecting user interface
US7925996B2 (en) 2004-11-18 2011-04-12 Microsoft Corporation Method and system for providing multiple input connecting user interface
US20060123353A1 (en) 2004-12-08 2006-06-08 Microsoft Corporation Method and system of taskbar button interfaces
US20060136833A1 (en) 2004-12-15 2006-06-22 International Business Machines Corporation Apparatus and method for chaining objects in a pointer drag path
WO2006067711A2 (en) 2004-12-21 2006-06-29 Koninklijke Philips Electronics N.V. Method and device for displaying animated buttons
US20070185876A1 (en) 2005-02-07 2007-08-09 Mendis Venura C Data handling system
US20060190833A1 (en) 2005-02-18 2006-08-24 Microsoft Corporation Single-handed approach for navigation of application tiles using panning and zooming
WO2006094308A2 (en) 2005-03-04 2006-09-08 Apple Computer, Inc. Multi-functional hand-held device
US20060197753A1 (en) 2005-03-04 2006-09-07 Hotelling Steven P Multi-functional hand-held device
CN1841284A (en) 2005-03-28 2006-10-04 上海桐港信息科技有限公司 Touch screen type mobile apparatus micro-browser webpage displaying and drifting method
US7750893B2 (en) 2005-04-06 2010-07-06 Nintendo Co., Ltd. Storage medium storing input position processing program, and input position processing device
US20060236263A1 (en) 2005-04-15 2006-10-19 Microsoft Corporation Tactile device for scrolling
US20060242602A1 (en) 2005-04-22 2006-10-26 Microsoft Corporation Interface and system for manipulating thumbnails of live windows in a window manager
US7673255B2 (en) 2005-04-22 2010-03-02 Microsoft Corporation Interface and system for manipulating thumbnails of live windows in a window manager
US7499027B2 (en) 2005-04-29 2009-03-03 Microsoft Corporation Using a light pointer for input on an interactive display surface
US20080072143A1 (en) 2005-05-18 2008-03-20 Ramin Assadollahi Method and device incorporating improved text input mechanism
US7487447B1 (en) 2005-05-25 2009-02-03 Google Inc. Web page zoom feature
US7561159B2 (en) 2005-05-31 2009-07-14 Magnifi Group Inc. Control of animation timeline
WO2006128248A1 (en) 2005-06-02 2006-12-07 National Ict Australia Limited Multimodal computer navigation
US20090049388A1 (en) 2005-06-02 2009-02-19 Ronnie Bernard Francis Taib Multimodal computer navigation
US20060279548A1 (en) 2005-06-08 2006-12-14 Geaghan Bernard O Touch location determination involving multiple touch location processes
US7576732B2 (en) 2005-06-23 2009-08-18 Elan Microelectronics Corporation Scroll control method using a touchpad
US20070050469A1 (en) 2005-08-30 2007-03-01 Microsoft Corporation Commanding
US20070061126A1 (en) 2005-09-01 2007-03-15 Anthony Russo System for and method of emulating electronic input devices
WO2007037806A1 (en) 2005-09-15 2007-04-05 Apple Inc. System and method for processing raw data of track pad device
US20070064004A1 (en) * 2005-09-21 2007-03-22 Hewlett-Packard Development Company, L.P. Moving a graphic element
US20070075965A1 (en) 2005-09-30 2007-04-05 Brian Huppi Automated response to and sensing of user activity in portable devices
WO2007067858A2 (en) 2005-12-08 2007-06-14 Apple Inc. List scrolling in response to moving contact over list of index symbols
US20070132789A1 (en) 2005-12-08 2007-06-14 Bas Ording List scrolling in response to moving contact over list of index symbols
US20070152984A1 (en) 2005-12-30 2007-07-05 Bas Ording Portable electronic device with multi-touch input
US20070152976A1 (en) 2005-12-30 2007-07-05 Microsoft Corporation Unintentional touch rejection
WO2007079425A2 (en) 2005-12-30 2007-07-12 Apple Inc. Portable electronic device with multi-touch input
US20070174257A1 (en) 2006-01-18 2007-07-26 Bruce Thomas Howard Systems and methods for providing sorted search results
US20070177804A1 (en) * 2006-01-30 2007-08-02 Apple Computer, Inc. Multi-touch gesture dictionary
WO2007089766A2 (en) 2006-01-30 2007-08-09 Apple Inc. Gesturing with a multipoint sensing device
US20070176903A1 (en) 2006-01-31 2007-08-02 Dahlin Jeffrey J Capacitive touch sensor button activation
US20070214462A1 (en) 2006-03-08 2007-09-13 Navisense. Llc Application programming interface (api)for sensory events
US20070236472A1 (en) * 2006-04-10 2007-10-11 Microsoft Corporation Universal user interface device
US20070242056A1 (en) 2006-04-12 2007-10-18 N-Trig Ltd. Gesture recognition feedback for a dual mode digitizer
US20080172633A1 (en) 2006-04-19 2008-07-17 Lg Electronics Inc. Touch screen device and method of displaying and selecting menus thereof
US20070247435A1 (en) 2006-04-19 2007-10-25 Microsoft Corporation Precise selection techniques for multi-touch screens
US20070262964A1 (en) * 2006-05-12 2007-11-15 Microsoft Corporation Multi-touch uses, gestures, and implementation
US20070277124A1 (en) 2006-05-24 2007-11-29 Sang Hyun Shin Touch screen device and operating method thereof
US20080034029A1 (en) 2006-06-15 2008-02-07 Microsoft Corporation Composition of local media playback with remotely generated user interface
US20070291009A1 (en) 2006-06-19 2007-12-20 Cypress Semiconductor Corporation Apparatus and method for detecting a touch-sensor pad gesture
US20080005703A1 (en) 2006-06-28 2008-01-03 Nokia Corporation Apparatus, Methods and computer program products providing finger-based and hand-based gesture commands for portable electronic device applications
US20080001923A1 (en) 2006-06-28 2008-01-03 Microsoft Corporation Input Simulation System For Touch Based Devices
US20080012835A1 (en) 2006-07-12 2008-01-17 N-Trig Ltd. Hover and touch detection for digitizer
US20080028327A1 (en) 2006-07-27 2008-01-31 Canon Kabushiki Kaisha Information processing apparatus and user interface control method
WO2008020446A1 (en) 2006-08-15 2008-02-21 N-Trig Ltd. Gesture detection for a digitizer
US20080043020A1 (en) 2006-08-18 2008-02-21 Microsoft Corporation User interface for viewing street side imagery
WO2008030879A2 (en) 2006-09-06 2008-03-13 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US8253695B2 (en) 2006-09-06 2012-08-28 Apple Inc. Email client for a portable multifunction device
WO2008030779A2 (en) 2006-09-06 2008-03-13 Apple Inc. Portable electronic device for photo management
WO2008030880A1 (en) 2006-09-06 2008-03-13 Apple Inc. Methods for determining a cursor position from a finger contact with a touch screen display
US20080094368A1 (en) 2006-09-06 2008-04-24 Bas Ording Portable Electronic Device, Method, And Graphical User Interface For Displaying Structured Electronic Documents
US7941760B2 (en) 2006-09-06 2011-05-10 Apple Inc. Soft keyboard display for a portable multifunction device
US20080114614A1 (en) 2006-11-15 2008-05-15 General Electric Company Methods and systems for healthcare application interaction using gesture-based interaction enhanced with pressure sensitivity
US20080120576A1 (en) 2006-11-22 2008-05-22 General Electric Company Methods and systems for creation of hanging protocols using graffiti-enabled devices
JP2008146165A (en) 2006-12-06 2008-06-26 Sony Corp Display device, control method for display device, and program
US20080158191A1 (en) 2006-12-29 2008-07-03 Inventec Appliances Corp. Method for zooming image
US20080162751A1 (en) 2007-01-03 2008-07-03 Apple Inc. Multi buffer asynchronous scheme for processing incoming information
US20080165140A1 (en) * 2007-01-05 2008-07-10 Apple Inc. Detecting gestures on multi-event sensitive devices
US8214768B2 (en) 2007-01-05 2012-07-03 Apple Inc. Method, system, and graphical user interface for viewing multiple application windows
US20080165132A1 (en) 2007-01-05 2008-07-10 Microsoft Corporation Recognizing multiple input point gestures
US20080165141A1 (en) * 2007-01-05 2008-07-10 Apple Inc. Gestures for controlling, manipulating, and editing of media files using touch sensitive devices
US20090058830A1 (en) 2007-01-07 2009-03-05 Scott Herz Portable multifunction device, method, and graphical user interface for interpreting a finger gesture
US8091045B2 (en) 2007-01-07 2012-01-03 Apple Inc. System and method for managing lists
WO2008085846A2 (en) 2007-01-07 2008-07-17 Apple Inc. Application programming interfaces for synchronization
US20080168405A1 (en) 2007-01-07 2008-07-10 Francisco Ryan Tolmasky Portable Multifunction Device, Method, and Graphical User Interface for Translating Displayed Content
US20080168395A1 (en) 2007-01-07 2008-07-10 Bas Ording Positioning a Slider Icon on a Portable Multifunction Device
US20080168402A1 (en) 2007-01-07 2008-07-10 Christopher Blumenberg Application Programming Interfaces for Gesture Operations
US7844915B2 (en) 2007-01-07 2010-11-30 Apple Inc. Application programming interfaces for scrolling operations
US7966578B2 (en) 2007-01-07 2011-06-21 Apple Inc. Portable multifunction device, method, and graphical user interface for translating displayed content
US20080165160A1 (en) 2007-01-07 2008-07-10 Kenneth Kocienda Portable Multifunction Device, Method, and Graphical User Interface for Interpreting a Finger Gesture on a Touch Screen Display
US20100325575A1 (en) 2007-01-07 2010-12-23 Andrew Platzer Application programming interfaces for scrolling operations
US20110314430A1 (en) 2007-01-07 2011-12-22 Christopher Blumenberg Application programming interfaces for gesture operations
US7903115B2 (en) 2007-01-07 2011-03-08 Apple Inc. Animations
WO2008085877A1 (en) 2007-01-07 2008-07-17 Apple Inc. Animations
US20120023509A1 (en) 2007-01-07 2012-01-26 Christopher Blumenberg Application programming interfaces for gesture operations
US20080165136A1 (en) 2007-01-07 2008-07-10 Greg Christie System and Method for Managing Lists
WO2008085855A1 (en) 2007-01-07 2008-07-17 Apple Inc. Application programming interfaces for scrolling
WO2008085871A1 (en) 2007-01-07 2008-07-17 Apple Inc. Application programming interfaces for scrolling operations
WO2008085848A1 (en) 2007-01-07 2008-07-17 Apple Inc. Application programming interfaces for gesture operations
US20080195388A1 (en) 2007-02-08 2008-08-14 Microsoft Corporation Context based word prediction
US20080207130A1 (en) 2007-02-28 2008-08-28 Brother Kogyo Kabushiki Kaisha Communication Apparatus And Communication System
US20080218489A1 (en) 2007-03-07 2008-09-11 Jong-Woung Park Display device and method of driving the same
WO2008148021A2 (en) 2007-05-25 2008-12-04 Microsoft Corporation Selective enabling of multi-input controls
JP2008312153A (en) 2007-06-18 2008-12-25 Pioneer Electronic Corp Operation control system for av equipment
WO2009018314A2 (en) 2007-07-30 2009-02-05 Perceptive Pixel, Inc. Graphical user interface for large-scale, multi-user, multi-touch systems
US20090051671A1 (en) 2007-08-22 2009-02-26 Jason Antony Konstas Recognizing the motion of two or more touches on a touch-sensing surface
US20090063135A1 (en) 2007-08-31 2009-03-05 Vadim Fux Handheld Electronic Device and Method Employing Logical Proximity of Characters in Spell Checking
US20110047459A1 (en) 2007-10-08 2011-02-24 Willem Morkel Van Der Westhuizen User interface
US7917584B2 (en) 2007-10-22 2011-03-29 Xcerion Aktiebolag Gesture-based collaboration
US20100267449A1 (en) 2007-11-09 2010-10-21 Wms Gaming, Inc. Interface for wagering game environments
US8171432B2 (en) 2008-01-06 2012-05-01 Apple Inc. Touch screen device, method, and graphical user interface for displaying and selecting application options
US20090207140A1 (en) 2008-02-19 2009-08-20 Sony Ericsson Mobile Communications Ab Identifying and responding to multiple time-overlapping touches on a touch panel
US20090211891A1 (en) 2008-02-21 2009-08-27 Wintek Corporation Touch panel and driving method of touch panel
US20090225039A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model programming interface
US20110310046A1 (en) 2008-03-04 2011-12-22 Jason Clay Beaver Touch Event Model
WO2009111469A2 (en) 2008-03-04 2009-09-11 Apple Inc. Touch event model programming interface
WO2009111458A1 (en) 2008-03-04 2009-09-11 Apple Inc. Touch event model for web pages
WO2009111189A1 (en) 2008-03-04 2009-09-11 Apple Inc. Touch event model
US20090225037A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model for web pages
US20130069899A1 (en) 2008-03-04 2013-03-21 Jason Clay Beaver Touch Event Model
US8174502B2 (en) 2008-03-04 2012-05-08 Apple Inc. Touch event processing for web pages
US20090225038A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event processing for web pages
US20110252307A1 (en) 2008-03-04 2011-10-13 Richard Williamson Touch Event Model Programming Interface
US20110252306A1 (en) 2008-03-04 2011-10-13 Richard Williamson Touch Event Model Programming Interface
US20090228901A1 (en) 2008-03-04 2009-09-10 Apple Inc. Touch event model
WO2009111460A1 (en) 2008-03-04 2009-09-11 Apple Inc. Touch event processing for web pages
US20090228828A1 (en) 2008-03-06 2009-09-10 Microsoft Corporation Adjustment of range of content displayed on graphical user interface
US20090231281A1 (en) 2008-03-11 2009-09-17 Microsoft Corporation Multi-touch virtual keyboard
US20090251434A1 (en) 2008-04-03 2009-10-08 N-Tring Ltd. Multi-touch and single touch detection
US8289289B2 (en) 2008-04-03 2012-10-16 N-trig, Ltd. Multi-touch and single touch detection
US20090262087A1 (en) 2008-04-22 2009-10-22 Lg Electronics Inc. Terminal and method for recognizing image therein
US20090273571A1 (en) 2008-05-01 2009-11-05 Alan Bowens Gesture Recognition
US20100177053A2 (en) 2008-05-09 2010-07-15 Taizo Yasutake Method and apparatus for control of multiple degrees of freedom of a display
US20090282332A1 (en) 2008-05-12 2009-11-12 Nokia Corporation Apparatus, method and computer program product for selecting multiple items using multi-touch
US20090284479A1 (en) 2008-05-16 2009-11-19 Microsoft Corporation Multi-Touch Input Platform
US20090309847A1 (en) 2008-06-12 2009-12-17 You I Labs, Inc. Apparatus and method for providing multi-touch interface capability
US7864037B2 (en) 2008-06-16 2011-01-04 International Business Machines Corporation Pattern-driven communication architecture
US20090322699A1 (en) 2008-06-25 2009-12-31 Sony Ericsson Mobile Communications Ab Multiple input detection for resistive touch panel
US20090322687A1 (en) 2008-06-27 2009-12-31 Microsoft Corporation Virtual touchpad
US20090322700A1 (en) 2008-06-30 2009-12-31 Tyco Electronics Corporation Method and apparatus for detecting two simultaneous touches and gestures on a resistive touchscreen
EP2141576A2 (en) 2008-07-01 2010-01-06 Sony Corporation Information processing apparatus and method for displaying auxiliary information
US20100013676A1 (en) 2008-07-15 2010-01-21 International Business Machines Corporation Presence recognition control of electronic devices using a multi-touch device
US20100020221A1 (en) 2008-07-24 2010-01-28 David John Tupman Camera Interface in a Portable Handheld Electronic Device
US20100020025A1 (en) 2008-07-25 2010-01-28 Intuilab Continuous recognition of multi-touch gestures
US20100030612A1 (en) 2008-08-01 2010-02-04 Lg Electronics Inc. Mobile terminal capable of managing schedule and method of controlling the mobile terminal
US8112299B2 (en) 2008-08-01 2012-02-07 Lg Electronics Inc. Mobile terminal capable of managing schedule and method of controlling the mobile terminal
US8135171B2 (en) 2008-08-19 2012-03-13 Au Optronics Corp. Multipoint tracking method and related device
US20100046850A1 (en) 2008-08-19 2010-02-25 Chen-Hsiang Ho Multipoint Tracking Method and Related Device
US8115744B2 (en) 2008-08-27 2012-02-14 Byd Company, Ltd. Multi-point touch-sensitive system
US20100107116A1 (en) 2008-10-27 2010-04-29 Nokia Corporation Input on touch user interfaces
EP2184673A1 (en) 2008-10-30 2010-05-12 Sony Corporation Information processing apparatus, information processing method and program
US20100146458A1 (en) 2008-12-04 2010-06-10 Nvidia Corporation Operating System Providing Multi-Touch Support For Applications In A Mobile Device
US20100149122A1 (en) 2008-12-12 2010-06-17 Asustek Computer Inc. Touch Panel with Multi-Touch Function and Method for Detecting Multi-Touch Thereof
US20100156804A1 (en) 2008-12-19 2010-06-24 Cypress Semiconductor Corporation Multi-finger sub-gesture reporting for a user interface device
US20100182248A1 (en) 2009-01-19 2010-07-22 Chun Jin-Woo Terminal and control method thereof
US20110321125A1 (en) 2009-02-10 2011-12-29 Satoshi Kyohgoku Authentication device, authentication method and program for causing computer to execute the same
US20110179380A1 (en) 2009-03-16 2011-07-21 Shaffer Joshua L Event Recognition
US9285908B2 (en) 2009-03-16 2016-03-15 Apple Inc. Event recognition
US20100235118A1 (en) 2009-03-16 2010-09-16 Bradford Allen Moore Event Recognition
US20130016039A1 (en) 2009-03-16 2013-01-17 Bradford Allen Moore Event Recognition
US20110310047A1 (en) 2009-03-16 2011-12-22 Bradford Allen Moore Event Recognition
US20110179387A1 (en) 2009-03-16 2011-07-21 Shaffer Joshua L Event Recognition
US8285499B2 (en) 2009-03-16 2012-10-09 Apple Inc. Event recognition
US20110179386A1 (en) 2009-03-16 2011-07-21 Shaffer Joshua L Event Recognition
US20100245267A1 (en) 2009-03-31 2010-09-30 Lg Electronics Inc. Mobile terminal and method of controlling the same
US20100281435A1 (en) 2009-04-30 2010-11-04 At&T Intellectual Property I, L.P. System and method for multimodal interaction using robust gesture processing
US20100283739A1 (en) 2009-05-05 2010-11-11 Microsoft Corporation Contact grouping and gesture recognition for surface computing
US20100299594A1 (en) 2009-05-21 2010-11-25 Sony Computer Entertainment America Inc. Touch control with dynamically determined buffer region and active perimeter
US20110069021A1 (en) 2009-06-12 2011-03-24 Hill Jared C Reducing false touchpad data by ignoring input when area gesture does not behave as predicted
US20110037714A1 (en) 2009-08-11 2011-02-17 Lg Electronics Inc. Method for displaying data and mobile terminal thereof
US8310459B2 (en) 2009-09-23 2012-11-13 Nokia Corporation Touch detection
US20110090257A1 (en) 2009-10-20 2011-04-21 Chueh-Pin Ko Touch Display Device, Touch Display System, and Method for Adjusting Touch Area Thereof
US20110102336A1 (en) 2009-10-30 2011-05-05 Pantech Co., Ltd. User interface apparatus and method
US20110115745A1 (en) 2009-11-13 2011-05-19 Microsoft Corporation Interactive display system with contact geometry interface
US20100085323A1 (en) 2009-12-04 2010-04-08 Adam Bogue Segmenting a Multi-Touch Input Region by User
US20110167391A1 (en) 2010-01-06 2011-07-07 Brian Momeyer User interface methods and systems for providing force-sensitive input
US20110181526A1 (en) 2010-01-26 2011-07-28 Shaffer Joshua H Gesture Recognizers with Delegates for Controlling and Modifying Gesture Recognition
US8140570B2 (en) 2010-03-11 2012-03-20 Apple Inc. Automatic discovery of metadata
US8296332B2 (en) 2010-04-01 2012-10-23 Apple Inc. Visual manipulation of database schema
US8291344B2 (en) 2010-04-07 2012-10-16 Apple Inc. Device, method, and graphical user interface for managing concurrently open software applications
US20110252368A1 (en) 2010-04-07 2011-10-13 Freddy Allen Anzures Device, Method, and Graphical User Interface for Navigation of Multiple Applications
US20130009986A1 (en) 2010-05-27 2013-01-10 Adobe Systems Incorporated Event Handling In An Integrated Execution Environment
US20110291951A1 (en) 2010-05-28 2011-12-01 Research In Motion Limited Electronic device including touch-sensitive display and method of controlling same
EP2390766A1 (en) 2010-05-28 2011-11-30 Research In Motion Limited Electronic device including touch-sensitive display and method of controlling same
US20110295596A1 (en) 2010-05-31 2011-12-01 Hon Hai Precision Industry Co., Ltd. Digital voice recording device with marking function and method thereof
JP2012014299A (en) 2010-06-29 2012-01-19 Brother Ind Ltd Image processing apparatus
US20120278725A1 (en) 2011-04-29 2012-11-01 Frequency Networks, Inc. Multiple-carousel selective digital service feeds
US20160018981A1 (en) 2014-07-17 2016-01-21 Facebook, Inc. Touch-Based Gesture Recognition and Application Navigation
US20160370987A1 (en) 2014-07-17 2016-12-22 Facebook, Inc. Touch-Based Gesture Recognition and Application Navigation

Non-Patent Citations (244)

* Cited by examiner, † Cited by third party
Title
Alien. J., "Override the GNU C library-painlessly," ibm.com, Apr. 2002, 4 pages.
Alien. J., "Override the GNU C library—painlessly," ibm.com, Apr. 2002, 4 pages.
Anonymous, "Firegestures Version History," Internet Article, Oct. 28, 2009, 6 pages, http://addons.mozilla.org/en-US/firefox/addons/version/6366.
Anonymous, "Firegestures," Internet Article, Oct. 27, 2009, 2 pages, http://xuldev.org/firegestures/.
Anonymous, "Firegestures: Changelog," Internet Article, Oct. 28, 2009, 8 pages, http://xuldev.org/firegestures/changelog.php.
Apple, "Safari Web Content Guide for iPhone," Apple Inc., Feb. 5, 2005, 96 pages.
Brown et al., "Distributed active objects," Computer Networks and ISDN Systems, North Holland Pubiishing, Amsterdam, NL, vol. 28, No. 11, May 1996, pp. 1037-1052.
Buxton, W. at al., "Multi-Touch Systems that l Have Known and Loved," Jan. 12, 2007, 14 pages, http://lwww.billbuxton.com/multitouchOverview.html.
Certificate of Examination dated May 7, 2012, received in Australian Patent No. 2011101154, which corresponds to U.S. Appl. No. 12/042,318, 1 page (Beaver).
Certificate of Examination dated May 8, 2012 received in Australian Patent No. 2011101155, which corresponds to U.S. Appl. No. 12/042,318, 1 page (Beaver).
Certificate of Examination dated May 8, 2012 received in Australian Patent No. 2011101157, which corresponds to U.S. Appl. No. 12/042,318, 1 page (Beaver).
Certificate of Examination dated May 8, 2012, received in Australian Patent No. 2011101156, which corresponds to U.S. Appl. No. 12/042,318, 1 page (Beaver).
Certificate of Grant dated Nov. 30, 2012, received in Hong Kong Patent Application No. 11110416.2, which corresponds to U.S. Appl. No. 12,042,318, 1 page (Beaver).
Certificate of Grant, dated Nov. 24, 2016, received in Australian Patent Application No. 2013242854, which corresponds with U.S. Appl. No. 12/042,318, 1 page.
Charter, D., "Apple releases iOS 4.3 beta for developers," Macworld.com, Jan. 12, 2011, http://www.macworld.com/article/1157114/ios-4-3.html, 7 pages.
Charter, D., "Apple releases iOS 4.3 beta for developers," Macworld.com, Jan. 12, 2011, http://www.macworld.com/article/1157114/ios—4—3.html, 7 pages.
Chen, T., "The Web is Everywhere," IEEE Communications Magazine, Feb. 5. 2008, 1 page.
Decision to Grant dated Jul. 26, 2012, received in European Patent Application No. 11150786.9, which corresponds to U.S. Appl. No. 12/042,318, 1 pages (Beaver).
Decision to Grant dated Jul. 27, 2012, received in Japanese Patent Application No. 2009080377, which corresponds to U.S. Appl. No. 12/042,31, 4 pages (Beaver).
Decision to Grant dated Mar. 23, 2012, received in Japanese Patent Application No. 2010-502358, which corresponds to U.S. Appl. No. 12/042,299, 5 pages (Williamson).
Decision to Grant dated Nov. 1, 2013, received in Japanese Patent Application No. 2012 186775, which corresponds to U.S. Appl. No. 12/042,318, 3 pages (Beaver).
Decision to Grant dated Nov. 27, 2012, received in Chinese Patent Application No. 200980000014.0, which corresponds to U.S. Appl. No. 12,042,067, 1 page (Williamson).
European Search Report dated Apr. 21, 2009, received in European Application No. 09154313.2, which corresponds to U.S. Appl. No. 12/042,318, 6 pages (Platzer).
European Search Report dated Dec. 7, 2011, received in European Patent Application No. 11184186.2, which corresponds to U.S. Appl. No. 12/588,660, 6 pages (Moore).
European Search Report dated Feb. 28, 2013, received in European Patent Application No. 12188748.3, which corresponds to U.S. Appl. No. 12/042,067, 8 pages (Williamson).
European Search Report dated Jan. 13, 2012, received in European Patent Application No. 11184224.1, which corresponds to U.S. Appl. No. 12/042,299, 7 pages (Williamson).
European Search Report dated Jan. 13, 2012, received in European Patent Application No. 11184226.6, which corresponds to U.S. Appl. No. 12/042,299, 7 pages (Williamson).
European Search Report dated Jul. 9, 2012, received in European Patent Application No. 12156395.1, which corresponds to U.S. Appl. No. 12/042,318, 8 pages (Beaver).
European Search Report dated Nov. 18, 2011, received in European Patent Application No. 11184170.6, which corresponds to U.S. Appl. No. 12/042,318, 6 pages (Beaver).
European Search Report dated Nov. 18, 2011, received in European Patent Application No. 11184172.2, which corresponds to U.S. Appl. No. 12/042.318, 6 pages (Beaver).
European Search Report dated Nov. 23, 2011, received in European Patent Application No. 11184167.2, which corresponds to U.S. Appl. No. 12/042.318, 6 pages (Beaver).
European Search Report dated Nov. 24, 2011, received in European Patent Application No. 11184169.8, which corresponds to U.S. Appl. No. 12/042,318, 6 pages (Beaver).
European Search Report dated Nov. 30, 2011, received in European Patent Application No. 11184409.8, which corresponds to U.S. Appl. No. 12/042,318, 6 pages (Beaver).
Ex parte reexamination communication transmittal form, dated Jul. 26, 2013, received in Reexamination No. 90/012,332, 61 pages.
Final Office Action dated Feb. 14, 2013, received in U.S. Appl. No. 13/221,837, 17 (Blumenberg).
Final Office Action dated Jul. 19, 2013, received in U.S. Appl. No. 12/892,851, 21 pages (Dale).
Final Office Action dated Jul. 28, 2011 received in U.S. Appl. No. 12/042,067 (Williamson).
Final Office Action dated Jul. 5, 2012, received in U.S. Appl. No. 13/251,146, 28 pages (Blumenberg).
Final Office Action dated Jul. 5, 2012, received in U.S. Appl. No. 13/251,150, 36 pages (Blumenberg).
Final Office Action dated Jul. 8, 2011, received in U.S. Appl. No. 12/042,299 (Williamson).
Final Office Action dated Jul. 9, 2012, received in U.S. Appl. No. 13/251,121, 30 pages (Blumenberg).
Final Office Action Dated Jun. 20, 2012, received in U.S. Appl. No. 13/251,152, 24 pages (Blumenberg).
Final Office Action dated Jun. 20, 2013, received in U.S. Appl. No. 13/084,472, 20 pages (Crumly).
Final Office Action dated Mar. 1, 2013, received in U.S. Appl. No. 11/620,715, 25 pages (Platzer).
Final Office Action dated Mar. 12, 2012, received in U.S. Appl. No. 11/620,727, 21 pages (Blumenberg).
Final Office Action dated Mar. 7, 2013, received in U.S. Appl. No. 11/620,727, 23 pages (Blumenberg).
Final Office Action dated May 15, 2013, received in U.S. Appl. No. 13/221,836, 27 pages (Blumenberg).
Final Office Action dated Nov. 13, 2009, received in U.S. Appl. No. 11/620,709.
Final Office Action dated Nov. 17, 2009, received in U.S. Appl. No. 11/620,723.
Final Office Action dated Oct. 18, 2013, received in U.S. Appl. No, 13/251,152, 38 pages (Blumenberg).
Final Office Action dated Oct. 2, 2013, received in U.S. Appl. No. 13/251,146, 24 pages (Blumenberg).
Final Office Action dated Sep. 15, 2011, received in U.S. Appl. No. 12/042,318 (Beaver).
Final Office Action dated Sep. 23, 2013, received in U.S. Appl. No. 13/251,121, 28 pages (Blumenberg).
Final Office Action dated Sep. 9, 2013, received in U.S. Appl. No. 13/077,931, 30 pages (Shaffer).
Final Office Action, dated Mar. 7, 2014, received in U.S. Appl. No. 12/789,684, 23 pages.
Flanagan, D., "JavaScript," 5th Edition, O'Reilly Japan, Jan. 31, 2008, pp. 405-437, (No English translation provided).
Grant for Invention Patent dated Mar. 22, 2011, received in Chinese Patent Application No. ZL200910118596.4, which corresponds to U.S. Appl. No. 12/042,318 (Beaver).
Han, J., "Jeff Han demos his breakthrough touchscreen," TED ideas worth spreading, Feb. 25, 2006, http://www.ted.com/talks/jeff-han-demos-his-breakthrough-touchscreen.html.
Han, J., "Jeff Han demos his breakthrough touchscreen," TED ideas worth spreading, Feb. 25, 2006, http://www.ted.com/talks/jeff—han—demos—his—breakthrough—touchscreen.html.
International Preliminary Report on Patentability dated Dec. 27, 2012, received in International Patent Application No. PCT/US2011/039583, which corresponds to U.S. Appl. No. 12/892,848, 10 pages (Dale).
International Preliminary Report on Patentability dated Jul. 4, 2013, received in International Patent Application No, PCT/US2011/085859, which corresponds to U.S. Appl. No. 13/077,925, 18 pages (Shaffer).
International Preliminary Report on Patentability dated Jul. 7, 2009, received in International Application No. PCT/US2008/000058, which corresponds to U.S. Appl. No. 11/620,709 (Platzer).
International Preliminary Report on Patentability dated Jul. 7, 2009, received in International Application No. PCT/US2008/000060, which corresponds to U.S. Appl. No. 11/620,727 (Blumenberg).
International Preliminary Report on Patentability dated Jul. 7, 2009, received in International Application No. PCT/US2008/000069, which corresponds to U.S. Appl. No. 11/620,715 (Platzer).
International Preliminary Report on Patentability dated Jul. 7, 2009, received in International Application No. PCT/US2008/000089, which corresponds to U.S. Appl. No. 11/620,717 (Platzer).
International Preliminary Report on Patentability dated Jul. 7, 2009, received in International Application No. PCT/US2008/000103, which corresponds to U.S. Appl. No. 11/620,723 (Platzer).
International Preliminary Report on Patentability dated Sep. 16, 2010, received in International Application No. PCT/US2009/035856, which corresponds to U.S. Appl. No. 12/042,067, 8 pages (Williamson).
International Preliminary Report on Patentability dated Sep. 16, 2010, received in International Application No. PCT/US2009/035874, which corresponds to U.S. Appl. No. 12/042,299, 8 pages (Williamson).
International Preliminary Report on Patentability dated Sep. 20, 2011, received in International Application No. PCT/US2010/027118, which corresponds to U.S. Appl. No. 12/566,660, 10 pages (Moore).
International Preliminary Report on Patentability, dated Jul. 10, 2012, received in International Patent Application No. PCT/US2011/020404, which corresponds with U.S. Appl. No. 12/789,684, 5 pages.
International Search Report and Written Opinion dated Apr. 22, 2008, received in International Application No. PCT/US2008/000060, which corresponds to U.S. Appl. No. 11/620,727 (Blumenberg).
International Search Report and Written Opinion dated Dec. 13, 2011, received in International Patent Application No. PCT/US2011/039583, which corresponds to U.S. Appl. No. 12/892,848, 12 pages (Dale).
International Search Report and Written Opinion dated Jul. 3, 2009, received in International Application No. PCT/US2009/035856, which corresponds to U.S. Appl. No. 12/042,067, 15 pages (Williamson).
International Search Report and Written Opinion dated Jul. 31, 2008, received in International Application No. PCT/US2008/000058, which corresponds to U.S. Appl. No. 11/620,709 (Platzer).
International Search Report and Written Opinion dated Jun. 1, 2012, received in International Application No. PCT/US2011/065859, which corresponds to U.S. Appl. No. 13/077,925, 22 pages (Shaffer).
International Search Report and Written Opinion dated Jun. 3, 2008, received in International Application No. PCT/US2008/000103, which corresponds to U.S. Appl. No. 11/620,723 (Platzer).
International Search Report and Written Opinion dated Jun. 4, 2008, received in International Application No. PCT/US2008/000089, which corresponds to U.S. Appl. No. 11/620,717 (Platzer).
International Search Report and Written Opinion dated May 2, 2008, received in International Application No. PCT/US2008/000069, which corresponds to U.S. Appl. No. 11/620,715 (Platzer).
International Search Report and Written Opinion dated May 20, 2011, received in International Application No. PCT/US2011/022516, which corresponds to U.S. Appl. No. 12/789,695, 6 pages (Moore).
International Search Report and Written Opinion dated Nov. 11, 2009, received in International Application No. PCT/US2009/035874, which corresponds to U.S. Appl. No. 12/042,299, 7 pages (Williamson).
International Search Report and Written Opinion dated Oct. 5, 2010, received in International Application No. PCT/US2010/027118, which corresponds to U.S. Appl. No. 12/566,660, 19 pages (Moore).
International Search Report and Written Opinion, dated Jun. 1, 2011, received in International Patent Application No. PCT/US2011/020404, which corresponds with U.S. Appl. No. 12/789,684, 7 pages.
International Search Report dated Apr. 16, 2009, received in International Application No. PCT/US2009/034772 which corresponds to U.S. Appl. No. 12/042,318, 3 pages (Platzer).
Invitation to Pay Additional Fees dated Jul. 13, 2010, received in International Application No. PCT/US2010/027118, which corresponds to U.S. Appl. No. 12/566,660, 7 pages (Moore).
Invitation to Pay Additional Fees dated Mar. 12, 2012, received in International Application No. PCT/US2011/065859, which corresponds to U.S. Appl. No. 13/077,925, 10 pages (Shaffer).
iPhone Development Wiki, "UI GestureRecognizer", http://iphonedevwiki.net/index.php?title+UIGestureRecognizer&oldid=319, 3 pages.
Ivanov, "API Hooking Revealed", Code Project, www.codeproject.com/Articles/2082/API-hooking-revealed, Dec. 2, 2002, 16 pages.
Jazzmutant Sas at al., "The Lemur Owner's Manual," Oct. 31, 2005, http://www.juzzmutant .com/support-download.php, 108 pages.
Jazzmutant Sas at al., "The Lemur Owner's Manual," Oct. 31, 2005, http://www.juzzmutant .com/support—download.php, 108 pages.
Jazzmutant, "Lemur v1.3 Documentation Addendum," Mar. 22, 2005, http://www.juzzmutant.com/support-download.php, 3 pages.
Jazzmutant, "Lemur v1.3 Examples package: CursorModes.xml." Jan. 31, 2006, http://www.juzzmutant.com/supoort-download.php, 4 pages.
Jazzmutant, "Lemur v1.3 Examples package: LightStepSeq.xml," Jan. 31, 2006, http://www.juzzmutant.com/support-download.php, 5 pages.
Jazzmutant, "Support," Apr. 21, 2006, http://web.archive.org/web/20060421144624/http://www.jazzmutant.com/support-download.php, 2 pages.
Jazzmutant, "Lemur v1.3 Documentation Addendum," Mar. 22, 2005, http://www.juzzmutant.com/support—download.php, 3 pages.
Jazzmutant, "Lemur v1.3 Examples package: CursorModes.xml." Jan. 31, 2006, http://www.juzzmutant.com/supoort—download.php, 4 pages.
Jazzmutant, "Lemur v1.3 Examples package: LightStepSeq.xml," Jan. 31, 2006, http://www.juzzmutant.com/support—download.php, 5 pages.
Jazzmutant, "Support," Apr. 21, 2006, http://web.archive.org/web/20060421144624/http://www.jazzmutant.com/support—download.php, 2 pages.
Justice Floyd, "UK Royal Court of Justice: [2012] EWHC 1789 (Pat)-Extracts," Jul. 4, 2013, http://www.judiciary.gov.uk/Resources/JCO/Documents/Judgments/htc-v-apple-judgment.pdf, 26 pages.
Justice Floyd, "UK Royal Court of Justice: [2012] EWHC 1789 (Pat)—Extracts," Jul. 4, 2013, http://www.judiciary.gov.uk/Resources/JCO/Documents/Judgments/htc-v-apple-judgment.pdf, 26 pages.
KennyTM, "UIGestureRecognizer," from iPhone Development Wiki, Oct. 31, 2009, 3 pages, http://iphonedevwiki.net/index.php?title=UIGestureRecognizer&oldid=319http://iphonedevwiki.net/index.php?title=UIGestureRecognizer&action=history.
Masui et al., "Elastic Graphical Interfaces for Precise Data Manipulation," ACM Conference on Human Factors in Computing Systems (CHI '95), Apr. 1995, Conference Companion, ACM press, pp. 143-144.
Microsoft, "Microsoft Windows Software Development Kit-Update for Windows Vista," Mar. 22, 2007, http://www.microsoft.com/en-us/download/details.aspx?displaylang=en&id=23719, 26 pages.
Microsoft, "Window Styles-Microsoft Windows SDK-Screenshot," Mar. 22, 2001, 2 pages.
Microsoft, "Window Styles—Microsoft Windows SDK—Screenshot," Mar. 22, 2001, 2 pages.
Notice of Acceptance dated Jul. 3, 2013, received in Australian Patent Application No 2011205170, which corresponds to U.S. Appl. No 12/042,318, 2 pages (Beaver).
Notice of Acceptance dated Nov. 8, 2012, received in Australian Patent Application No. 2011265335, which corresponds to U.S. Appl. No. 12/042,318, 3 pages (Beaver)
Notice of Allowance dated Dec. 12, 2012, received in U.S. Appl. No. 12/042,299, 12 pages (Williamson).
Notice of Allowance dated Dec. 12, 2012, received in U.S. Appl. No. 12/869,182, 8 pages (Platzer).
Notice of Allowance dated Dec. 19, 2012, received in U.S. Appl. No. 13/464,800, 11 pages (Bolsinga).
Notice of Allowance dated Dec. 3, 2012, received in U.S. Appl. No. 13/221,830, 17 pages (Moore).
Notice of Allowance dated Jul. 20, 2010, received in U.S. Appl. No. 11/620,717.
Notice of Allowance dated Jul. 24, 2013, received in U.S. Appl. No. 13/670,378, 20 days (Beaver).
Notice of Allowance dated Jul. 26, 2012, received in U.S. Appl. No. 12/566,660, 9 pages (Moore).
Notice of Allowance dated Jun. 13, 2013, received in U.S. Appl. No. 13/077,927, 29 pages (Shaffer).
Notice of Allowance dated Jun. 27, 2013, received in U.S. Appl. No. 13/077,925, 29 pages (Shaffer).
Notice of Allowance dated Mar. 6, 2012, received in U.S. Appl. No. 12/042,237, 16 pages (Bolsinga).
Notice of Allowance dated May 15, 2013, received in U.S. Appl. No. 12/892,848, 37 pages (Dale).
Notice of Allowance dated May 23, 2012, received in U.S. Appl. No. 13/221,830, 8 pages (Moore).
Notice of Allowance dated May 24, 2012, received in U.S. Appl. No. 12/566,660, 10 pages (Moore).
Notice of Allowance dated May 29, 2013, received in Korean Patent Application No. 10-2011-7024288, which corresponds to U.S. Appl. No. 12/566,660, 2 pages (Moore).
Notice of Allowance dated Nov. 13, 2012, received in U.S. Appl. No, 15/464,800, 20 pages (Bolsinga).
Notice of Allowance dated Nov. 2, 2012, received in Canadian Patent Application No. 2755443, which corresponds to U.S. Appl. No, 12/566,680, 1 page (Moore).
Notice of Allowance dated Oct. 22, 2013, received in U.S. Appl. No, 13/867,950, 12 pages (Platzer).
Notice of Allowance dated Sep. 27, 2013, received in U.S. Appl. No. 12/042,067, 16 pages (Williamson).
Notice of Allowance, dated Aug. 14, 2015, received in U.S. Appl. No. 12/789,684, 15 pages.
Notice of Grant dated Jul. 26, 2013, received in Chinese Patent Application No. 201120580018 5, which corresponds to U.S. Appl. No. 13/077,925, 7 pages (Shaffer).
Notification of Grant dated Nov. 6, 2013, received in Chinese Patent Application No. 200980000013.6, which corresponds to U.S. Appl. No. 12/042,299, 2 pages (Williamson).
Office Action dated Apr. 1, 2009, received in U.S. Appl. No. 11/620,709.
Office Action dated Apr. 1, 2009, received in U.S. Appl. No. 11/620,723.
Office Action dated Apr. 11, 2013, received in U.S. Appl. No. 13/251,146, 35 pages (Blumenberg).
Office Action dated Apr. 22, 2013, received in Chinese Patent Application No. 201120580018.5, which corresponds to U.S. Appl. No. 13/077,925, 4 pages (Shaffer).
Office Action dated Apr. 23, 2013, received in U.S. Appl. No. 13/251,152, 29 pages (Blumenberg).
Office Action dated Aug. 10, 2010, received in German Patent Application No. 11 2009 000 003.7, which corresponds to U.S. Appl. No. 12/042,299 (Williamson).
Office Action dated Aug. 14, 2013, received in Australian Patent Application No. 2011268047, which corresponds to U.S. Appl. No. 12/892,848, 2 pages (Dale).
Office Action dated Aug. 15, 2011, received in Japanese Patent Application No. 2010 502358, which corresponds to U.S. Appl. No. 12/042,299, 2 pages (Williamson).
Office Action dated Aug. 15, 2012, received in U.S. Appl. No. 11/620,727, 19 pages (Blumenberg).
Office Action dated Aug. 22, 2013, received in European Patent Application No. 11 727 371.4, which corresponds to U.S. Appl. No. 12/892,848, 6 pages (Dale).
Office Action dated Aug. 26, 2011, received in Japanese Patent Application No. 2009-080377, which corresponds to U.S. Appl. No. 12/042,318, 2 pages (Beaver).
Office Action dated Aug. 26, 2013, received in Chinese Patent Application No. 201110063183.8, which corresponds to U.S. Appl. No. 12/789,695, (Shaffer).
Office Action dated Aug. 29, 2012, received in U.S. Appl. No. 11/620,715. 20 pages (Platzer).
Office Action dated Aug. 5, 2013, received in Chinese Patent Application No. 201110148738.9, which corresponds to U.S. Appl. No. 12/042,318, 6 pages (Beaver).
Office Action dated Aug. 9, 2011, received in Australian Patent Application No. 2009200493, which corresponds to U.S. Appl. No. 12/042,318, 2 pages (Beaver).
Office Action dated Dec. 13, 2011, received in Australian Patent Application No. 2011101154, which corresponds to U.S. Appl. No. 12/042,318, 4 pages (Beaver).
Office Action dated Dec. 13, 2011, received in Australian Patent Application No. 2011101155, which corresponds to U.S. Appl. No. 12/042,318, 3 pages (Beaver).
Office Action dated Dec. 13, 2011, received in Australian Patent Application No. 2011101156, which corresponds to U.S. Appl. No. 12/042,318, 3 pages (Beaver).
Office Action dated Dec. 13, 2011, received in Australian Patent Application No. 2011101157, which corresponds to U.S. Appl. No. 12/042,318, 4 pages (Beaver).
Office Action dated Dec. 29, 2009, received in U.S. Appl. No. 11/620,717.
Office Action dated Dec. 5, 2012, received in Chinese Patent Application No. 200980000013.6, which corresponds to U.S. Appl. No. 12/042,299, 7 pages (Williamson).
Office Action dated Dec. 9, 2011, received in U.S. Appl. No. 12/566,660, 14 pages (Moore).
Office Action dated Feb. 16, 2011, received in U.S. Appl. No. 12/042,318, 26 pages (Beaver).
Office Action dated Feb. 22, 2012, received in Australian Patent Application No. 2011205170, which corresponds to U.S. Appl. No. 12/042,318, 3 pages (Beaver).
Office Action dated Feb. 22, 2012, received in Chinese Patent Application No. 200980000015.5, which corresponds to U.S. Appl. No. 12/042,237, 9 pages (Bolsinga).
Office Action dated Feb. 25, 2011, received in Australian Patent Application No. 2009200493, which corresponds to U.S. Appl. No. 12/042,318 (Beaver).
Office Action dated Jan. 16, 2012, received in Japanese Patent Application No. 2010-502357, which corresponds to U.S. Appl. No. 12/042,237, 2 pages (Bolsinga).
Office Action dated Jan. 18, 2011, received in U.S. Appl. No. 12/042,067 (Williamson).
Office Action dated Jan. 21, 2013, received in Chinese Patent Application No. 201110148738.9, which corresponds sto U.S. Appl. No. 12/042,318, 17 pages (Beaver).
Office Action dated Jan. 29, 2012, received in Chinese Patent Application No. 2008800018227, which corresponds to U.S. Appl. No. 11/620,717, 5 pages (Platzer).
Office Action dated Jan. 3, 2013, received in U.S. Appl. No. 13/077,931, 24 pages (Shaffer).
Office Action dated Jan. 4, 2011, received in U.S. Appl. No. 12/042,299 (Williamson).
Office Action dated Jul. 14, 2011, received in Chinese Patent Application No. 200980000015.5, which corresponds to U.S. Appl. No. 12/042,237, 8 pages (Bolsinga).
Office Action dated Jul. 2, 2013, received in Chinese Patent Application No. 200880001827.7, which corresponds to U.S. Appl. No. 11/620,717, 7 pages (Platzer).
Office Action dated Jul. 24, 2012, received in U.S. Appl. No. 13/221,837, 25 pages (Blumenberg).
Office Action dated Jul. 26, 2013, received in European Patent Application No. 11 152 015.1, which corresponds to U.S. Appl. No. 12/789,695, 6 pages (Shaffer).
Office Action dated Jul. 3, 2013, received in Chinese Patent Application No. 200980000013.6, which corresponds to U.S. Appl. No. 12/042,299, 6 pages (Williamson).
Office Action dated Jul. 8, 2009, received in U.S. Appl. No. 11/620,717.
Office Action dated Jun. 13, 2012, received in Chinese Patent Application No. 200980000014.0, which corresponds to U.S. Appl. No. 12/042,067, 6 pages (Williamson).
Office Action dated Jun. 18, 2012, received in U.S. Appl. No. 13/464,800, 10 pages (Bolsinga).
Office Action dated Jun. 19, 2013, received in European Patent Application No. 10 712 826.8, which corresponds to U.S. Appl. No. 12/566,660, 5 pages (Moore).
Office Action dated Jun. 20, 2012, received in U.S. Appl. No. 12/869,182, 18 pages (Platzer).
Office Action dated Jun. 26, 2013 received in U.S. Appl. No. 13/867,950, 21 pages (Platzer).
Office Action dated Jun. 28, 2013, received in Australian Patent Application No. 2011209720, which corresponds to U.S. Appl. No. 12/789,695, 4 pages (Shaffer).
Office Action dated Jun. 3, 2013, received in Japanese Patent Application No. 2012500844, which corresponds to U.S. Appl. No. 12/566,660, 5 pages (Moore).
Office Action dated Jun. 6, 2012, received in Chinese Patent Application No. 200880001855.9, which corresponds to U.S. Appl. No. 11/620,715, (Platzer).
Office Action dated Jun. 6, 2012, received in Chinese Patent Application No. 200980000013.6, which corresponds to U.S. Appl. No. 12/042,299,7 pages (Williamson).
Office Action dated Jun. 7, 2013, received in U.S. Appl. No. 13/215,150, 43 pages (Blumenberg).
Office Action dated Jun. 8, 2010, received in U.S. Appl. No. 11/620,723.
Office Action dated Jun. 9, 2010, received in U.S. Appl. No. 11/620,709.
Office Action dated Mar. 14, 2013, received in U.S. Appl. No. 12/042,067, 27 pages (Williamson).
Office Action dated Mar. 2, 2011, received in European Patent Application No. 11150786.9, which corresponds to U.S. Appl. No. 12/042,318 (Beaver).
Office Action dated Mar. 20, 2013, received in U.S. Appl. No. 13/163,626, 10 pages (Williamson).
Office Action dated Mar. 22, 2013, received in U.S. Appl. No. 13/163,624, 11 pages (Williamson).
Office Action dated Mar. 4, 2013, received in U.S. Appl. No. 12/789,695, 29 pages (Shaffer).
Office Action dated Mar. 5, 2013, received in U.S. Appl. No. 13/670,378, 40 pages (Beaver).
Office Action dated Mar. 7, 2013, received in Chinese Patent Application No. 200880001855.9, which corresponds to U.S. Appl. No. 11/620,715, 21 pages (Platzer).
Office Action dated May 3, 2012 received in U.S. Appl. No. 12/042,299, 14 pages (Williamson).
Office Action dated Nov. 11, 2010, received in Chinese Patent Application No. 200880001827,7, which corresponds to U.S. Appl. No. 11/620,717, 6 pages (Platzer).
Office Action dated Nov. 21, 2012, received in U.S. Appl. No. 13/163:624, 29 pages (Williamson).
Office Action dated Nov. 26, 2010, received in European Patent Application No. 09 700 007.9, which corresponds to U.S. Appl. No. 12/402.290 (Williamson).
Office Action dated Nov. 26, 2012, received in European Patent Application No. 08 712 964.9, which corresponds to U.S. Appl. No. 11/620,717, 6 pages (Platzer).
Office Action dated Nov. 26, 2012, received in U.S. Appl. No. 13/163,326, 29 pages (Williamson).
Office Action dated Nov. 5, 2012, received in Chinese Patent Application No. 200880001855,9, which corresponds to U.S. Appl. No. 11/620,715, 22 pages (Platzer).
Office Action dated Nov. 5, 2012, received in U.S. Appl. No. 13/221,836, 31 pages (Blumenberg).
Office Action dated Oct. 15, 2010, received in European Patent Application No. 09 700 006.1, which corresponds to U.S. Appl. No. 12/042,067 (Williamson).
Office Action dated Oct. 19, 2010, received in German Patent Application No. 11 2009 000 001.0, which corresponds to U.S. Appl. No. 12/042,067 (Williamson).
Office Action dated Oct. 19, 2011, received in Chinese Patent Application No. 200980000014.0, which corresponds to U.S. Appl. No. 12/042,067, 15 pages (Williamson).
Office Action dated Oct. 19, 2012, received in Chinese Patent Application No. 201120580018.5, which corresponds to U.S. Appl. No. 13/077,925, 4 pages (Shaffer).
Office Action dated Oct. 19, 2012, received in German Patent Application No. 11 2009 000 003.7, which corresponds to U.S. Appl. No. 12/042,299, 5 pages (Williamson).
Office Action dated Oct. 22, 2012, received in Chinese Patent Application No. 201110063183.8, which corresponds to U.S. Appl. No. 12/789,895, 8 pages (Shaffer).
Office Action dated Oct. 24, 2011, received in Japanese Patent Application No. 2010-502356, which corresponds to U.S. Appl. No. 12/042,067, 2 pages (Williamson).
Office Action dated Oct. 24, 2013, received in U.S. Appl. No. 12/789,695, 24 pages (Shaffer).
Office Action dated Oct. 24, 2013, received in U.S. Appl. No. 13/163,624, 16 pages (Williamson).
Office Action dated Oct. 24, 2013, received in U.S. Appl. No. 13/163,626, 16 pages (Williamson).
Office Action dated Oct. 26, 2011, received in Chinese Patent Application No. 200980000013.6, which corresponds to U.S. Appl. No. 12/042,299, 11 pages (Williamson).
Office Action dated Oct. 30, 2012, received in European Patent Application No. 08 712 946.6, which corresponds to U.S. Appl. No. 11/620,715. 20 pages (Platzer).
Office Action dated Oct. 30, 2013, received in U.S. Appl. No. 13/221,836, 31 pages (Blumenberg).
Office Action dated Oct. 9, 2012, received in U.S. Appl. No. 12/892,851, 22 pages (Dale).
Office Action dated Oct. 9, 2012, received in U.S. Appl. No. 13/084,472, 15 pages (Crumly).
Office Action dated Sep. 11, 2012, received in Chinese Patent Application No. 200980000015.5, which corresponds to U.S. Appl. No. 12/042,237, 9 pages (Bolsinga).
Office Action dated Sep. 12, 2012, received in European Patent Application No. 11184222.5, which corresponds to U.S. Appl. No. 12/402,299, 4 pages (Williamson).
Office Action dated Sep. 12, 2012, received in European Patent Application No. 11184223.3, which corresponds to U.S. Appl. No. 12/402,299, 4 pages (Williamson).
Office Action dated Sep. 12, 2012, received in European Patent Application No. 11184224.1, which corresponds to U.S. Appl. No. 12/402,299, 4 pages (Williamson).
Office Action dated Sep. 12, 2012, received in European Patent Application No. 11184226.6, which corresponds to U.S. Appl. No. 12/402,299, 5 pages (Williamson).
Office Action dated Sep. 14, 2011, received in U.S. Appl. No. 12/042,237, 8 pages (Bolsinga).
Office Action dated Sep. 2, 2013, received in Japanese Patent Application No. 2010 502357, which corresponds to U.S. Appl. No. 12/042,237, 11 pages (Bolsinga).
Office Action dated Sep. 24, 2013, received in Japanese Patent Application No. 2012 218235, which corresponds to U.S. Appl. No. 12/042,237, 6 pages (Bolsinga).
Office Action dated Sep. 26, 2012, received in German Patent Application No. 11 2009 000 001.0, which corresponds to U.S. Appl. No. 12/042.067, 5 pages (Williamson).
Office Action dated Sep. 3, 2012, received in Australian Patent Application No. 2011265335, which corresponds to U.S. Appl. No. 12/042,318, 2 pages (Beaver).
Office Action dated Sep. 6, 2013, received in Japanese Patent Application No. 2012 088747, which corresponds to U.S. Appl. No. 12/042 299, 4 pages (Williamson).
Office Action, dated Feb. 2, 2016, received in Chinese Patent Application No. 2013105574402, which corresponds with U.S. Appl. No. 12/789,695, 5 pages.
Office Action, dated Jan. 28, 2015, received in U.S. Appl. No. 12/789,684, 29 pages.
Office Action, dated Jul. 18, 2014, received in U.S. Appl. No. 12/789,684, 29 pages.
Office Action, dated Nov. 9, 2016, received in Chinese Patent Application No. 2013105574402, which corresponds with U.S. Appl. No. 12/789,695, 3 pages.
Office Action, dated Oct. 4, 2013, received in U.S. Appl. No. 12/789,684, 19 pages.
Office Acton dated Sep. 26, 2012, received in German Patent Application No. 11 2009 000 002.9, which corresponds to U.S. Appl. No, 12/042,237, 5 pages (Bolsinga).
Patent Examination Report No. 1 dated Oct. 17, 2012, received in Australian Patent Application No. 2010226120, which corresponds to U.S. Appl. No. 12/566,660, 3 pages (Moore).
Petzoid, C., "Programming Microsoft Windows with C#," Jan. 18, 2002, 5 pages.
Pixley, "Document Object Model (DOM) Level 2 Events Specifications Version 1.0," W3C Recommendation, pp. 1-47, Nov. 13, 2000.
Pogue. D., "Windows Vista for Starters: The Missing Manual," Safari Books Online, Jan. 25, 2007, 18 pages.
Räihä, L., "Delegation: Dynamic Specialization," Proceeding of the conference on TRI-Ada '94, pp. 172-179.
Rogers, M., "It's for You! An iPhone Development Primer for the Busy College Professor," Journal of Computing Sciences in Colleges, vol. 25, No. 1, Oct. 1, 2009, pp. 94-101.
Search Report dated Jun. 2012, received in Dutch Patent Application No. 2007993, which corresponds to U.S. Appl. No. 13/077,925, 6 pages (Shaffer).
Summons to attend oral proceedings dated Oct. 30, 2013, received in European Patent Appiication No. 11184224.1, which corresponds to U.S. Appl. No. 12/042,299, 5 pages (Williamson).
Summons to attend oral proceedings dated Oct. 30, 2013, received in European Patent Application No. 09700007.9, which corresponds to U.S. Appl. No. 12/042,299, 5 pages (Williamson).
Summons to attend oral proceedings dated Oct. 30, 2013, received in European Patent Application No. 11184222.5, which corresponds to U.S. Appl. No. 12/042,299, 5 pages (Williamson).
Summons to attend oral proceedings dated Oct. 30, 2013, received in European Patent Application No. 11184223.3, which corresponds to U.S. Appl. No. 12/042,299, 5 pages (Williamson).
Summons to attend oral proceedings dated Oct. 30, 2013, received in European Patent Application No. 11184226.6, which corresponds to U.S. Appl. No. 12/042,299, 5 pages (Williamson).
Summons to oral proceedings dated Mar. 27, 2013, received in European Patent Application No. 09700008.7, which corresponds to U.S. Appl. No, 12/042,237, 4 pages (Bolsinga).
Summons to oral proceedings dated Mar. 7, 2013, received in European Patent Application No. 09700006.1, which corresponds to U.S. Appl. No. 12/042,067, 5 pages (Williamson).
Summons to oral proceedings dated May 15, 2013, received in European Patent Application No. 09154313.2, which corresponds to U.S. Appl. No. 12/042,318, 30 pages (Beaver).
Venners, "Java's Security Architecture; Java's Security Model and Built-In Safety Features," JavaWorld, Jul. 1997, 7 pages.
W3C, "Document Object Model (DOM) Level 2 Events Specification, Version 1," W3C Recommendation, Nov. 13, 2000, 48 pages.
Wikibooks, "Java Programming/Applets/Event Listeners," May 1, 2007, http://en.wikibooks.org/w/index.php?title=Java-Programming/Applets/Event-Listeners&oldid=849558, 6 pages.
Wikibooks, "Java Programming/Applets/Event Listeners," May 1, 2007, http://en.wikibooks.org/w/index.php?title=Java—Programming/Applets/Event—Listeners&oldid=849558, 6 pages.
YouTube, "A Lemurized Formula," 4:07 minute video uploaded to YouTube by Sph9000 on Dec. 12, 2007, http://youtube.com/watch?v=sHAMyQak-LM, 1 page.

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10324619B2 (en) * 2014-07-17 2019-06-18 Facebook, Inc. Touch-based gesture recognition and application navigation

Also Published As

Publication number Publication date
CN102736852A (en) 2012-10-17
US20120023509A1 (en) 2012-01-26
US20160342325A1 (en) 2016-11-24
WO2008085848A1 (en) 2008-07-17
CN102736851A (en) 2012-10-17
US20120023461A1 (en) 2012-01-26
US20080168402A1 (en) 2008-07-10
CN101578577A (en) 2009-11-11
CN102750083B (en) 2016-03-16
CN102750083A (en) 2012-10-24
US9529519B2 (en) 2016-12-27
US20110314429A1 (en) 2011-12-22
WO2008085848A9 (en) 2009-04-09
HK1177017A1 (en) 2013-08-09
US20190138181A1 (en) 2019-05-09
US20230021869A1 (en) 2023-01-26
US20200233555A1 (en) 2020-07-23
US10175876B2 (en) 2019-01-08
US9665265B2 (en) 2017-05-30
US10613741B2 (en) 2020-04-07
US11449217B2 (en) 2022-09-20
US20110314430A1 (en) 2011-12-22
US20120023443A1 (en) 2012-01-26
EP2109809A1 (en) 2009-10-21
US9575648B2 (en) 2017-02-21
US20120023460A1 (en) 2012-01-26

Similar Documents

Publication Publication Date Title
US11449217B2 (en) Application programming interfaces for gesture operations
US10817162B2 (en) Application programming interfaces for scrolling operations
US10963142B2 (en) Application programming interfaces for scrolling
US9990756B2 (en) Animations
US9183661B2 (en) Application programming interfaces for synchronization
US9600352B2 (en) Memory management

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4