US20050160357A1 - System, method, and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages - Google Patents

System, method, and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages Download PDF

Info

Publication number
US20050160357A1
US20050160357A1 US11/078,584 US7858405A US2005160357A1 US 20050160357 A1 US20050160357 A1 US 20050160357A1 US 7858405 A US7858405 A US 7858405A US 2005160357 A1 US2005160357 A1 US 2005160357A1
Authority
US
United States
Prior art keywords
note
notes
sub
user
web page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/078,584
Inventor
Kevin Rivette
Irving Rappaport
Luke Hohmann
Sandra Carrico
Andrew DeWolfe
Brent Rosenquist
David Koehn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Datacloud Technologies LLC
F Poszat HU LLC
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/155,752 external-priority patent/US5623681A/en
Priority claimed from US08/423,676 external-priority patent/US5623679A/en
Priority claimed from US08/632,801 external-priority patent/US5806079A/en
Priority claimed from US08/662,377 external-priority patent/US5799325A/en
Priority to US11/078,584 priority Critical patent/US20050160357A1/en
Application filed by Individual filed Critical Individual
Assigned to ROSE BLUSH SOFTWARE LLC reassignment ROSE BLUSH SOFTWARE LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MICROPATENT LLC
Assigned to MICROPATENT LLC reassignment MICROPATENT LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AURIGIN SYSTEMS, INC.
Assigned to AURIGIN SYSTEMS, INC. reassignment AURIGIN SYSTEMS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOEHN, DAVID, HOHMANN, LUKE, CARRICO, SANDRA L., DEWOLFE, ANDREW S., ROSENQUIST, BRENT, RIVETTE, KEVIN G., RAPPAPORT, IRVING S.
Publication of US20050160357A1 publication Critical patent/US20050160357A1/en
Assigned to INTELLECTUAL VENTURES ASSETS 151 LLC reassignment INTELLECTUAL VENTURES ASSETS 151 LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: F. POSZAT HU, L.L.C.
Assigned to DATACLOUD TECHNOLOGIES, LLC reassignment DATACLOUD TECHNOLOGIES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES ASSETS 151 LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]

Definitions

  • Web World Wide Web
  • the Web is a distributed, hypermedia system, and functions as a client-server based information presentation system.
  • Information that is intended to be accessible over the Web is stored in the form of “pages” on general-purpose computers known as “servers.”
  • servers Computer users can access a Web page using general-purpose computers, referred to as “clients,” by specifying the uniform resource locator (URL) of the page.
  • URL uniform resource locator
  • FIG. 1 illustrates a scenario involving Documents A, B, C, D, and E.
  • Document A is linked to Document B via Hyperlink B.
  • Document B is linked to Documents C and D
  • Document D is linked to Document E.
  • a user follows Hyperlinks B, C, D, and E to traverse through Documents A, B, C, D, and E using a conventional “point-and-click” methodology.
  • Hyperlinks B, C, D, and E form a trail through Documents A, B, C, D, and E.
  • This trail represents the organization of Documents A, B, C, D, and E.
  • Hyperlinks B, C, D, and E do not document or explain this trail. Accordingly, it can be said that Hyperlinks B, C, D, and E form an undocumented trail through Documents A, B, C, D, and E.
  • Some computer applications allow users to attach notes to data objects.
  • some word processors such as MICROSOFT WORD and WORD PERFECT
  • Some computer applications allow users to attach notes to their documents.
  • the user positions the cursor at the point in the document where he wishes to insert the note.
  • the user then keys in the text for the note.
  • the note is linked to the point in the document where the cursor was positioned.
  • these applications do not provide a mechanism for documenting the rationale for linking notes to data objects.
  • the link 210 conveys no information that explains the rationale for linking note 212 with cell 206 . Instead, the user must attempt to discern this rationale from the contents of note 212 and cell 206 .
  • these applications do not provide a mechanism for establishing intra or inter data object linking, such as between different spreadsheets in EXCEL or linking with a word processor data object or another computer application data object.
  • notes are intended to convey information.
  • the ability of notes to convey information is diminished if notes cannot be associated with any portions of data objects, and if notes cannot be organized and structured, and if the rationale for linking notes to data objects is not explicitly conveyed to users.
  • a system and method for enabling the organization and recordation of a person or group's thinking, work product, and data objects collected or generated during a project or task serves to institutionalize the person or group's thinking, work product, and data objects, thereby protecting against the unavailability of persons, memory loss, or loss of work product.
  • the present invention is directed to a system, method, and computer program product of linking notes to data objects.
  • the present invention is directed to a system, method, and computer program product of linking annotations (or notes or sub-notes in a note) to Web pages.
  • the invention enables a user to select a portion of a Web page stored at a Web site or from a local file system (if the portion of the Web page was cached).
  • the invention creates an annotation, and links the annotation to the selected portion.
  • the invention receives a request from a user viewing the annotation to display the selected portion linked to the annotation.
  • the invention makes a connection to the Web site, if a connection is not already created, and causes the Web site to send the Web page and present the selected portion. Also note that if the portion of the Web page was cached and thus stored in a local file system, then the present invention does not need to make a connection to a Web site.
  • the present invention also relates to organizing, bi-directionally linking, making annotations (or notes and sub-notes) on, and maintaining disparate Web pages.
  • Bi-directional links as described in this application allow the user to determine the relative location of links on Web page of the Internet or an intranet.
  • Bi-directional links as described in this application also allow the user to select a portion or section of the Web page and then make annotations on the portion of the Web page selected.
  • Bi-directional links as described in this application also link the user to the location of the selected Web page from the note or sub-note about the selected Web page.
  • the present invention relates generally to organizing, bi-directionally linking, making annotations (or notes and sub-notes) on, and maintaining disparate Web pages.
  • embodiments of the invention relate to a standalone mediator that lets users create, manage, arrange, categorize, search, customize, label, title and otherwise maintain annotations on Web pages available on the Internet without changing or manipulating the location of the Web page.
  • FIG. 1 illustrates a conventional scenario comprising linked documents
  • FIG. 2 illustrates a conventional spreadsheet application having limited note capabilities
  • FIGS. 3 and 4 illustrate a marketing related example
  • FIG. 5 is a block diagram of a Web annotation system according to a preferred embodiment of the present invention.
  • FIG. 6 is a block diagram of an exemplary computer system useful for implementing the present invention.
  • FIG. 7 illustrates the dynamic steps to establish communication between a client and a server executing an object-oriented program.
  • FIG. 7 is broken into nine (9) figures including FIG. 7A , FIG. 7B , FIG. 7C , FIG. 7D , FIG. 7E , FIG. 7F , FIG. 7G , FIG. 7H and FIG. 71 ;
  • FIG. 9 illustrates a preferred implementation of the functional objects of the present invention according to a preferred embodiment of the present invention.
  • FIG. 11 is a legend of colors/fonts and symbols used by the present invention according to a preferred embodiment
  • FIG. 14 illustrates an example file menu according to a preferred embodiment of the present invention
  • FIG. 15 illustrates an example edit menu according to a preferred embodiment of the present invention
  • FIG. 16 illustrates an example view menu according to a preferred embodiment of the present invention
  • FIGS. 17 and 18 illustrate an example options menu according to a preferred embodiment of the present invention
  • FIG. 19 illustrates an example note properties menu according to a preferred embodiment of the present invention.
  • FIG. 24 is a block diagram illustrating the effects of a user interface of the present invention according to a preferred embodiment
  • FIG. 25 illustrates the results of a replication operation according to a preferred embodiment of the present invention
  • FIG. 26 illustrates an example virtual reality environment according to an embodiment of the present invention
  • FIG. 27 illustrates the effect of security/privacy features of the invention according to a preferred embodiment
  • FIG. 28 illustrates an example implementation of the invention according to a preferred embodiment
  • FIG. 29 illustrates an example link view according to a preferred embodiment of the present invention.
  • FIG. 30 illustrates an example notes database according to a preferred embodiment of the present invention
  • FIGS. 31-42 are flowcharts depicting a preferred operation of the present invention.
  • FIG. 43 illustrates the drag and drop method of editing notes according to a preferred embodiment of the present invention
  • the present invention is directed to a system, method, and computer program product (CPP) for attaching annotations (or notes and sub-notes) to data objects, and for linking data objects via the use of annotations.
  • data objects are Web pages.
  • the note capabilities of the present invention can be used to organize, associate, annotate, and link data objects in an intra and/or inter data object environment with single notes and multiple sub-notes and/or multiple notes and sub-notes to the same data object portions or different data object portions as required by the needs of the user to institutionalize his/her knowledge. Additionally, the note capabilities of the present invention can be used to convey information explaining the rationale for such organization, association, and linkage. Accordingly, the present invention represents a system, method, and CPP for using intelligent notes to organize, associate, annotate, and link data objects. The invention can also be used to manipulate these data objects.
  • data object refers to any information in any form that can be accessed and/or processed by a computer.
  • information includes data generated and/or processed by computer applications and computer-related devices such as word processing applications, spreadsheet applications, presentation managers, database managers, financial applications, networking applications, communication applications, sound recorders and processors, video recorders and processors, on-line service applications, scanners, computer aided drafting (CAD) applications, virtual reality applications and environments, etc.
  • CAD computer aided drafting
  • the data objects generated and processed by these applications and devices vary widely in subject matter. Also, these data objects come in many forms, such as text files, image files, video files, audio files, computer programs, Web pages, etc. Accordingly, these data objects are disparate in both form and content.
  • the invention is adapted to memorialize and/or institutionalize a person's or group's thinking and work product regarding a subject. If a person's or group's thinking and work product are not memorialized or institutionalized, then such thinking and work product may be lost or not accessible when needed if the person or group becomes unavailable, or is unable to remember its thinking, or loses its work product.
  • the present invention relates generally to organizing, bi-directionally linking, making notes and sub-notes on, and maintaining disparate data objects.
  • a preferred embodiment of the present invention relates to organizing, bi-directionally linking, making notes and sub-notes on, and maintaining disparate Web pages.
  • embodiments of the invention relate to a standalone mediator that lets users create, manage, arrange, categorize, search, customize, label, title and otherwise maintain notes on Web pages available on the Internet without changing or manipulating the location of the Web page.
  • the invention shall initially be described by way of several examples.
  • a marketing expert regularly uses the Internet for research to determine if there are products that may compete with his company's software product.
  • the marketing expert first discovers company ABC's Web site that contains a Web page 302 containing a press release detailing the launch of a new ABC software product.
  • the marketing expert notices that the ABC software product appears to directly compete with his company's software product.
  • the marketing expert may or may not record his thinking 312 .
  • Web pages that provide interesting information including, a more detailed explanation on all ABC products, strategic partners to ABC, major customers of ABC, and entities that have invested in ABC. It is important to note that these Web pages could be either located on the same Web site as Web page 302 , or be located on a different Web site.
  • the expert first clicks on the link to a Web page 304 describing ABC products in more detail.
  • the expert notes some additional products that may also compete with his company's software product.
  • the expert may or may not record his thinking 314 .
  • the expert next requests a Web page 306 discussing the strategic partners of ABC.
  • the expert recalls that one of the strategic partners listed is currently talking to his company about a joint venture.
  • the expert may or may not record his thinking 316 .
  • the expert requests a Web page 308 that contains information relating to ABC's major customers.
  • the expert notes some of the same customers of his company, along with some potential customers.
  • the expert may or may not record his thinking 318 .
  • the expert requests a Web page 310 that has information relevant to ABC's past and current investors.
  • the expert recalls that one of the investors listed has recently declined an offer to invest in his company.
  • the expert may or may not record his thinking 320 .
  • the expert's overall analysis and conclusions involving the ABC company may or may not be recorded 322 .
  • the scenario described above and shown in FIG. 3 represents a conventional investigation, analysis and decision process.
  • This conventional process may or may not be documented.
  • the marketing expert's thinking during each step of the process may or may not be documented.
  • Such thinking is represented by blocks 312 , 314 , 316 , 318 , 320 , and 322 .
  • the expert may document such thinking (by writing or dictating notes, for example).
  • the expert is just as likely to maintain his thinking only in his head. In this latter case, the expert's thinking will be lost or not accessible when needed if the expert becomes unavailable, or is unable to remember his thinking.
  • the investigation, analysis, and decision process represented by FIG. 3 will not be fully documented, even if the expert documents his thinking in blocks 312 , 314 , 316 , 318 , 320 , and 322 .
  • the total work product and thinking resulting from the investigation, analysis, and decision process of FIG. 3 will not be fully documented simply by the documentation of thinking blocks 312 , 314 , 316 , 318 , 320 , and 322 . This is the case for at least two reasons. First, such documentation will be very disorganized. The documentation will not indicate how one note is related to another note. Second, such documentation will include only the expert's thinking (represented by blocks 312 , 314 , 316 , 318 , 320 , and 322 ).
  • the documentation will not include copies of the Web pages upon which such thinking was based or a reference to the exact portion (text excerpt, video section, audio segment, etc.) that is relevant to the expert's thinking and analysis. In instances with voluminous Web pages, the lack of this type of reference or the like prevents the expert from clearly communicating and recording the basis for the analysis. That is, the documentation will not include the Web pages relating to press release 302 , the detailed description of ABC company products 304 , the strategic partners 306 , the major customers 308 , and the past and current investors 310 . The documentation may contain cites to some of these Web pages, but it would be necessary for a person to manually retrieve these Web pages in order to evaluate them.
  • Such manual retrieval is inefficient, as it requires another person to perform the same tasks as the expert. Also, such manual retrieval may not be possible, since particular Web sites and/or Web pages often become unavailable over time. Further, as noted above, such cites will not be to the exact portion (text excerpt, video section, audio segment, etc.) that is relevant to the expert's thinking and analysis.
  • the invention addresses and solves the problems illustrated by the conventional investigation, analysis, and decision process of FIG. 3 .
  • the invention is adapted to memorialize and/or institutionalize the expert's total work product and thinking related to the investigation, analysis, and decision process. By doing so, the invention ensures that the expert's total work product and thinking will survive and be accessible when needed, even if the expert becomes unavailable, or is unable to remember his thinking, or loses the hard copies of his work product.
  • the operation of the invention is represented by FIG. 4 .
  • the invention allows the expert to create a note 401 comprising multiple sub-notes 402 , 404 , 406 , 408 , 410 , and 412 .
  • the expert records his thinking in these sub-notes 402 , 404 , 406 , 408 , 410 , and 412 .
  • the expert reviews the press release 302 and notices that the ABC software product appears to be very similar to his company's software product.
  • the expert records his thinking regarding the press release 302 and the potential competition between the ABC software product and the expert's company product sub-note 402 .
  • the sub-notes 402 , 404 , 406 , 408 , 410 , and 412 are linked to the relevant portions of the Web pages upon which the expert's thinking is based. Such linkage is represented by links 430 , 432 , 434 , 436 , 438 , and 440 .
  • the expert links sub-note 402 to the relevant portion of the press release 302 .
  • the expert records his thinking regarding the other products in 404 .
  • the expert links sub-note 404 to that relevant portion of the ABC's other products 304 containing the competitive products.
  • the sub-notes 402 , 404 , 406 , 408 , 410 , and 412 and the links 430 , 432 , 434 , 436 , 438 , and 440 collectively represent the expert's total work product and thinking.
  • the sub-notes 402 , 404 , 406 , 408 , 410 , and 412 and the links 430 , 432 , 434 , 436 , 438 , and 440 are stored in a computer database.
  • the invention memorializes and/or institutionalizes the expert's total work product and thinking.
  • the marketing expert can categorize the notes he makes on the Web site(s) by color and by the shape of the bi-directional hyperlink he associates with the part of the Web page he has selected.
  • the expert stores these notes on his own computer and the Web site is left unmarred.
  • the expert can revise the content of the notes and then decides which company strategist should receive which copies of the notes and Web pages.
  • the notes he has made on the Web site can be shared in their entirety, by note (a collection of sub-notes), by type (based on a pre-set or user-defined filter), or by sub-note.
  • the expert may decide to send a copy of the notes on strategic partners 406 to his Vice-President of Marketing, a copy of the notes on major customers 408 to his Vice President of Sales, and a copy of the notes on past and current investors 410 to his CEO. He also informs his marketing department that he has stored all of his notes on a public directory for all of the members of the marketing department to read and further develop.
  • the present invention allows the marketing expert to remark on any location on the Internet and choose the people he would like to securely view his notes.
  • the present invention notifies the marketing expert when the Web page has changed in one or both of the following ways.
  • the marketing expert can be notified that the Web page changes its content when the user is notified by e-mail of a change in the data object.
  • the marketing expert can be notified that the Web page has changed its content when he activates a bi-directional link intended to take him from his note or sub-note to the Web page, and the marketing expert will have the option of re-linking his notes to locations on the changed Web page.
  • the Web page of the recipe of interest to the chef appears with all of the customer's notes listed and color-coded.
  • the chef uses this information and tries the recipe. He adds several more tips about equipment and adds a new color for a new category of notes titled Customer Feedback. He then uses the present invention to send this new set of notes to several other chefs and to the customer who sent the original notes. Now all the people that receive the e-mail can view the same URL and the same set of notes and make notes of their own. Some they can store locally, others they can store on a network, and of both sets of notes they can choose which ones or which set of notes to send to others. They may choose to send a single sub-note, several sub-notes, or a full note containing any number of combinations of additional notes and sub-notes.
  • the chef can save his notes and sub-notes and print them individually or in sets or even related sets based on his own needs.
  • the chef may later receive notes from the people he sent his notes to; he can view those notes on the recipe Web page and include the notes sent to him in his own collection of notes and sub-notes.
  • the invention is preferable implemented using a Web annotation system 502 ( FIG. 5 ).
  • the Web annotation system 502 is described in the following section.
  • FIG. 5 is a block diagram of a Web annotation system 502 according to a preferred embodiment of the present invention.
  • the Web annotation system 502 includes a user interface 504 , a notes engine 506 , a Web pages engine 509 , a notes database 508 , and a Web pages database 509 .
  • the notes database 508 includes annotations (also called notes and sub-notes or note sections) that are attached to Web pages generated and/or processed by applications 512 .
  • the Web pages database 509 may be used to store Web pages, or a Web page's images or its text, that are associated with notes stored in notes database 508 for greater speed in re-loading the data objects when the user returns to the note or sub-note on the Web page.
  • the applications 512 include any computer applications that generate and/or process information accessible via the Internet.
  • the notes engine 506 manages the notes database 508 . More particularly, the notes engine 506 enables users to create, modify, delete, link, view, create hierarchies of annotations (or notes and sub-notes), categorize, classify, view the location or address of the selected Web page, view the name or title of the selected Web page, re-link notes to changed Web pages, and otherwise manipulate the notes and sub-notes in the notes database 508 . Users gain access to the functions supported by the notes engine 506 via the user interface 504 .
  • the Web pages engine 507 manages the Web pages database 509 . More particularly, the Web pages engine 507 enables users to cache or store, or otherwise maintain, Web pages and parts of Web pages stored in Web pages database 509 for greater speed in re-loading the Web page when the user returns to the note or sub-note on the Web page.
  • the caching feature of the present invention means that the present invention does not need to make a connection to a Web site. Users gain access to the functions supported by the Web pages engine 507 via the user interface 504 .
  • the Web annotation system 502 drives, controls, manipulates, and otherwise interacts with the applications 512 .
  • the Web annotation system 502 controls the applications 512 so as to open Web pages (i.e., access Web sites containing Web pages), display particular portions of Web pages, highlight portions of Web pages using particular fonts, patterns, and/or colors, display icons and/or buttons, etc.
  • the present invention achieves this functionality by interacting with applications 512 that support an interface 510 defining the interaction between computer applications.
  • the interface 510 uses the Object Linking Embedded (OLE) standard.
  • OLE Object Linking Embedded
  • the OLE standard is well known and defines the manner in which one software application may drive, control, manipulate, and otherwise interact with another software application.
  • the OLE standard is described in many publicly available documents, such as Microsoft OLE Programmers Reference, Volumes I and II, 1993, which are herein incorporated by reference in their entirety.
  • the OLE standard is based on the Component Object Model (COM).
  • COM Component Object Model
  • the COM enables programmer to develop objects that can be accessed by any COM-compliant application.
  • the interface 510 uses JScript and Dynamic HTML (DHTML) standards. Both of these standards are also based on the COM, as the OLE standard discussed above.
  • JScript is Microsoft's extended implementation of ECMAScript (ECMA262), an international standard based on the Netscape's JavaScript and Microsoft's JScript languages.
  • JScript is implemented as a Windows Script engine. This means that it can be “plugged in” to any application that supports Windows Script, such as Internet Explorer, Active Server Pages, and Window Script Host. It also means that any application supporting Windows Script can use multiple languages, including JScript, VBScript, Perl, and others. JScript can be used for both simple tasks (such as mouseovers on Web pages) and for more complex tasks (such as updating a database with ASP or running logon scripts for Windows NT).
  • dynamic HTML refers to Web content that changes each time it is viewed. For example, the same URL could result in a different page depending on any number of parameters, such as: geographic location of the user, time of day, previous pages viewed by the user, and profile of the user.
  • DHTML refers to new HTML extensions that will enable a Web page to react to user input without sending requests to the Web server.
  • the applications 512 can be any conventional or implementation specific applications, as long as they have the capability of being externally controlled (in this case, as long as they have the capability of being controlled by the Web annotation system 502 ).
  • Standard windows operations are mentioned in this disclosure. Such operations include selecting text, opening files, moving between windows, resizing windows, editing documents, etc. Such operations are well known and are described in many publicly available documents, such as Microsoft Word for Windows Users Guide, 1994, incorporated herein by reference in its entirety.
  • components of the present invention are each implemented using a computer system 602 such as that shown in FIG. 6 .
  • the computer system 602 includes one or more processors, such as a processor 604 .
  • the processor 604 is connected to a communication bus 606 .
  • the computer system 602 also includes a main or primary memory 608 , preferably random access memory (RAM).
  • the primary memory 608 has stored therein control logic 610 , such as software corresponding to the Web annotation system 502 , the notes database 508 , and the Web pages database 509 .
  • notes database 508 and/or the Web pages database 509 are not necessarily stored within a single computer. Instead, the notes database 508 and/or the Web pages database 509 may be distributed among multiple computers. Such distribution of the notes database 508 and/or the Web pages database 509 are described in further detail below.
  • the computer system 602 also includes a secondary memory 612 .
  • the secondary memory 612 includes, for example, a hard disk drive 614 and/or a removable storage drive 616 , representing a floppy disk drive, a magnetic tape drive, a compact disk drive, a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as EPROM or PROM), etc., which is read by and written to by removable storage unit 618 .
  • the removable storage unit 618 includes a computer usable storage medium having stored therein computer software and/or data.
  • the removable storage drive 616 reads from and/or writes to a removable storage unit 618 in a well known manner.
  • Removable storage unit 618 also called a program storage device or a computer program product, represents a floppy disk, magnetic tape, compact disk, etc.
  • Computer programs are stored in main memory 608 and/or the secondary memory 612 . Such computer programs, when executed, enable the computer system 602 to perform the functions of the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor 604 to perform the functions of the present invention. Accordingly, such computer programs represent controllers of the computer system 602 .
  • the Web annotation system 502 preferably represents a computer program executing in the computer system 602 .
  • the computer system 602 also includes a communication interface 620 .
  • the communications interface 620 enables the computer system 602 to communicate and interact with locally or remotely located external devices 624 via a communications medium 622 .
  • communications interface 620 enables the computer system 602 to send and receive software and data to/from the external devices 624 .
  • Examples of the communications interface 622 include a modem, a network interface (such as an Ethernet card), a communications port, etc.
  • the computer system 602 also includes a display unit 626 , such as a computer monitor, and one or more input devices, such as a keyboard and a pointing device (such as a mouse, trackball, etc.).
  • a display unit 626 such as a computer monitor
  • input devices such as a keyboard and a pointing device (such as a mouse, trackball, etc.).
  • the invention is directed to a system 602 as shown in FIG. 6 , and having the functionality described herein.
  • the invention is directed to a computer program product having stored therein computer software (having the functionality described herein) for controlling computer systems, such as computer system 602 .
  • the invention is directed to a system and method for transmitting and/or receiving computer software (having the functionality described herein) to/from external devices 624 .
  • Object-oriented programming is a type of programming in which programmers define not only the data type of a data structure, but also the types of operations (functions) that can be applied to the data structure. In this way, the data structure becomes an object that includes both data and functions.
  • programmers can create relationships between one object and another. For example, objects can inherit characteristics from other objects.
  • object-oriented programming techniques enable programmers to create modules that do not need to be changed when a new type of object is added.
  • a programmer can simply create a new object that inherits many of its features from existing objects. This makes object-oriented programs easier to modify.
  • object-oriented programming language OOPL
  • C++ and Smalltalk are two of the more popular languages, and there are also object-oriented versions of Pascal. While a preferred embodiment of the present invention is implemented using computer programs written in an object-oriented programming language, the present invention can also be implemented using procedural programming languages, etc.
  • a preferred embodiment of the present invention uses a type of network architecture called a peer-to-peer object architecture.
  • client/server architecture is a network architecture in which each computer or process on the network is either a client or a server.
  • Servers are computers or processes dedicated to managing disk drives (file servers), printers (print servers), applications/functions or network traffic (network servers).
  • a server is any computer or device that allocates resources for an application.
  • Clients are personal computers or workstations on which users run applications. Clients rely on servers for resources, such as files, devices, execution of functions and even processing power.
  • FIG. 7 illustrates an example of the dynamic steps to establish communication that occur between a client and a server executing an object-oriented program.
  • the server has switchboard object 702 and listen object 704 waiting for a request from the client.
  • init object 706 determines that it needs to perform a specific task.
  • init object 706 creates comm object 708 .
  • Comm object 708 is used to communicate with the server.
  • comm object 708 makes a connection to listen object 704 in FIG. 7D .
  • listen object 710 creates comm object 710 and relocates comm object 710 to switchboard object 702 .
  • Comm object 710 is used to communicate back to the client (i.e., between the two piers), via comm object 708 .
  • FIG. 7F there is two-way communication between the client and the server (i.e., between the two piers) through comm object 708 and comm object 710 .
  • Init object 706 knows which receiver object needs to be created by the server (i.e., receiving pier) to preform the specific task required. Therefore, once this communication is established, init object 706 sends a request to the server (i.e., receiving pier) to create the specific receiver object.
  • switchboard object 702 receives the request, via comm object 710 , and creates receiver object 712 . Once receiver object 712 is created, comm object 710 is relocated to receiver object 712 in FIG. 7H .
  • FIG. 7I init object 706 and receiver object 712 , via comm object 708 and comm object 710 , can communicate back and forth until receiver object 712 completes the task requested by init object 706 .
  • a preferred embodiment of the present invention uses a type of network architecture called a peer-to-peer object architecture.
  • a peer-to-peer object architecture is when each computer in the network has equivalent capabilities and responsibilities. This differs from client/server architectures, in which some computers are dedicated to serving the others. Therefore, in a preferred embodiment of the present invention, all computers 602 can operate as either a server or a client.
  • one advantage of using an object-oriented programming language is that it allows programmers to create modules that do not need to be changed when a new type of object is added. This advantage will be further illustrated as the present invention is described in detail.
  • Web annotation system 502 is implemented as computer 602 operating as described in reference to FIG. 6 above.
  • Computer 602 executes computer programs to enable it to perform the features and capabilities (or functions) of the present invention.
  • Web annotation system 502 executes computer programs to perform its functions.
  • the computer programs executed by Web annotation system 502 are preferably written in an object-oriented programming language and executed in a peer-to-peer object architecture.
  • An advantage of any object-oriented program, and thus also with computer programs executed by Web annotation system 502 is that they enable programmers to create modules that do not have to be changed when a new type of object is added.
  • An object includes both the data and functions required to perform a task.
  • This implementation of the present invention reduces complexity and thus increases efficiency.
  • FIG. 7 shows a generic init object 706 and a generic receiver object 712 .
  • init object 706 and receiver object 712 are replaced by specific init and receiver objects that perform their specific functions.
  • Web annotation system 502 The types of functions performed by Web annotation system 502 , through the execution of computer software, note/sub-note organization, linking sub-notes to Web pages, viewing notes, sub-notes and Web pages, editing note/sub-note organization, and so forth.
  • the figures used to illustrate the individual functions of Web annotation system 502 do not include switchboard object 702 and listen object 704 of FIG. 7 .
  • FIG. 8 is a high level view of the functional objects of the Web annotation system 502 in a preferred embodiment of the present invention.
  • the functional objects are organized in a hierarchical fashion and each functional object contains a data object wrapper that supports a COM interface and a data object.
  • the functional objects include a Web annotation system object 802 , a note repository object 804 , a note object 806 , a sub-note object 808 , a content object 810 , an anchor object 812 , a Web page repository object 814 , a Web page folder object 816 , and a Web page object 818 .
  • the content object 810 stores data that conveys information. This data is user definable and includes at least information that explains the rationale for linking the sub-note object 808 to a portion of the Web page object 818 .
  • the data stored in the content object 810 can be any format or combination of formats, such as text, sound, video, image, executable program, tactile (such as braille), etc.
  • the anchor object 812 is linked by a bookmark link 820 to a portion of the Web page object 818 . According to the present invention, the bookmark link 820 is bi-directional.
  • Each note object 806 preferably contains data including its title, the date and time of creation, the data and time of last modification, a listing of all of its sub-notes, etc.
  • Each sub-note object 808 also preferably stores data including its title, the date and time of creation, the data and time of last modification, its content object, its anchor object, privacy settings, etc.
  • the anchor object 812 contains data indicating the color and which pen was highlighted when the pointer was used to select the selected portion to which the sub-note is linked.
  • the anchor object 812 also stores data representing the data object that the sub-note object 808 is linked with.
  • This data may include a URL for non-cached Web pages and a filename for cached Web pages, a frame index array to the frame that contains the annotation, apiece of data (e.g., TextRange bookmark) that describes a text selection on the given frame of the given Web page, pixels that get printed to a screen, etc.
  • apiece of data e.g., TextRange bookmark
  • a frame index array is a collection of indexes that specify a frame. For example, a simple Web page may contain only one frame. The present invention would indicate this with an empty frame index array. Another example for a Web page that has three frames, and it is the second frame that is annotated by the present invention, the frame index array contains the number 1. (Note that arrays start with an index of 0).
  • the present invention may utilize at least four different ways to specify the selected text. An preferred way is through the use of a TextRange. A TextRange can be created from the current selection. A TextRange can be persisted to a “bookmark” (such as bookmark link 820 ), which is an opaque piece of data that represents the TextRange.
  • the present invention maintains a character offset to the start of the range, and then the number of characters in the TextRange.
  • the present invention maintains a collapsed TextRange bookmark to start the selected text or portion, and the number of characters in the TextRange.
  • the present invention maintains a collapsed TextRange bookmark to the start of the selected text or portion, and another collapsed TextRange bookmark to the end of the selected text.
  • note repository object 804 note object 806 , sub-note object 808 , content object 810 , and anchor object 812 make up the notes database 508 ( FIG. 5 ).
  • Web page repository object 814 Web page folder object 816 , and Web page object 818 conceptually make up Web pages database 509 .
  • the user interface 504 creates, updates, and deletes objects in the Web annotation system 502 preferably using the COM interfaces. In order to do this, the user interface 504 must first gain access to a functional object through the top level object, namely the Web annotation system object 802 .
  • the Web annotation system object 802 can return to the user interface 504 the note repository object 804 and/or the Web page repository object 814 . Once the user interface 504 has either the note repository object 804 or the Web page repository object 814 , it can use either of these (based on its interface) to: navigate to other objects, create child objects, remove child objects, and modify child objects.
  • Each of the functional objects 802 - 818 shown in FIG. 8 preferably follows a pattern of implementation as shown in FIG. 9 .
  • the user interface 504 uses a COM interface 902 to access a generic functional object 903 (same as described above).
  • the functional object 903 contains a data object wrapper 906 that supports the COM interface 902 and a data object 908 that can be stored in either a flat file 910 or a database 912 .
  • the functional object 903 uses the data access interface 904 to access the data object 908 .
  • the data access interface 904 could go across a network connection to access the data object 908 , or it could access the data object 908 stored physically on the same computer.
  • the present invention includes a multitude of functions which enable it to achieve the advantages discussed herein. Many of these functions are discussed in the following sections.
  • the present invention supports a note/sub-note hierarchy, where a note may include zero or more sub-notes. This is shown in FIG. 29 , for example, where Note A includes Sub-notes A, B, and C. Note B includes Sub-notes B and C (dashed line 2950 B is discussed below), Note C includes Sub-notes B, D, and E, and Note D includes Sub-notes E and F.
  • the note/sub-note hierarchy is useful for organizing information.
  • the note/sub-note hierarchy allows users to group together related sub-notes for organization purposes. Related sub-notes may be grouped together under one note.
  • the note/sub-note hierarchy is extendable to multiple-levels. For example, related notes can be grouped together under a note grouping. In essence, a note itself is also an implementation of a note grouping because a note can contain other notes (or sub-notes).
  • FIG. 29 for example, Notes A and B are grouped together under Note Grouping A. Notes B, C, and D are grouped together under Note Grouping B. The sharing of Note B between Note Grouping A and Note Grouping B is one embodiment of the present invention. In another embodiment, notes and/or sub-notes are not shared. It should be understood that the invention is not limited to the three level hierarchy shown in the example of FIG. 29 . The invention is extendable to more than three levels.
  • the note/sub-note hierarchy of the invention is very flexible. Multiple note groupings may include the same note. For example, both Note Groupings A and B include Note B. Also, multiple notes may include the same sub-note. For example, Notes A, B, and C include Sub-note B.
  • the note/sub-note hierarchy is defined by users. That is, users define which notes are contained in note groupings, and which sub-notes are contained in notes.
  • the invention includes tools for enabling users to define and modify the note/sub-note hierarchy (such tools are discussed below).
  • the present invention allows users to link sub-notes to portions of data object, preferably Web pages.
  • Sub-note A is linked to a portion of Web Page A via link 2911 .
  • a Web page (or data object) represents any information in any form that can be accessed and/or processed by a computer via the Internet.
  • the Web pages generated and processed by these applications and devices vary widely in subject matter.
  • these Web pages (or data objects in general) come in many forms, such as text files, image files, video files, audio files, computer programs, HTML documents, etc. Accordingly, these Web pages are disparate in both form and content.
  • Users can navigate from sub-notes to Web pages via the links. For example, a user can navigate from Sub-note A to Web Page A via link 2911 .
  • the links between sub-notes and Web pages are bidirectional.
  • users can also navigate from Web pages to sub-notes via the links. For example, a user can navigate from Web Page A to Sub-note A via link 2911 .
  • a note or sub-note may be linked to all or any portion of a Web page. (In the discussion contained herein, attributes of sub-notes also apply to notes.) Multiple sub-notes may be linked to portions of the same Web page. This is true, whether the sub-notes are in the same or different notes. These Web page portions may be completely overlapping, partially overlapping, or non-overlapping. Also, the sub-notes in a note may be linked to portions of a single Web page, or to portions of one or more Web pages.
  • a Web page may be linked to one or more sub-notes (these sub-notes may be in the same note, or in multiple notes).
  • Web page A is linked to Sub-notes A, C, and D.
  • a user can navigate from Sub-note A in Note A to Sub-note D in Note C via Web Page A, which is linked to both Sub-note A (via link 2911 ) and Sub-note D (via link 2917 ).
  • the Web annotation system 502 in the example of FIG. 10 includes notes 1014 A and 1014 B (these notes are stored in the notes database 508 , which is not explicitly shown in FIG. 10 ).
  • Each note 1014 includes a plurality of sub-notes 1016 .
  • Each sub-note 1016 is linked to a Web page 1020 .
  • Each Web page 1020 is associated with one or more applications 512 .
  • a Web page 1020 is associated with an application 512 if the application 512 is capable of accessing and/or processing the Web page 1020 .
  • each sub-note 1016 is linked to a portion 1022 of a Web page 1020 .
  • a portion 1022 may include all or part of a Web page 1020 .
  • Portions 1022 in the same Web page 1020 that are linked to sub-notes 1016 may be distinct (non-overlapping), may completely overlap, or may partially overlap.
  • each Web page is associated with a single computer program application.
  • This association between Web pages and applications may be established in any well known manner, such as by file extension. For example, all files having a “wpd” extension are as a default associated with the WORD PERFECT word processing application, all files having a “wks” extension are as a default associated with the LOTUS 1-2-3 spreadsheet application, all files having a “db” extension are as a default associated with the PARADOX database application, etc.
  • These default associations between Web pages and applications are preferably user definable. Preferably, users may override these default associations at the time that a sub-note is linked with a Web page, or at any time thereafter.
  • a note 1014 may contain sub-notes 1016 that are linked to portions 1022 of a single Web page 1020 , or multiple Web pages 1020 . These Web pages 1020 may be associated with a single application 512 , or with multiple applications 512 .
  • note 1014 A includes sub-notes 1016 A, 1016 B, 1016 C that are linked to portions 1022 A, 1022 C, 1022 B, respectively, of Web pages 1020 A, 1020 B that are associated with application 512 A.
  • Note 1014 A also includes a sub-note 1016 D that is linked to portion 1022 D of object 1020 C associated with application 512 B.
  • sub-notes 1016 in the same or different notes 1014 may be linked to the same portion 1022 of a Web page 1020 .
  • sub-notes 1016 D and 1016 F are linked to portion 1022 D of object 1020 C.
  • a note 1014 is not a Web page. In another embodiment of the present invention, a note 1014 represents a Web page. Accordingly, a sub-note 1016 may be linked to a portion of a note 1014 . For example, sub-note 1016 E is linked to portion 1022 F of note 1014 B. Portion 1022 F includes sub-note 1016 G.
  • Each sub-note 1016 includes a content data that is used to convey information.
  • the content data are user definable.
  • the content data includes at least information that explains the rationale for lining the sub-note 1016 to the portion 1022 of the Web page 1020 .
  • the content field 1512 could include a description of how the portions 1022 linked to the sub-notes 1016 in the note 1014 are related to one another.
  • the content field 1512 can be any format or combination of formats, such as text, sound, video, image, executable program, tactile (such as braille), etc.
  • the mechanism for liking portions 1022 of Web pages 1020 with sub-notes 1016 is generally represented in FIG. 10 as links 1038 .
  • this linking mechanism 1038 is bi-directional.
  • a user viewing portion 1022 B of Web page 1020 A can issue a command to view sub-note 1016 C.
  • a user viewing sub-note 1016 D can issue a command to automatically launch application 512 B, load Web page 1020 C, and view portion 1022 D.
  • the linking mechanism 1038 of the present invention enables users to easily traverse through related Web pages 1020 , and through sub-notes 1016 .
  • a user could command the Web annotation system 502 to display the note 1014 A. From note 1014 A, the user could move from sub-note 1016 A to portion 1022 A and back again, from sub-note 1016 B to portion 1022 B and back again, etc. Accordingly, the notes 1014 and sub-notes 1016 represent a trail through portions 1022 in Web pages 1020 .
  • the linking mechanism 1038 of the present invention enables users to access portions 1022 of Web pages 1020 in any order. This represents random access technology. For example, a user can access in any order the portions 1022 of Web pages 1020 linked to the sub-notes 1016 in the note 1014 A.
  • the invention is superior to conventional mechanisms for lining documents, such as that shown in FIG. 1 , where documents must be accessed in a predefined order. Such conventional mechanisms represent sequential or linear access technology.
  • the trail through documents provided by the linking mechanism 1038 of the present invention is much more flexible and user-friendly than the trail provided by conventional linking mechanisms.
  • a note grouping table 1090 or other database construct is used to keep track of which notes are in which note groupings.
  • notes 1014 A and 1014 B are in Note Grouping A.
  • Each note 1014 preferably includes information that identifies which Note Grouping it is in, such that it is possible to traverse from a note to a note grouping, and vice versa. This is described further below. Further levels of organization are also supported by the invention, using the same or extensions of the organizational constructs (note groupings, notes, sub-notes, links, etc.) discussed herein.
  • the note/sub-note hierarchy feature and the linking feature of the invention as described above collectively provide at least two ways to organize information, and to memorialize/institutionalize a person or group's thinking and work product.
  • the Web annotation system 502 provides a note/sub-note hierarchy.
  • the note/sub-note hierarchy allows users to group together related sub-notes for organization purposes. That is, related sub-notes may be grouped together under one note.
  • the grouping together of related sub-notes conveys to a certain extent the rationale for the linking together of Web pages 1020.
  • the Web annotation system 502 provides a means for explicitly documenting the trail through Web pages 1020 as established by the linking mechanism 1038 .
  • Such documentation is achieved by the sub-notes 1016 .
  • each sub-note 1016 includes a content field 1512 ( FIG. 15 ) that is used to convey information.
  • the content field 1512 preferably includes at least information that explains the rationale for linking the sub-note 1016 to the portion 1022 of the Web page 1020 .
  • the rationale for the trail established by the linking mechanism 1038 is explicitly explained by the information contained in the sub-notes 1016 .
  • FIG. 11 is a legend 1102 of colors 1106 , 1110 , 1114 , 1118 , 1122 used by the present invention for color coding purposes.
  • Colors 1106 , 1110 , 1114 , 1118 , 1122 are preferably red, green, yellow, cyan, and magenta, although other colors could alternatively be used.
  • Colors 1106 , 1110 , 1114 , 1118 , 1122 could represent different patterns and/or fonts in addition to or instead of colors. This is especially useful when the notes application 302 is used with a computer having a black and while monitor.
  • the colors/patterns/fonts are user definable (this embodiment is discussed further below).
  • the legend 1102 depicts different symbols 1108 , 1112 , 1116 , 1120 , 1126 used by the present invention.
  • symbols 1108 , 1112 , 1116 , 1120 , and 1124 are associated with colors 1106 , 1110 , 1114 , 1118 , and 1122 , respectively.
  • the invention fills the symbols 1108 , 1112 , 1116 , 1120 , 1126 with their associated colors 1106 , 1110 , 1114 , 1118 , 1122 , respectively.
  • FIG. 12 depicts an example computer display 1202 of the display unit 626 ( FIG. 6 ).
  • the computer display 1202 is currently displaying a notes toolbox window 1206 , a Web page window 1208 , a notes/Web page directory window 1212 , and a notes text window 1214 .
  • a pointer 1220 corresponding to the mouse or other pointing device, such as a trackball.
  • the Web page window 1208 is generated by an application that can process Web pages, such as a Web browser or the Aureka Workbench available from Aurigin, Inc., Mountain View, Calif.
  • the Web page window 1208 is currently displaying a portion of Aurigin's home page.
  • the notes/Web page directory window 1212 displays the directory of either the notes or the Web pages accessed by the present invention.
  • the directory is displayed in a tree format.
  • the notes/Web page directory window 1212 includes a directory button 1218 . When the user clicks on the directory button 1218 , any sub-notes that are stored in the note are displayed.
  • the notes text window 1214 is the area where the user types in his notes about the portion of the Web page that he highlights.
  • the notes text window 1214 also displays the text of one or more notes for the user to review/revise.
  • the notes toolbox window 1206 includes a new note button 1216 , a delete button 1236 , a plurality of pen buttons 1210 , a search button 1230 , a show sub-notes button 1232 , a launch Web browser button 1234 , a file button 1222 , an edit button 1224 , a view button 1226 , and a help button 1228 .
  • the notes toolbox window 1206 includes five pen buttons 1210 , but the notes toolbox window 1206 could alternatively include other numbers of pen buttons 1210 .
  • the delete button 1236 is used to delete a note or Web page.
  • a search window 1302 ( FIG. 13 ) appears.
  • the user types in the title of a note or sub-note in the space 1304 and clicks on a search now button 1306 .
  • the present invention searches for that particular note. If the note/sub-note is located, the present invention displays the note/sub-note to the user.
  • the term “menu” is used to describe property sheets, herein.
  • the user can access functions provided by the Web annotation system 502 for manipulating notes and sub-notes. These functions include creating a new note, creating a new sub-note, importing a note or sub-note, exporting a note or sub-note, sending notes and sub-notes to another person, printing the notes and sub-notes, and exiting the Web annotation system 502 .
  • the user is able to send via e-mail a copy of portions of the note database 508 to other users by using a “send to” command in the file menu 1402 .
  • a “send to” command in the file menu 1402 .
  • the recipient gets copies of all of the notes and Web pages necessary to display the information that is sent.
  • the user can also save AWN (Aurigin Web Note) files. These files can be generated using the “export” command in the file menu 1402 .
  • the “send to” command simply mails an AWN file to the other user.
  • the user can access additional functions provided by the Web annotation system 502 . These functions include undoing the last function, redoing the undo, cutting a note or sub-note, pasting a note or sub-note, deleting a note or Web page (same as delete button 1236 ), and finding text in a Web page displayed in the Web page window 1208 .
  • a view menu 1602 ( FIG. 16 ) is displayed.
  • the functions provided to the user include toggling between a notes directory tree or a Web pages directory tree displayed in the notes/Web page directory window 1212 , searching for a note or sub-note (as described above with the search button 1230 ), loading the original Web page (function that shows the user the original version of the Web page), showing sub-notes in the tree of the notes/Web page directory window 1212 (as described above with the sub-notes button 1232 ), options, and properties.
  • the options and properties functions of the present invention are described next in more detail.
  • an options menu 1702 ( FIG. 17 ) is displayed.
  • the options menu has two property pages, a sub-notes page 1704 and a caching page 1706 .
  • the sub-files file 1704 provides the user with options on how the sub-notes are displayed.
  • the sub-notes can be shown in the tree in the notes/Web page directory window 1212 (as described above with the sub-notes button 1232 ), the contents of the sub-note can be displayed beside the title of the note in the tree, and the title and/or URL of the Web page that the sub-note is linked to can be display in the tree.
  • the caching page 1706 will now be described.
  • the user can decide whether he wants the Web pages cached for faster retrieval of the Web pages by the present invention.
  • a properties menu 1902 ( FIG. 19 ).
  • the properties menu 1902 has a note page 1904 .
  • the title of the note is displayed, the date and time it was created, and the date and time it was last modified.
  • the help menu 2002 provides the typical help functions to the user.
  • Each pen button 1210 includes an image of a pen, such as the pen image in pen button 1210 A.
  • the pen images in the pen buttons 1210 are color coded using the colors 1106 , 1110 , 1114 , 1118 , 1122 shown in FIG. 11 .
  • the pen buttons 1210 are used to select portions of Web pages that are to be linked with sub-notes of notes.
  • the pen buttons 1210 are used as follows. A user selects one of the pen buttons 1210 using the mouse.
  • the pointer 1220 is then used to highlight, in the same color as the pen, what the user selects.
  • the user then manipulates the pointer 1220 to select a portion of the currently displayed Web page (in the case of FIG. 12 , a portion of the Web page displayed in the Web page window 1208 ).
  • the selected portion of the Web page is color coded using the same color as the pen.
  • the Web annotation system 502 creates a new sub-note, and links the sub-note to the selected portion of the Web page.
  • FIG. 21 Such operation is shown in FIG. 21 .
  • the user selects pen button 1210 A, which is color coded using color 1106 ( FIG. 11 ).
  • the user selects text 2102 , which is a portion of Aurigin's home Web page displayed in the Web page window 1208 .
  • the Web annotation system 502 instructs the application associated with the Web page window 1208 to color code the selected text 2102 using the same color as the pen button 1210 A, i.e., color 1106 .
  • the Web annotation system 502 creates a new note, called Note A, and displays Note A in the notes text window 1214 .
  • the notes text window 1214 has a current note title field 2110 in which the title of the note (i.e., Note A) is displayed.
  • the date and time Note A was created and last modified can be displayed in the note page 1904 of the properties menu 1902 ( FIG. 19 ).
  • the Web annotation system 502 creates a new sub-note with a linking button with the color 1106 and the symbol 1108 (associated with color 1106 ). This lining button (with color 1106 /symbol 1108 ) is positioned in three locations.
  • the locations are in the notes/Web page directory window 1212 as a linking button 2106 , in the notes text window 1214 as a linking button 2108 , and outside the Web page window next to the selected text 2102 as lining button 2104 .
  • the Web annotation system 502 links the linking buttons 2104 - 2108 to the selected text 2102 .
  • the user can have the present invention display either the linked Web page's title or the linked Web page's URL.
  • the user can change the option displayed by using the options menu 1712 and sub-notes page 1704 ( FIG. 17 ).
  • Linking button 2104 associated with the selected text 2102 , is used to navigate to and display the sub-note (i.e., under Note A) that is linked to the selected text 2102 .
  • the user need only click on one of the linking buttons 2104 - 2108 . This causes the Web annotation system 502 to display Note A and the associated sub-note in the notes/Web page directory window 1212 and the notes text window 1214 .
  • FIG. 22 continues the scenario of FIG. 21 .
  • the user selects pen button 1210 B, which is color coded using color 1110 ( FIG. 11 ).
  • the user selects text 2202 , which is a portion of Aurigin's home Web page displayed in the Web page window 1208 .
  • the Web annotation system 502 instructs the application associated with the Web page window 1208 to color code the selected text 2202 using the same color as the pen button 1210 B, i.e., color 1110 .
  • the Web annotation system 502 creates a second sub-note with a linking button with the color 1110 and the symbol 1112 (associated with color 1110 ). This linking button (with color 1110 /symbol 1112 ) is positioned in three locations.
  • the locations are in the notes/Web page directory window 1212 as a linking button 2206 , in the notes text window 1214 as a linking button 2208 , and outside the Web page window next to the selected text 2202 as linking button 2204 .
  • the Web annotation system 502 links the linking buttons 2204 - 2208 to the selected text 2202 .
  • the user types in the desired content for the second sub-note associated with linking buttons 2204 - 2208 .
  • Note that this second sub-note is added to existing Note A, because Note A was being displayed when the user selected text 2202 . Also note that selected text 2202 overlaps with selected text 2102 .
  • the present invention allows portions in a Web page that are to be linked with sub-notes to be distinct, to partially overlap, or to completely overlap. Such functionality of the invention enables users to precisely associate sub-notes with portions in Web pages.
  • Sub-notes in a note can be linked to portions of Web pages associated with different applications. This is done in a similar manner as described in U.S. Pat. No. 5,806,079, incorporated herein by reference.
  • the invention can be used to mark or “bookmark” text based and non-text based Web pages for fast reference and retrieval.
  • the Web annotation system 502 can operate with any application that supports the interface 510 ( FIG. 5 ).
  • the interface 510 preferably uses the JScript and DHTML standards. Both of these standards are also based on the COM. It should be understood, however, that the Web annotation system 502 is not limited to use with the JScript and DHTML standards.
  • the Web annotation system 502 can be used with any standard that allows one software application to interact with another.
  • the present invention supports a view mode for displaying the contents of the notes database 508 that is designed to be like a sheet of paper that the user can write his notes on.
  • Other view modes that the present invention supports include a note centric view, an object centric view, and a link centric view, all of which are described in detail in U.S. Pat. No. 5,806,079.
  • the view mode designed to be like a sheet of paper is further described with reference to FIG. 23 .
  • the present invention maintains the notes in the order in which the user created them (unless reordered by the user as will be described below).
  • the order in which the user created the notes is maintained in the notes/Web page directory window 1212 and the notes text window 1214 . Note that this is true, regardless of the order of the links and their associated text in the Web page window 1208 .
  • the invention includes many flexible features and functions for modifying and replicating the note grouping/note/sub-note hierarchy. These are described below.
  • the invention enables users to modify the note grouping/note/sub-note hierarchy.
  • the invention enables users to switch or copy notes from one note grouping to another, or switch or copy sub-notes from one note to another.
  • One way in which a user can modify the note grouping/note/sub-note hierarchy is move sub-note from one note to another by using well known copy/cut and paste operations (via the cut, paste, and delete commands on the edit menu 1502 ( FIG. 15 )). Also, a user can change the linkage and/or order between sub-notes and Web page portions by clicking and dragging the linking buttons.
  • a great deal of time and effort may go into the creation of a note grouping/note/sub-note hierarchical database.
  • a database is specific to a particular task or project. However, it is often the case that parts of a database are applicable to another task or project. For efficiency purposes, users would like to reuse a database generated for one project to the extent possible in another project. Users may also want to e-mail copies of notes and sub-notes to other users.
  • the invention provides powerful tools for enabling a user to identify and replicate portions of an existing database that may be relevant to another project. These replicated portions constitute the foundation of a new hierarchical database.
  • a user may already know which parts of a database are pertinent to another project. In such cases, the user may select those parts and replicate (copy) them to a new database. Here, the user may select just those parts and e-mail a copy of them to one of more users.
  • the user is able to send via e-mail a copy of portions of the note database 508 to other users by using a “send to” command in the file menu 1402 . If the user sends an e-mail to another user, the recipient gets copies of all of the notes and Web pages necessary to display the information that is sent.
  • the user can also save AWN (Aurigin Web Note) files. These files can be generated using the “export” command in the file menu 1402 . Here, the “sent to” command simply mails an AWN file to the other user.
  • FIG. 25 illustrates a new database that was created based on a search conducted on the example database of FIG. 29 .
  • the invention supports searching based on key words, date/time of creation/modification, creator, icon tags, color, shape, Web page title, note title, content, etc. The searching capabilities of the invention are discussed below.
  • the Web annotation system 502 includes a user interface 504 .
  • the user interface 504 enables a user 2404 to interact with the notes database 508 and source material 2410 , representing Web pages (these Web pages may be stored in Web pages database 509 ).
  • the user 2404 interacts with the user interface 504 so as to create note groupings, notes, and sub-notes, establish and modify the note grouping/note/sub-note hierarchy, establish and modify the links between sub-notes and Web page portions, and in all other ways interact with the notes database 508 and the source material 2410 .
  • the user interface 504 provide the user 2404 with an easy to use (i.e., user friendly) interface to the notes database 508 , the source material 2410 , and to the features and functions provided by the Web annotation system 502 . If the user interface 504 is user friendly, then the user 2404 is more likely to utilize the Web annotation system 502 to document his thinking and work product.
  • the user interface 504 may be implemented using any user interface tools, approaches, techniques, technology and/or applications that currently exist, or that will be developed in the future.
  • the user interface 504 is implemented as a computer based graphical user interface (GUI). Example screen shots from this GUI are shown in FIGS. 12-23 .
  • the user interface 504 is implemented in whole or in part using virtual reality (VR) technology.
  • VR virtual reality
  • Significant VR technology has been developed, and more is currently being developed.
  • Virtual reality is discussed in many publicly available documents, such as Virtual Reality Applications and Explorations , edited by Alan Wexelblat, Academic Press, Cambridge, Mass., 1993, and On the Cutting Edge of Technology , Sams Publishing, Carmel, Ind., 1993 which are incorporated herein by reference in their entities.
  • FIG. 26 represents an example VR scenario 2602 according to a preferred embodiment of the invention.
  • the user is represented in VR scenario 2602 by a hand 2604 .
  • the user selects and manipulates objects in the VR world of FIG. 26 by using the virtual hand 2604 , just-like the user selects and manipulates objects in the real world using his own hand.
  • Other techniques for manipulating objects in the VR world will be apparent to persons skilled in the VR arts. For example, manipulation may be accomplished by voice command, or by thought (tied to brain waves or brain impulses), or by body gestures, etc.
  • the user selects a book 2608 from a library 2606 .
  • the user opens the book 2608 until a passage 2610 of interest is found.
  • the user selects this passage 2610 and then links this passage 2610 to a sub-note 2618 in Note A.
  • Such linkage may automatically occur upon the selection of the passage 2610 (since such selection results in the creation of sub-note 2618 , and in the creation of the link between sub-note 2618 and the passage 2610 , as described above).
  • the user can link passage 2610 with sub-note 2618 by moving the hand 2604 from the passage 2610 to the sub-note 2618 .
  • the user can enter comments into the sub-note 2618 using any input mechanism or procedure, such as typing on a real or virtual keyboard, audibly dictating the comments, etc.
  • the user can manipulate the items and objects in those displays via the VR hand 2604 or any other virtual construct, instead of or in addition to a computer (physical or virtual) keyboard and mouse.
  • the combination of the Web annotation system 502 with virtual reality creates a very powerful, user friendly application.
  • the user is often said to issue a command, press a button, select an option from a menu, review a computer display, input/key in information or commands, or perform some other type of action that requires interaction with the computer. It should be understood that, according to the present invention, such interaction can be achieved using any type of user interface, including a conventional computer interface (using a keyboard and mouse, for example), or a virtual reality interface, as just described above.
  • security is not addressed.
  • the invention may include many functions, features, and capabilities to maintain the security of the information contained in the note database 508 .
  • These security features can generally be categorized as follows: (1) security on individual note groupings, notes, sub-notes, links, and objects; and (2) security of the note database 508 as a whole. These two security features are discussed below.
  • a person, group, or organization may wish to limit access to note groupings, notes, sub-notes, links, and/or Web pages. Only people or groups who satisfy some specified criteria would have access to such note groupings, notes, sub-notes, links, and/or Web pages.
  • the present invention supports features for securing individual note groupings, notes, sub-notes, links, and Web pages.
  • a note grouping, note, sub-note, link, or Web page may be secured based on a number of criteria, including creator, owner, password, security level, or any other well known security criteria. For example, if a sub-note is secured based on the creator criteria, then only the creator may access the sub-note. If a sub-note is secured based on password, then only persons who have the correct password may access the sub-note. If a sub-note is secured based on security level, then only persons having the appropriate security level will have access to the sub-note.
  • a person or group who satisfies the current security criteria for a note grouping, note, sub-note, link, or Web page may modify the security criteria for the note grouping, note, sub-note, link, or Web page.
  • only persons or groups who have satisfy a specified, alternate security criteria may change existing security criteria.
  • Note A is displayed in a note window 2706 . It is assumed that Note A is not secured, or that the current user satisfies the security criteria associated with Note A.
  • Note A includes Sub-notes A, B, and C. It is assumed that Sub-notes A and B are not secured, or that the current user satisfies the security criteria respectively associated with Sub-notes A and B. Accordingly, Sub-notes A and B are displayed.
  • Sub-note C is secured. However, the current user does not satisfy the security criteria of Sub-note C. Thus, Sub-note C is not displayed.
  • link 2714 is active.
  • the current user may manipulate and traverse link 2714 .
  • the Web page associated with link 2714 is displayed in application window 2720 .
  • the current user does not satisfy the security criteria of link 2716 .
  • link 2716 is inactive.
  • the current user may not manipulate or traverse link 2716 .
  • the Web page associated with link 2716 is not displayed. It is irrelevant whether the current user does or does not satisfy the security criteria of link 2718 . In either case, link 2718 is inactive since its Sub-note C is inactive (in other embodiments, the security state of a link is separate and distinct from the security state of its sub-note).
  • the notes database 508 is stored in a single computer. In other embodiments of the present invention, the notes database 508 is distributed among multiple databases. Procedures and technology for distributing the notes database 508 , and for working with the distributed notes database 508 , will be apparent to persons skilled in the relevant art(s).
  • the distribution of the notes database 508 is advantageous for implementation, performance, and robustness reasons.
  • the motivations and advantages of distributed database systems in this regard are well known.
  • the notes database 508 is also distributed for security reasons. In some situations, it is necessary to maintain the confidentiality and secrecy of the notes database 508 . Distributing the notes database 508 aids in this effort, and it ensures that the inadvertent or improper disclosure of one part of the notes database 508 maintained at one site does not result in the disclosure of the other parts of the notes database 508 at other sites.
  • the present invention utilizes techniques in addition to the data distribution approached described above to secure the linkage information in the notes database 508 . These additional techniques also relate to data distribution.
  • the present invention preferably partitions the notes database 508 into a note information database 2406 and a note/object linking information database 2408 .
  • the note/object linking information database 2408 contains the linkage information that specifies how sub-notes are linked to Web page portions.
  • the note information database 2406 includes all information about notes and sub-notes except for the linkage information.
  • the note information database 2406 is distributed among a first set of sites.
  • the note/object linking information database 2408 is distributed among a second set of sites.
  • the first and second sets of sites may be the same, may be completely different, or may be partially the same.
  • FIG. 28 illustrates an example implementation of the invention.
  • the note information database 2406 is distributed among sites 2804 and 2808 .
  • the note/object linking information database 2408 is distributed among sites 2806 , 2810 , and 2812 .
  • These sites are connected via a network 2820 , which may represent any type of communication medium in any form or configuration, such as a public network (the Internet, for example), a private network (such as a virtual network), dial up telephone lines, etc.
  • the communication medium can include any type of communication links, such as fiber optics, coaxial cable, wireless, satellite links, etc., or any combination of these.
  • the invention uses other techniques for securing the notes database 508 .
  • all or part of the notes database 508 is encrypted.
  • references contained in the note information database 2406 to the note/object lining information database 2408 are encrypted using any well known encryption mechanism or algorithm, such as key encryption. Encryption of the notes database 508 is further described below.
  • the invention supports powerful search features for identifying note groupings, notes, sub-notes, links, and/or Web pages that satisfy user supplied search criteria.
  • Users can perform key word searches, searches based on date/time of creation or modification, searches based on icon tagging (icons can be predefined or user defined), searches based on creator or owner, searches based on security/privacy levels, color, shape, Web page title, etc.
  • sub-notes are indexed and searchable.
  • fields (predefined or user defined) within note groupings, notes, and sub-notes are indexed and searchable.
  • the user can limit the search to a user-defined path through the note/sub-note hierarchy (for example, the user can limit the search to a path that starts with a user specified note grouping, note, sub-note, link, etc.).
  • notes database 508 (as well as the Web pages database 509 ) are implemented as functional objects.
  • note repository object 804 note object 806 , sub-note object 808 , content object 810 , and anchor object 812 make up the notes database 508 .
  • the content object 810 stores data that conveys information. These data are user definable and includes at least information that explains the rationale for linking the sub-note object 808 to a portion of the Web page object 818 .
  • the data stored in the content object 810 can be any format or combination of formats, such as text, sound, video, image, executable program, tactile (such as braille), etc.
  • the anchor object 812 is linked by a bookmark link 820 to the Web page object 818 .
  • the bookmark link 820 is bi-directional.
  • Each note object 806 contains data including its title, the date and time of creation, the data and time of last modification, a listing of all of its sub-notes, etc.
  • Each sub-note object 808 also contains data including its title, the date and time of creation, the data and time of last modification, its content object, its anchor object, privacy settings, etc.
  • the anchor object contains data including the color and which pen was highlighted when the pointer 1220 was used to select the selected portion to which the sub-note is linked, etc.
  • FIG. 30 illustrates an example notes database 508 that stores Notes A, B, and C.
  • the user interface 504 creates, updates, and deletes objects in the Web annotation system 502 preferably using the COM interfaces.
  • the user interface 504 must first gain access to a functional object through the top level object, namely the Web annotation system object 802 .
  • the Web annotation system object 802 can return to the user interface 504 the note repository object 804 and/or the Web page repository object 814 .
  • the user interface 504 has either the note repository object 804 or the Web page repository object 814 , it can use either of these (based on its interface) to: navigate to other objects, create child objects, remove child objects, and modify child objects.
  • the note repository object 804 includes three note objects, namely a note A object 806 A, a note B object 806 B, and a note C object 806 C.
  • the note A object 806 A is comprised of two sub-note objects, namely sub-note object 808 A and sub-note object 808 B.
  • the sub-note object 808 A comprises a content object 810 A and an anchor object 812 A.
  • the sub-note object 808 B comprises a content object 810 B and an anchor object 812 B.
  • the note B object 806 B is also comprised of two sub-note objects, namely sub-note object 808 C and sub-note object 808 D.
  • the sub-note object 808 C comprises a content object 810 C and an anchor object 812 C.
  • the sub-note object 808 D comprises a content object 810 D and an anchor object 812 D.
  • the note C object 806 C is comprised of three sub-note objects, namely sub-note object 808 E, sub-note object 808 F, and sub-note object 808 G.
  • the sub-note object 808 E comprises a content object 810 E and an anchor object 812 E.
  • the sub-note object 808 F comprises a content object 810 F and an anchor object 812 F.
  • the sub-note object 808 G comprises a content object 810 G and an anchor object 812 G.
  • Web page repository object 814 includes two Web page folders, namely Web page folder object 816 A and Web page folder object 816 B.
  • the Web page folder object 816 A comprises a Web page object 818 A, a Web page object 818 B, and a Web page object 818 C.
  • the Web page folder object 816 B comprises a Web page object 818 D and a Web page object 818 E.
  • bookmark links will next be discussed with reference to FIG. 30 .
  • the bookmark links are bi-directional links.
  • a bookmark link 820 A links together the sub-note object 808 A (and its content object 810 A) with the portion of a Web page it relates to, namely a portion of the Web page object 818 E.
  • a bookmark link 820 B links together the sub-note object 808 B with a portion of the Web page object 818 D.
  • a bookmark link 820 C also links together the sub-note object 808 C to a portion of the Web page object 818 D.
  • sub-note object 808 B and sub-note object 808 C are both linked to the same Web page object 818 D.
  • the portion of Web page object 818 D that sub-note object 808 B and sub-note object 808 C are linked to can be the same portion, can be different portions, or can be two portions that overlap.
  • a bookmark link 820 D links together the sub-note object 808 D with a portion of the Web page object 818 C
  • a bookmark link 820 E links together the sub-note object E with a portion of the Web page object 818 B
  • a bookmark link 820 F links together the sub-note object F with a portion of the Web page object 818 B
  • a bookmark link 820 G links together the sub-note object G with a portion of the Web page object 818 A.
  • Flowchart 3102 illustrates the manner in which a user interacts with the Web annotation system 502 to organize Web pages, and to manipulate notes attached to portions of Web pages.
  • Such user interaction with the Web annotation system 502 is preferably achieved through interaction with a user interface 504 that forms part of the Web annotation system 502 .
  • the user interface 504 of the present invention is very powerful and flexible.
  • the user interface 504 allows users to access the functionality of the Web annotation system 502 in any number of ways.
  • the operational steps shown in flowchart 3102 and in other flowcharts discussed below represent one way (i.e., one operational sequence) of accessing the functions provided by the Web annotation system 502 . Users may access and traverse the functions provided by the Web annotation system 502 in any number of other ways via interaction with the menus provided by the user interface 504 .
  • Such other ways i.e., such other operational sequences
  • step 3104 the user issues a command to an operating system executing in the computer system 602 .
  • the user may issue this command via a keyboard or a well known point-and-click approach, or via a body gesture, thought, or voice command when using a VR user interface, or via any other well known means for entering a command.
  • control line 3110 is taken. If the user issued a command to create a new note/sub-note, and this command was issued using the file menu 1402 , then control line 3112 is taken. If the user issued a command to create a new note/sub-note, and this command was issued using a pen (such as pen 1210 A in FIG. 12 ) or VR hand 2604 or the like, then control line 3114 is taken. If the user issued a command to view a note, and this command was issued by selecting a linking button in a Web page, then control line 3116 is taken.
  • control line 3118 is taken. If the user issued a command to e-mail a copy of a portion of notes database 508 , and this command was issued from the file menu 1402 , then control line 3119 is taken. If the user issued a command to find a specified text in the current Web page via edit menu 1502 , then control line 3120 is taken. If the user issued a command to modify the privacy/security settings associated with a note grouping, note, sub-note, or link, then control line 3121 is taken.
  • control line 3122 is taken. If the user issued a command to show sub-notes in the notes/Web page directory window 1212 via view menu 1602 , then control line 3124 is taken. If the user issued a command to toggle between viewing notes or Web pages in the notes/Web page directory window 1212 via view menu 1602 , then control line 3126 is taken. If the user issued a command to change or view options via the view menu window 1602 , then control line 3128 is taken. If the user issued a command to change or view properties via the view menu window 1602 , then control line 3130 is taken. These control flows and commands are discussed below.
  • step 3106 is performed.
  • the operating system in the computer system 602 invokes the user-specified application in a well known manner.
  • the application is preferably a Web browser, but may also be a word processing application, a spread sheet application, a database application, a communication application, a video/audio processing application, a financial application, etc.
  • the invoked application displays an application window.
  • the user commands the application to load a Web page, and uses the application to process the Web page.
  • control from step 3106 may then flow to any number of directions. In some cases, control flows back to step 3104 , as shown in FIG. 31 .
  • One way for the user to issue a command to create a new note or sub-note is to open the file menu 1402 (by pressing the file menu button 1222 ), and then select the “New Note” function or the “New Sub-Note” function.
  • the Web annotation system 502 performs the steps of flowchart 3202 in FIG. 32 .
  • step 3204 the notes engine 506 of the Web annotation system 502 determines whether a note is currently highlighted in the computer display (i.e., the display unit 2826 ). That is, the notes engine 506 determines whether a note is currently active. If a note is not currently highlighted or active, then step 3210 is performed. Otherwise, step 3206 is performed.
  • step 3206 the notes engine 506 determines whether the user has issued a command to highlight a different note (i.e., deactivate the note that was currently being highlighted). The user issues such a command if he wishes to insert the new sub-note in a new note, as opposed to the currently active note. If the notes engine 506 determines that the user has not issued a command to deactivate the note that is currently being highlighted, then step 3212 is performed (described below). In step 3212 , the note currently being highlighted is called the active note for reference purposes. Otherwise, step 3208 is performed.
  • step 3208 the notes engine 506 closes or deactivates the note.
  • the notes engine 506 creates a new note.
  • the notes engine 506 creates a new note by creating and storing a new note object (such as note object 806 in FIG. 8 ) in the notes database 508 (step 3306 ).
  • the notes engine 506 adds the new note object to the note repository object 804 (step 3308 ). Procedures for adding data to an object are well known.
  • the notes engine 506 in step 3310 initializes the new note object by storing its title in the note object (this name is preferably entered by the user).
  • the Web annotation system 502 may also prompt the user for security/privacy settings for the new note object. Any security/privacy settings input by the user are also stored in the new note object.
  • the Web annotation system 502 may receive from the user a command identifying a notes group (either existing or new) to which the Web annotation system 502 should add the new note object. If the user provides this information, then the Web annotation system 502 modifies the note grouping table 1090 ( FIG. 10 ) accordingly.
  • the user interface 504 displays the new note (i.e., note object) in the notes/Web page directory window 1212 and the notes text window 1214 .
  • the new note is called the active note for reference purposes.
  • the notes engine 506 creates a new sub-note.
  • the notes engine 506 creates a new sub-note by creating a new sub-note object (such as sub-note object 808 in FIG. 8 ) in step 3406 .
  • the notes engine 506 generates a sub-note identifier for the new sub-note object.
  • the sub-note identifier is unique among all sub-note objects.
  • the sub-note identifier may be composed of the title of the note (i.e., the active note) concatenated with the current date/time stamp. Other procedures for deriving the sub-note identifier could alternatively be used.
  • the notes engine 506 stores the sub-note identifier in the sub-note object.
  • the notes engine 506 also stores information identifying the new sub-note object in the note object.
  • the notes engine 506 adds the new sub-note object to the active notes object's sub-note objects.
  • the notes engine 506 may also receive a command from the user indicating the privacy/security setting of the new sub-note object. If the user enters this information, then the notes engine 506 stores the privacy/setting of the new sub-note object in the sub-note object.
  • the user interface 504 in step 3214 enables the user to link the new sub-note to a portion of a Web page. It may be necessary for the user to open the Web page in a well known manner prior to the performance of step 3214 . Alternatively, the Web page may already have been opened by the user. In any-case, in step 3214 , the user selects one of the pen buttons 1210 in order to obtain a pen. The user then uses this pen to activate the pointer 1220 (in the manner discussed above) to select a portion of the Web page. Procedures for selecting portions of Web pages are well known. The procedure for selecting a portion of a Web page is dependent on the application associated with the Web page. The notes engine 506 commands the application associated with the Web page to color code the selected portion using the color associated with the pen.
  • the notes engine 506 stores information identifying the Web page in the sub-note object. This information may be the file name of the Web page, for example.
  • the notes engine 506 may also store in the sub-note object information identifying the application associated with the Web page.
  • the notes engine 506 may obtain the information to be stored in the sub-note object by querying the application associated with the Web page.
  • the notes engine 506 stores in the new sub-note object information that identifies the location of the selected portion in the Web page. If the Web page is a text document, for example, then this information may comprise page and line information. The notes engine 506 preferably obtains this location identification information by querying the application associated with the Web page. Also in step 3508 , the notes engine 506 stores in the sub-note object information that indicates the range, of the selected portion in the Web page.
  • the object identifier data, the location identifier data, and the range data are partitioned into the note/object linking information database 2408 (along with any link privacy settings). All other information is stored in the note information database 2406 .
  • the notes engine 506 stores in the sub-note object's anchor object the pen-data that identifies the pen that the user used in step 3214 to select a portion of the Web page.
  • the notes engine 506 stores pen data identifying the color of the pen, and the symbol associated with the pen.
  • the notes engine 506 may store privacy/security settings information for the sub-note and/or the link, if the user enters this information.
  • the notes engine 506 commands the application associated with the Web page to display a linking button proximate or adjacent to the selected portion.
  • the linking button is displayed using the color of the pen used to select this selected portion, and using the symbol associated with this color (see FIG. 11 ).
  • the notes engine 506 associates the sub-note identifier for the new sub-note with this linking button. In this manner, the notes engine 506 can locate the new sub-note if the user presses the lining button (such operation is described below).
  • the user interface 504 in step 3220 enables the user to enter information in the appropriate area in the notes display window 1214 for the new sub-note.
  • information can be of any format, such as text, sound, video, tactile, computer program, etc.
  • the notes engine 506 stores this information in the content object (such as content object 810 of FIG. 8 ) of the new sub-note's object.
  • the user may also enter privacy settings at this time for the note, sub-note, or link.
  • the notes engine 506 stores any such information entered by the user in the appropriate locations of the sub-note object.
  • step 3604 the user selects one of the pen buttons 1210 in order to obtain a pen.
  • the user then uses this pen to activate the pointer 1220 (in the manner discussed above) to select a portion of the Web page.
  • the notes engine 506 commands the application associated with the Web page to color code the selected portion using the color associated with the pen.
  • step 3606 the notes engine 506 of the Web annotation system 502 determines whether a note is currently highlighted in the computer display (i.e., the display unit 2826 ). That is, the notes engine 506 determines whether a note is currently active. If a note is not currently highlighted or active, then step 3612 is performed. Otherwise, step 3608 is performed.
  • step 3608 the notes engine 506 determines whether the user has issued a command to highlight a different note (i.e., deactivate the note that was currently being highlighted). The user issues such a command if he wishes to insert the new sub-note in a new note, as opposed to the currently active note. If the notes engine 306 determines that the user has not issued a command to close the note that is currently being displayed, then step 3614 is performed (described below). (In step 3614 , the note currently being displayed is called the active note for reference purposes.) Otherwise, step 3610 is performed.
  • step 3610 the notes engine 306 deactivates the note.
  • the notes engine 506 creates a new note.
  • the notes engine 506 creates a new note by creating and storing a new note object (such as note object 806 in FIG. 8 ) in the notes database 508 (step 3306 ).
  • the notes engine 506 adds the new note object to the note repository object 804 (step 3308 ).
  • the notes engine 506 in step 3310 initializes the new note object by storing its title in the note object (this name is preferably entered by the user).
  • the Web annotation system 502 may also prompt the user for security/privacy settings for the new note object. Any security/privacy settings input by the user are also stored in the new note object.
  • the user interface 504 displays the new note (i.e., note object) in the notes/Web page directory window 1212 and the notes text window 1214 .
  • the new note is called the active note for reference purposes.
  • step 3614 the notes engine 506 creates a new sub-note. As indicated above with reference to FIG. 34 , the notes engine 506 creates a new sub-note by creating a new sub-note object (such as sub-note object 808 in FIG. 8 ) in step 3406 .
  • a new sub-note object such as sub-note object 808 in FIG. 8
  • step 3616 the notes engine 506 links the selected portion of the Web page to the new sub-note (in the manner discussed above).
  • step 3618 the notes engine 506 updates the displays of the Web page and the active note so as to graphically reflect this linkage (in the manner discussed above).
  • One way for the user to issue a command to view an existing sub-note is to select (using the well known point-and-click approach) the linking button displayed proximate to the portion of the Web page that is linked to the sub-note. For example, in FIG. 4 , the user can issue a command to view Sub-note A by selecting the linking button 2104 next to the portion 2102 of the Web page that is linked to Sub-note A.
  • the operation of the Web annotation system 502 in this regard is represented by a flowchart 3702 in FIG. 37 .
  • step 3704 the user selects the linking button displayed proximate to the portion of the Web page of interest.
  • the linking button 2204 corresponding to portion 2202 of the Web page titled “aurigin.com” ( FIG. 22 ).
  • step 3706 the notes engine 506 in response to this user action identifies the note and sub-note corresponding to linking button 2204 .
  • the manner in which the notes engine 506 performs step 3706 is represented by a flowchart 3802 in FIG. 38 .
  • the notes engine 506 identifies the sub-note identifier that is associated with the linking button 2204 .
  • the lining button 2204 preferably has stored with it the sub-note identifier (or some other type of reference or address to a sub-note).
  • step 3808 the notes engine 506 searches in a well known manner through the notes database 508 until it locates the sub-note having the sub-note identifier determined in step 3806 . For illustrative purposes, assume that the notes engine 506 in step 3808 determines that Sub-note B (see FIG. 29 ) has the sub-note identifier determined in step 3806 .
  • the notes engine 506 determines whether security/privacy criteria associated with the link (corresponding to the linking button), the sub-note (identified in step 3706 ), and the note (identified in step 3706 ) are satisfied.
  • the notes engine 506 retrieves this security/privacy criteria information from the associated note node and sub-note node, and then compares the retrieved security/privacy criteria information to the situation at hand. For example, if the security/privacy criteria is keyed to the current user's password, then the notes engine 506 compares the password of the current user (which the current user previously entered, or is now asked to enter) with that retrieved from the note and/or sub-note.
  • step 3708 If the security/privacy criteria is not satisfied, then the user cannot view the note and/or sub-note. If this is the case, then an error message is displayed in step 3722 . If the security/privacy criteria is satisfied, then control flows to step 3708 .
  • step 3708 the notes engine 506 determines whether the note that includes the sub-note identified in step 3706 is currently being displayed in the computer display. In the example discussed above, the notes engine 506 in step 3708 determines whether Note B is currently being displayed in the computer display. If Note B is currently being displayed in the computer display, then control flows to step 3712 (described below). Otherwise, step 3710 is performed.
  • step 3710 the notes engine 506 displays in a notes display window 1214 the note that includes the sub-note identified in step 3706 .
  • step 3712 the notes engine 506 scrolls through the note in the notes display window 1214 until the sub-note identified in step 3706 is displayed in the notes display window 1214 .
  • control line 3118 is taken.
  • the operation of the Web annotation system 502 in accordance with function is represented by a flowchart 3902 shown in FIG. 39 .
  • step 3904 the user clicks on the search button 1230 or indicated via the view menu 1602 that he would like to search notes for a specific text string.
  • step 3906 a search window is displayed.
  • step 3908 the user types in the search window the text string to be searched for by the present invention.
  • step 3910 the present invention searches the notes database 508 (specifically the content object 810 of each sub-note object 808 ( FIG. 8 )) for the indicated text string.
  • step 3912 if the text string is not found, then control passes to step 3914 where the present invention displays to the user that no matches were found. Alternatively, the control passes to step 3916 .
  • step 3916 the notes engine 506 scrolls through the note in the notes display window 1214 until the sub-note identified in step 3910 is displayed in the notes display window 1214 .
  • step 3918 the notes engine 506 also displays the associated Web page.
  • control line 3119 is taken.
  • the operation of the Web annotation system 502 in accordance with function is represented by a flowchart 4002 shown in FIG. 40 .
  • the user clicks indicates via the file menu 1402 (by using the “send to” command) that he would like to e-mail a copy of a portion of notes database 508 and any associated Web pages to another user.
  • the present invention displays an e-mail window to the user.
  • step 4008 the user utilizes the e-mail window to indicate to the Web annotation system 502 the notes/sub-notes he wants sent to an e-mail recipient.
  • step 4010 the user indicates the recipient's e-mail address to the present invention.
  • the user can also save AWN (Aurigin Web Note) files. These files can be generated using the “export” command in the file menu 1402 .
  • the “sent to” command simply mails an AWN file to the other user.
  • step 4012 the Web annotation system 502 generates an attachment that contains a copy of all of the notes/sub-notes and their associated Web pages. Also in step 4012 , the Web annotation system 502 sends the attachment to the e-mail recipient.
  • step 4014 if the e-mail recipient's machine already has a copy of the present invention, control passes to step 4018 .
  • control passes to step 4016 .
  • step 4016 the present invention indicates to the recipient where he can download a copy of the present invention to his machine.
  • Control then passes to step 4018 .
  • step 4018 when the recipient clicks on the attachment sent by the present invention, the present invention automatically loads in the application to display the Web pages.
  • the user initiates a search for a text string in the current Web page by selecting the “Find” command in the edit menu 1502 .
  • the operation of the Web annotation system 502 while performing searching is represented by a flowchart 4102 in FIG. 41 .
  • the user interface 504 enables the user to enter search criteria.
  • the user enters the text string to search.
  • the user can limit the search criteria by indicating whether to match “whole words only,” case, and/or how to search (up or down the Web page).
  • the notes engine 506 searches through the text of the current Web page (as limited by the user) to locate any and all text strings that satisfy the search criteria.
  • the user interface 504 highlights the first text string located in the current Web page. If no text strings are found, the present invention indicates this to the user.
  • Flowchart 4202 in FIG. 42 represents the operation of the invention when enabling the user to modify the privacy/security settings associated with a note grouping, note, sub-note, or link.
  • step 4204 the user selects a note grouping, note, sub-note, or link using any of the selection procedures discussed herein.
  • step 4206 the Web annotation system 502 verifies that the privacy/security criteria associated with the selected item is satisfied. Such verification is described above. If the privacy/security criteria is not satisfied, then the user is not allowed to modify the privacy/security settings. In this case, an error message is displayed in step 4210 . If the privacy/security criteria is satisfied, then in step 4208 the user is allowed to enter new privacy/security settings for the selected item. This new privacy/security setting is then stored.
  • the present invention allows users to modify the sub-notes that are in notes. For example, a user may rearrange the ordering of sub-notes within a note.
  • the user can delete sub-notes from a note.
  • the user can also copy (replicate) or move sub-notes from one note to other notes.
  • the user can also move, delete, or otherwise modify the notes that are in the note groups.
  • the user can also modify the linkage between sub-notes and Web page portions.
  • the invention allows the user to easily modify the note grouping/note/sub-note hierarchy by processing step 3108 ( FIG. 31 ). Such operation of step 3108 is further illustrated by reference to FIG. 43 .
  • a user rearranges sub-notes in a note, or moves/copies sub-notes between notes by selecting the desired sub-notes, and then dragging and dropping the selected sub-notes to the desired locations.
  • FIG. 43 assume that the user wishes to move sub-note 4302 so that it is displayed between sub-notes 4304 and 4306 .
  • the user selects sub-note 4302 in a well known manner, and then drags selected sub-note 4302 until it is located between sub-notes 4304 and 4306 .
  • the user then drops sub-note 4302 between sub-notes 4304 and 4306 in a well known manner. This can be done in both notes/Web page directory window 1212 and the notes text window 1214 .
  • sub-note 4302 Suppose that the user wishes to move sub-note 4302 to Note B.
  • the user selects sub-note 4302 in a well known manner, and then drags selected sub-note 4302 until it is positioned over Note B.
  • the user then drops sub-note 4302 into Note B. This is done in only the notes/Web page directory window 1212 .
  • the user modifies the notes within a note group and the linkage between sub-notes and Web page portions in a similar manner.
  • the notes engine 506 moves/copies sub-notes between the sub-note objects, modifies the note grouping table 1090 , and/or modifies the linkage information in the sub-note nodes.
  • control line 3124 is taken. Such operation is further described with reference to flowchart 4602 in FIG. 46 .
  • step 4604 the user indicates to the present invention to show the content of the sub-notes in the notes/Web page directory window 1212 by selecting the “Show Sub-notes In Tree” command in the view menu 1602 .
  • control line 3126 is taken. Such operation is further described with reference to flowchart 4702 in FIG. 47 .
  • step 4704 the user can toggle between displaying the notes tree or Web pages tree in the notes/Web page directory window 1212 by either selecting the “Notes” command or the “Web Pages” command in the view menu 1602 .
  • control line 3128 is taken. Such operation is further described with reference to flowchart 4802 in FIG. 48 .
  • the user can select either the sub-notes page 1704 or the caching page 1706 by selecting the options menu 1702 ( FIG. 17 ).
  • the sub-files file 1704 provides the user with options on how the sub-notes are displayed.
  • the sub-notes can be shown in the tree in the notes/Web page directory window 1212 (as described above with the sub-notes button 1232 ), the contents of the sub-note can be displayed beside the title of the note in the tree, and the title and/or URL of the Web page that the sub-note is linked to can be display in the tree.
  • the caching option, when checked, in the caching page 1706 indicates to the present invention to cache Web pages in the Web pages database 509 for faster retrieval of the Web pages by the present invention.
  • control line 3130 is taken. Such operation is further described with reference to flowchart 4902 in FIG. 49 .
  • step 4904 the user selects the properties function from the view menu 1602 and a properties menu 1902 ( FIG. 19 ) is displayed.
  • the properties menu 1902 has a note page 1904 .
  • the title of the note is displayed (and can be changed by the user), the date and time it was created, and the date and time it was last modified.
  • the invention is applicable to any application that would benefit from the enhanced organization of information.
  • Such applications include, but are not limited to: (1) law related projects, such as licensing studies, litigation efforts, opinions of counsel (such as patentability, patent validity, and patent infringement studies); (2) scientific and/or engineering related projects, such as research and development projects; (3) electronic text books, handbooks, user manuals, encyclopedias, and other electronic reference works, including multimedia reference works; (4) auditory and visual documents; (5) virtual library; (6) review course, such as legal bar review course, business review courses, CPA courses, medical review courses, etc.; (7) virtual classrooms; (8) business-related Internet research; and (9) casual Internet use.
  • the invention is applicable to the entertainment industry, such as the motion picture industry.
  • the invention could be used to organize the great amounts of information that is collected and generated during the development of a movie and stored on the Internet. This scenario is represented in simplified form in FIG. 44 .
  • a movie is developed in three phases: a pre-production phase, a production phase, and a post production phase.
  • the present invention could be used to organize, memorialize, and institutionalize the information collected and generated during these phases.
  • a note 4402 could be created for the pre-production phase.
  • a note 4404 could be created for the production phase, and another note 4406 could be created for the post production phase.
  • the pre-production note 4402 could include sub-notes that link to Web pages used to research the movie's topic. For example, suppose the movie involved lions. One sub-note, called Sub-note A, could be linked to a chapter in a book 4426 dealing with lions stored on a Web page. Another sub-note, Sub-note B, could be linked to a segment of a video 4428 pertaining to lions stored on a Web page. Other sub-notes, such as Sub-notes C-E, could be linked to drafts 4430 of the script on Web pages. These sub-notes could include comments/edits on the drafts 4430 . Other sub-notes (not shown) could be linked to other pre-production related objects, such as contracts with actors, travel itineraries, budget reports, purchase orders for costumes and props, etc.
  • the production note 4404 could include sub-notes that are linked to production Web pages, such as the final draft of the script 4434 , various scenes 4434 , various takes 4434 , clips, shots, frames, etc. Such scenes 4434 , takes 4434 , clips, shots, and frames would be in a form useable by a computer.
  • the post production note 4406 could include sub-notes that are linked to post-production Web pages, such as the theatrical production 4424 of the movie, the video production 4424 of the movie, the movie soundtrack, etc.
  • the present invention will lend order to the creation of a movie and to the memorialization and documentation of the movie production. Accordingly, movie production will be more efficient and effective.
  • the present invention allows any and all versions of any given movie to be easily packaged, distributed and sold.
  • the materials that were used to create the movie can be easily packaged, distributed, and sold. Again, one need only copy the pertinent notes, sub-notes, and Web pages to a computer readable medium, and distribute and sell copies of the computer readable medium to the public.
  • the use of the invention will enable movie aficionados to create their own versions of a movie. This is the case, since the soundtrack, scenes, takes, clips, shots, and/or frames are stored as Web pages, and are linked to sub-notes. Such personalized movie making packages can be easily packaged, distributed, and sold. Again, one need only copy the pertinent notes, sub-notes, and Web pages to a computer readable medium, and distribute and sell copies of the computer readable medium to the public.
  • the invention could be used to create attorney bar review course materials. These materials could be used as a supplement to a traditional bar review course, or as an alternative to a bar review course.
  • FIG. 45 A portion of an example notes database 508 for a bar review course is shown in FIG. 45 .
  • Bar review course materials typically include a number of sample tests.
  • a note is associated with each question of each sample test.
  • note 4502 is associated with Question 1.
  • Sub-note A is linked to the portion 4506 of a sample test Web page 4504 that corresponds to Question 1.
  • Sub-note B is linked to the portion 4508 of the sample test Web page 4504 that corresponds to the answer to Question 1.
  • Question 1 pertains to an area of Torts law.
  • Question 1 note 4502 may also include a Sub-note C that is linked to a portion 4516 of a torts text 4514 in an electronic legal library 4512 .
  • This portion 4516 deals with the substantive torts law of Question 1. A student may find it very useful to study this portion 4516 when working with Question 1.
  • the notes database 508 could also include a torts note 4510 that the deals specifically with torts.
  • This torts note 4510 could have sub-notes, such as Sub-notes G and H, that are linked to portions of the torts text 4514 .
  • Sub-notes G and H could have commentary on these portions of the torts text 4514 .
  • the Question 1 note 4502 could then have a Sub-note D that points to Sub-note G in the torts note 4510 .
  • Sub-note G points to the same portion 4516 in the torts text 4514 pointed to by Sub-note C (typically, the Question 1 note 4502 would include Sub-note C or Sub-note D, but not both).
  • Notes dealing with questions other than Question 1 could then point to the sub-notes in the torts note 4510 , as necessary, thereby enhancing reusability.
  • the notes database 508 could also include a case analysis note 4526 that includes sub-notes that point to cases in electronic case reporters 4522 . These sub-notes could include commentary and analysis of such cases.
  • the Question 1 note 4502 could include a Sub-note E that is linked to a Sub-note F in the case analysis note 4528 . This Sub-note F is linked to a case 4524 that deals with the issues of Question 1. Students may find it useful to review this case 4524 when working with Question 1.

Abstract

A system and method of manipulating notes linked to Web pages, and of manipulating the Web pages. These Web pages (or portions of Web pages) can be stored at a Web site or in a local file system. The method of linking notes to Web pages operates by enabling a user to select a portion of a Web page, creating a annotation, linking the annotation to the selected portion, receiving a request from a user viewing the annotation to display the selected portion linked to the annotation, and invoking an application, if the application is not already invoked, and for causing the application to load the Web page and present the selected portion.

Description

    CROSS-REFERENCE TO OTHER APPLICATIONS
  • This application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application No. 60/139,376, filed Jun. 16, 1999, which is incorporated by reference herein in its entirety.
  • This is a continuation-in-part application of the application entitled “System, Method, and Computer Program Product for Creating Sub-notes Linked to Portions of Data Objects After Entering an Annotation Mode,” by Rivette et al., application Ser. No. 09/057,557; filed Apr. 9, 1998, pending, incorporated herein by reference in its entirety.
  • This is a continuation-in-part application of the application entitled “System, Method, and Computer Program Product for Generating Documents Using Pagination Information (As Amended)” by Rivette et al., application Ser. No. 09/057,644; filed Apr. 9, 1998, pending, incorporated herein by reference in its entirety.
  • This patent application is related to U.S. Pat. No. 5,950,214, entitled “System, Method, and Computer Program Product for Accessing a Note Database Having Sub-note Information for the Purpose of Manipulating Sub-notes Linked to Portions of Documents,” by Rivette et al., issued from application Ser. No. 09/058,275, filed Apr. 10, 1998, incorporated herein by reference in its entirety.
  • This patent application is also related to the U.S. Pat. No. 5,623,681, entitled “Method and Apparatus for Synchronizing, Displaying and Manipulating Text and Image Documents,” issued from application Ser. No. 08/155,752, filed Nov. 19, 1993, incorporated herein by reference in its entirety.
  • This patent application is also related to the U.S. Pat. No. 5,806,079, entitled “System, Method, and Computer Program Product for Using Intelligent Notes to Organize, Link, and Manipulate Disparate Data Objects,” issued from application Ser. No. 08/632,801, filed Apr. 17, 1996, incorporated herein by reference in its entirety.
  • This patent application is also related to the U.S. Pat. No. 5,845,301, entitled “System, Method, and Computer Program Product for Displaying and Processing Notes Containing Note Segments Linked to Portions of Documents,” issued from application Ser. No. 08/647,230, filed May 9, 1996, incorporated herein by reference in its entirety.
  • This patent application is also related to the U.S. Pat. No. 5,809,318, entitled “Method and Apparatus for Synchronizing, Displaying and Manipulating Text and Image Documents,” issued from application Ser. No. 08/832,971, filed Apr. 4, 1997, incorporated herein by reference in its entirety.
  • This patent application is also related to the application entitled “Intellectual Property Asset Manager (IPAM) for Context Processing of Data Objects,” by Rivette et al., application Ser. No. 09/260,079, filed Mar. 2, 1999, pending, incorporated herein by reference in its entirety.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • Generally speaking, the present invention is directed to a system, method, and computer program product of linking notes to data objects. In a preferred embodiment, the present invention is directed to a system, method, and computer program product of linking notes to Web pages.
  • 2. Related Art
  • The importance to the modern economy of rapid information and data exchange cannot be understated. This explains the exponentially increasing popularity of the Internet. The Internet is a world-wide set of interconnected computer networks that can be used to access a growing amount and variety of information electronically.
  • One method of accessing information on the Internet is known as the World Wide Web (www, or the “Web”). The Web is a distributed, hypermedia system, and functions as a client-server based information presentation system. Information that is intended to be accessible over the Web is stored in the form of “pages” on general-purpose computers known as “servers.” Computer users can access a Web page using general-purpose computers, referred to as “clients,” by specifying the uniform resource locator (URL) of the page.
  • Hyperlinks are a common function of the Internet. A hyperlink is an element in an electronic document that links to another place in the same document or to an entirely different document. Typically, you click on the hyperlink to follow the link. Hyperlinks are one of the most essential ingredients of all hypertext systems, including the Web. As a publishing tool, hyperlinks enable the publisher to define the direction, location, flow and content of the user's path over the Internet. These single direction hyperlinks are part of published content that the user cannot change or comment on. In the Web environment, HyperText Markup Language (HTML) is the authoring language used to create documents or pages accessible on the Web.
  • In today's Computer Age, there exists a vast amount of information accessible over the Internet that can be processed by computers. Such information is generally referred to herein as data objects, and more specifically referred to herein as HTML documents or Web pages.
  • It is often desirable to organize information such that data objects that somehow relate to a particular topic are associated with other data objects that are related to the same topic. Hyperlinks represent a conventional mechanism for associating data objects with other data objects. FIG. 1 illustrates a scenario involving Documents A, B, C, D, and E. Document A is linked to Document B via Hyperlink B. In a similar manner, Document B is linked to Documents C and D, and Document D is linked to Document E. A user follows Hyperlinks B, C, D, and E to traverse through Documents A, B, C, D, and E using a conventional “point-and-click” methodology.
  • As apparent from FIG. 1, Hyperlinks B, C, D, and E form a trail through Documents A, B, C, D, and E. This trail represents the organization of Documents A, B, C, D, and E. However, Hyperlinks B, C, D, and E do not document or explain this trail. Accordingly, it can be said that Hyperlinks B, C, D, and E form an undocumented trail through Documents A, B, C, D, and E.
  • Consider, for example, Hyperlink B. Hyperlink B merely serves to link Document A to Document B. Hyperlink B does not describe why Document A is linked to Document B. Instead, the explanation or rationale for the linkage of Document A with Document B must be inferred by the user from the contents of Documents A and B.
  • However, it is often difficult to discern the rationale for the linkage between data objects. This is especially true for data objects which are not directly linked (Documents A and B represent two data objects that are directly linked), but which are indirectly linked (Documents A and E represent two data objects that are indirectly linked). For example, it may be very difficult for a user to determine the rationale for the indirect linkage of Document E to Document A. To discern the rationale for this linkage, it may be necessary for the user to review the contents of Documents A, B, D, and E. This could be a difficult and time-consuming task. Even then, the user may not be able to determine the rationale for the linkage. The user is unable to discern this rationale by reference to Hyperlinks B, D, and/or E since, as discussed above, these hyperlinks do not convey any information to the user.
  • In addition, a user will not know of the existence of Document E when following traditional links from Document A until he/she gets to Document E. This link (from Document A to Document E) may be the only link of interest to the user. The traditional linking mechanism is wasteful, as it requires the user to traverse through Documents B and D in order to arrive at Document E. Also, the user may end the search at Document B or Document D, thereby never getting to Document E. Further, traditional linking mechanisms do not provide a means by which to create links, with contextual information within and between different data objects. This type of linkage would provide the user with critical information as to how and why data objects are internally and externally related. Also, traditional links fail to provide the user with the ability to link the same portion of a data object with multiple links and notes to other data objects as well as to other portions of the same data object with varying contextual information on the rational for the links and user ideas or comments on the portion of the linked data object. Accordingly, there is a need for a mechanism that not only organizes, associates, and links data objects internally and externally, but also conveys contextual information explaining the rationale for such organization, association, and linkage, as well as the users' thoughts regarding the data objects.
  • Adding Notes to Data Objects
  • It is often desirable to add notes to data objects. Such notes may include a description of the contents of the data objects, instructions or comments to people working with the data objects, project notes, etc.
  • Some computer applications allow users to attach notes to data objects. For example, some word processors (such as MICROSOFT WORD and WORD PERFECT) allow users to attach notes to their documents. Typically, the user positions the cursor at the point in the document where he wishes to insert the note. The user then keys in the text for the note. The note is linked to the point in the document where the cursor was positioned.
  • Some spreadsheet applications (such as MICROSOFT EXCEL) allow users to attach notes to their spreadsheets. FIG. 2 illustrates an example spreadsheet window 204. The user has attached a note 212 to cell 206 of the spreadsheet 204 via a link 210. A small icon 208 located in cell 206 indicates that a note (in this case, note 212) is linked to cell 206. The user accesses the note 212 from the spreadsheet 204 by clicking on the icon 208.
  • The note functionality of conventional computer applications (including those described above) is limited in many respects. First, these applications restrict the manner in which users are allowed to associate notes with data objects. For example, these applications permit a note to be associated with only a single element in a data object. See FIG. 2, where note 212 is associated with only cell 206. It is not possible to associate note 212 with multiple cells or to establish intra or inter data object links. Also, notes cannot be associated with partial overlapping portions of data objects. For example, the spreadsheet 204 in FIG. 2 does not allow a first note to be associated with cells 206 and 214, and a second note to be associated with cells 214 and 216.
  • Second, these applications do not allow users to group related notes together. Accordingly, these applications do not permit users to organize their notes.
  • Third, these applications do not provide a mechanism for documenting the rationale for linking notes to data objects. For example, in FIG. 2, the link 210 conveys no information that explains the rationale for linking note 212 with cell 206. Instead, the user must attempt to discern this rationale from the contents of note 212 and cell 206.
  • Fourth, these applications do not provide a mechanism for establishing intra or inter data object linking, such as between different spreadsheets in EXCEL or linking with a word processor data object or another computer application data object.
  • The restrictions described above severely diminish the usefulness of notes. Notes are intended to convey information. The ability of notes to convey information is diminished if notes cannot be associated with any portions of data objects, and if notes cannot be organized and structured, and if the rationale for linking notes to data objects is not explicitly conveyed to users.
  • Accordingly, there is a need for a more flexible and intelligent mechanism for attaching notes to data objects.
  • Potential Loss of Information
  • Given these limitations of conventional data organization and note tools, users are not motivated or encouraged to utilize computer related tools to organize work product and data objects that are collected and generated during the performance of a task or project. Instead, such work product and data objects are often maintained in an unorganized state, often scattered about a person's office or haphazardly stored in a makeshift filing system. Also, a person's thinking is not typically documented or recorded. Instead, such thinking remains in the person's head.
  • Thus, a person's thinking, work product, and data objects that are collected and generated during the performance of a task or project are easily lost (either temporarily or permanently) if the person becomes unavailable, is unable to completely remember his thinking, or loses his work product. The person and the person's employer then suffer from this loss of information.
  • Accordingly, what is required is a system and method for enabling the organization and recordation of a person or group's thinking, work product, and data objects collected or generated during a project or task. Such organization and recordation serves to institutionalize the person or group's thinking, work product, and data objects, thereby protecting against the unavailability of persons, memory loss, or loss of work product.
  • SUMMARY OF THE INVENTION
  • Generally speaking, the present invention is directed to a system, method, and computer program product of linking notes to data objects. In a preferred embodiment, the present invention is directed to a system, method, and computer program product of linking annotations (or notes or sub-notes in a note) to Web pages. The invention enables a user to select a portion of a Web page stored at a Web site or from a local file system (if the portion of the Web page was cached). The invention creates an annotation, and links the annotation to the selected portion. The invention receives a request from a user viewing the annotation to display the selected portion linked to the annotation. In response to this request, the invention makes a connection to the Web site, if a connection is not already created, and causes the Web site to send the Web page and present the selected portion. Also note that if the portion of the Web page was cached and thus stored in a local file system, then the present invention does not need to make a connection to a Web site.
  • The present invention also relates to organizing, bi-directionally linking, making annotations (or notes and sub-notes) on, and maintaining disparate Web pages. Bi-directional links as described in this application allow the user to determine the relative location of links on Web page of the Internet or an intranet. Bi-directional links as described in this application also allow the user to select a portion or section of the Web page and then make annotations on the portion of the Web page selected. Bi-directional links as described in this application also link the user to the location of the selected Web page from the note or sub-note about the selected Web page. Once the Web page is placed in annotation mode, the existing bi-directional links appear beside the portion of the Web page selected, beside the annotation (or note/sub-note), and content field of the annotation, and beside the organizational storage of the annotation.
  • The present invention relates generally to organizing, bi-directionally linking, making annotations (or notes and sub-notes) on, and maintaining disparate Web pages. Specifically, embodiments of the invention relate to a standalone mediator that lets users create, manage, arrange, categorize, search, customize, label, title and otherwise maintain annotations on Web pages available on the Internet without changing or manipulating the location of the Web page.
  • Further features and advantages of the invention, as well as the structure and operation of various embodiments of the invention, are described in detail below with reference to the accompanying drawings.
  • BRIEF DESCRIPTION OF THE FIGURES
  • The present invention will be described with reference to the accompanying drawings, wherein:
  • FIG. 1 illustrates a conventional scenario comprising linked documents;
  • FIG. 2 illustrates a conventional spreadsheet application having limited note capabilities;
  • FIGS. 3 and 4 illustrate a marketing related example;
  • FIG. 5 is a block diagram of a Web annotation system according to a preferred embodiment of the present invention;
  • FIG. 6 is a block diagram of an exemplary computer system useful for implementing the present invention;
  • FIG. 7 illustrates the dynamic steps to establish communication between a client and a server executing an object-oriented program. For illustration purposes, FIG. 7 is broken into nine (9) figures including FIG. 7A, FIG. 7B, FIG. 7C, FIG. 7D, FIG. 7E, FIG. 7F, FIG. 7G, FIG. 7H and FIG. 71;
  • FIG. 8 is a high level view of the functional objects of the Web annotation system in a preferred embodiment of the present invention;
  • FIG. 9 illustrates a preferred implementation of the functional objects of the present invention according to a preferred embodiment of the present invention;
  • FIG. 10 is a block diagram used to explain the linking capabilities of the present invention according to a preferred embodiment;
  • FIG. 11 is a legend of colors/fonts and symbols used by the present invention according to a preferred embodiment;
  • FIGS. 12 and 13 depict example computer displays of the display unit in a preferred embodiment of the present invention;
  • FIG. 14 illustrates an example file menu according to a preferred embodiment of the present invention;
  • FIG. 15 illustrates an example edit menu according to a preferred embodiment of the present invention;
  • FIG. 16 illustrates an example view menu according to a preferred embodiment of the present invention;
  • FIGS. 17 and 18 illustrate an example options menu according to a preferred embodiment of the present invention;
  • FIG. 19 illustrates an example note properties menu according to a preferred embodiment of the present invention;
  • FIG. 20 illustrates an example help menu according to a preferred embodiment of the present invention;
  • FIGS. 21 and 22 illustrate the operation of the present invention on the creation of a new sub-note and the linking of the sub-note to the selected portion of the Web page according to a preferred embodiment of the present invention;
  • FIG. 23 illustrates the view mode of the present invention according to a preferred embodiment;
  • FIG. 24 is a block diagram illustrating the effects of a user interface of the present invention according to a preferred embodiment;
  • FIG. 25 illustrates the results of a replication operation according to a preferred embodiment of the present invention;
  • FIG. 26 illustrates an example virtual reality environment according to an embodiment of the present invention;
  • FIG. 27 illustrates the effect of security/privacy features of the invention according to a preferred embodiment;
  • FIG. 28 illustrates an example implementation of the invention according to a preferred embodiment;
  • FIG. 29 illustrates an example link view according to a preferred embodiment of the present invention;
  • FIG. 30 illustrates an example notes database according to a preferred embodiment of the present invention;
  • FIGS. 31-42 are flowcharts depicting a preferred operation of the present invention;
  • FIG. 43 illustrates the drag and drop method of editing notes according to a preferred embodiment of the present invention;
  • FIG. 44 illustrates a movie making example;
  • FIG. 45 illustrates a bar review course materials example; and
  • FIGS. 46-49 are flowcharts depicting a preferred operation of the present invention.
  • TABLE OF CONTENTS
    • 1. Overview of the Invention
      • 1.1 Marketing Expert Example: Business Internet User
      • 1.2 Chef Example: Casual Internet User
    • 2. Structure of the Present Invention
    • 3. Preferred Implementation of the Present Invention
      • 3.1 A Preferred Environment
      • 3.2 A Preferred Software Programming Language and Network Architecture
    • 4. Features and Capabilities of the Present Invention
      • 4.1 Note/Sub-Note Organization
      • 4.2 Linking Sub-Notes To Web Pages
      • 4.3 Examples of Note/Sub-Note Organization and Linking Sub-Notes To Web Pages
      • 4.4 Viewing Notes, Sub-Notes, and Data Objects
      • 4.5 Editing Note/Sub-Note Organization
        • 4.5.1 Modification
        • 4.5.2 Replication
      • 4.6 User Interface
      • 4.7 Security
        • 4.7.1 Security on Individual Note Groupings, Notes, Sub-notes, Links, and Web pages
        • 4.7.2 Security on the Note Database as a Whole
      • 4.8 Search Capabilities
    • 5. Notes Database
    • 6. Operation of the Invention
      • 6.1 Launch an Application
      • 6.2 Create a Note/Sub-note (From the File Menu)
      • 6.3 Create a Note/Sub-note (Using a Pen)
      • 6.4 View Note (By Selecting a Linking Button in a Web Page)
      • 6.5 Search a Note
      • 6.6 E-mail Notes to a Recipient
      • 6.7 Find Specified Text in the Current Web Page
      • 6.8 Modify Privacy/Security Settings
      • 6.9 Edit One or More Notes
      • 6.10 Show Sub-Notes
      • 6.11 Toggle Between Notes and Web Pages View
      • 6.12 Change or View Options
      • 6.13 Change or View Properties
    • 7. Applications of the Invention
      • 7.1 Movie Production
      • 7.2 Bar Review Program
    • 8. Conclusion
    DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • 1. Overview of the Invention
  • The present invention is directed to a system, method, and computer program product (CPP) for attaching annotations (or notes and sub-notes) to data objects, and for linking data objects via the use of annotations. In a preferred embodiment, data objects are Web pages. The note capabilities of the present invention can be used to organize, associate, annotate, and link data objects in an intra and/or inter data object environment with single notes and multiple sub-notes and/or multiple notes and sub-notes to the same data object portions or different data object portions as required by the needs of the user to institutionalize his/her knowledge. Additionally, the note capabilities of the present invention can be used to convey information explaining the rationale for such organization, association, and linkage. Accordingly, the present invention represents a system, method, and CPP for using intelligent notes to organize, associate, annotate, and link data objects. The invention can also be used to manipulate these data objects.
  • As used herein, the term “data object” refers to any information in any form that can be accessed and/or processed by a computer. Such information includes data generated and/or processed by computer applications and computer-related devices such as word processing applications, spreadsheet applications, presentation managers, database managers, financial applications, networking applications, communication applications, sound recorders and processors, video recorders and processors, on-line service applications, scanners, computer aided drafting (CAD) applications, virtual reality applications and environments, etc. The data objects generated and processed by these applications and devices vary widely in subject matter. Also, these data objects come in many forms, such as text files, image files, video files, audio files, computer programs, Web pages, etc. Accordingly, these data objects are disparate in both form and content.
  • The invention is adapted to memorialize and/or institutionalize a person's or group's thinking and work product regarding a subject. If a person's or group's thinking and work product are not memorialized or institutionalized, then such thinking and work product may be lost or not accessible when needed if the person or group becomes unavailable, or is unable to remember its thinking, or loses its work product.
  • The present invention relates generally to organizing, bi-directionally linking, making notes and sub-notes on, and maintaining disparate data objects. A preferred embodiment of the present invention relates to organizing, bi-directionally linking, making notes and sub-notes on, and maintaining disparate Web pages. Specifically, embodiments of the invention relate to a standalone mediator that lets users create, manage, arrange, categorize, search, customize, label, title and otherwise maintain notes on Web pages available on the Internet without changing or manipulating the location of the Web page.
  • 1.1 Marketing Expert Example: Business Internet User
  • The invention shall initially be described by way of several examples. Consider a scenario where a marketing expert regularly uses the Internet for research to determine if there are products that may compete with his company's software product. Referring to FIG. 3, the marketing expert first discovers company ABC's Web site that contains a Web page 302 containing a press release detailing the launch of a new ABC software product. The marketing expert notices that the ABC software product appears to directly compete with his company's software product. The marketing expert may or may not record his thinking 312.
  • The expert then notices links to other Web pages that provide interesting information including, a more detailed explanation on all ABC products, strategic partners to ABC, major customers of ABC, and entities that have invested in ABC. It is important to note that these Web pages could be either located on the same Web site as Web page 302, or be located on a different Web site.
  • The expert first clicks on the link to a Web page 304 describing ABC products in more detail. The expert notes some additional products that may also compete with his company's software product. The expert may or may not record his thinking 314.
  • The expert next requests a Web page 306 discussing the strategic partners of ABC. The expert recalls that one of the strategic partners listed is currently talking to his company about a joint venture. The expert may or may not record his thinking 316.
  • Next, the expert requests a Web page 308 that contains information relating to ABC's major customers. The expert notes some of the same customers of his company, along with some potential customers. The expert may or may not record his thinking 318.
  • Finally, the expert requests a Web page 310 that has information relevant to ABC's past and current investors. The expert recalls that one of the investors listed has recently declined an offer to invest in his company. The expert may or may not record his thinking 320. The expert's overall analysis and conclusions involving the ABC company may or may not be recorded 322.
  • The scenario described above and shown in FIG. 3 represents a conventional investigation, analysis and decision process. This conventional process may or may not be documented. In particular, the marketing expert's thinking during each step of the process may or may not be documented. Such thinking is represented by blocks 312, 314, 316, 318, 320, and 322. The expert may document such thinking (by writing or dictating notes, for example). However, the expert is just as likely to maintain his thinking only in his head. In this latter case, the expert's thinking will be lost or not accessible when needed if the expert becomes unavailable, or is unable to remember his thinking.
  • The investigation, analysis, and decision process represented by FIG. 3 will not be fully documented, even if the expert documents his thinking in blocks 312, 314, 316, 318, 320, and 322. In other words, the total work product and thinking resulting from the investigation, analysis, and decision process of FIG. 3 will not be fully documented simply by the documentation of thinking blocks 312, 314, 316, 318, 320, and 322. This is the case for at least two reasons. First, such documentation will be very disorganized. The documentation will not indicate how one note is related to another note. Second, such documentation will include only the expert's thinking (represented by blocks 312, 314, 316, 318, 320, and 322). The documentation will not include copies of the Web pages upon which such thinking was based or a reference to the exact portion (text excerpt, video section, audio segment, etc.) that is relevant to the expert's thinking and analysis. In instances with voluminous Web pages, the lack of this type of reference or the like prevents the expert from clearly communicating and recording the basis for the analysis. That is, the documentation will not include the Web pages relating to press release 302, the detailed description of ABC company products 304, the strategic partners 306, the major customers 308, and the past and current investors 310. The documentation may contain cites to some of these Web pages, but it would be necessary for a person to manually retrieve these Web pages in order to evaluate them. Such manual retrieval is inefficient, as it requires another person to perform the same tasks as the expert. Also, such manual retrieval may not be possible, since particular Web sites and/or Web pages often become unavailable over time. Further, as noted above, such cites will not be to the exact portion (text excerpt, video section, audio segment, etc.) that is relevant to the expert's thinking and analysis.
  • The invention addresses and solves the problems illustrated by the conventional investigation, analysis, and decision process of FIG. 3. The invention is adapted to memorialize and/or institutionalize the expert's total work product and thinking related to the investigation, analysis, and decision process. By doing so, the invention ensures that the expert's total work product and thinking will survive and be accessible when needed, even if the expert becomes unavailable, or is unable to remember his thinking, or loses the hard copies of his work product.
  • The operation of the invention is represented by FIG. 4. The invention allows the expert to create a note 401 comprising multiple sub-notes 402, 404, 406, 408, 410, and 412. The expert records his thinking in these sub-notes 402, 404, 406, 408, 410, and 412. For example, according to the present invention, the expert reviews the press release 302 and notices that the ABC software product appears to be very similar to his company's software product. The expert records his thinking regarding the press release 302 and the potential competition between the ABC software product and the expert's company product sub-note 402.
  • The sub-notes 402, 404, 406, 408, 410, and 412 are linked to the relevant portions of the Web pages upon which the expert's thinking is based. Such linkage is represented by links 430, 432, 434, 436, 438, and 440. For example, the expert links sub-note 402 to the relevant portion of the press release 302. As another example, recall that the expert looks at ABC's other products 304 to see if what other competing products may exist. The expert records his thinking regarding the other products in 404. The expert links sub-note 404 to that relevant portion of the ABC's other products 304 containing the competitive products. By linking sub-note 404 to only the relevant portion of the ABC's other products 304 pertinent to the expert's thinking recorded in sub-note 404, the expert creates a documented trail that is more useful and effective at communicating his work product and thinking.
  • The sub-notes 402, 404, 406, 408, 410, and 412 and the links 430, 432, 434, 436, 438, and 440 collectively represent the expert's total work product and thinking. The sub-notes 402, 404, 406, 408, 410, and 412 and the links 430, 432, 434, 436, 438, and 440 are stored in a computer database. Thus, the invention memorializes and/or institutionalizes the expert's total work product and thinking.
  • As will be described below in more detail, the marketing expert can categorize the notes he makes on the Web site(s) by color and by the shape of the bi-directional hyperlink he associates with the part of the Web page he has selected. The expert stores these notes on his own computer and the Web site is left unmarred. At a later time, the expert can revise the content of the notes and then decides which company strategist should receive which copies of the notes and Web pages. The notes he has made on the Web site can be shared in their entirety, by note (a collection of sub-notes), by type (based on a pre-set or user-defined filter), or by sub-note. For example, the expert may decide to send a copy of the notes on strategic partners 406 to his Vice-President of Marketing, a copy of the notes on major customers 408 to his Vice President of Sales, and a copy of the notes on past and current investors 410 to his CEO. He also informs his marketing department that he has stored all of his notes on a public directory for all of the members of the marketing department to read and further develop. The present invention allows the marketing expert to remark on any location on the Internet and choose the people he would like to securely view his notes.
  • As described in more detail below, the present invention notifies the marketing expert when the Web page has changed in one or both of the following ways. The marketing expert can be notified that the Web page changes its content when the user is notified by e-mail of a change in the data object. The marketing expert can be notified that the Web page has changed its content when he activates a bi-directional link intended to take him from his note or sub-note to the Web page, and the marketing expert will have the option of re-linking his notes to locations on the changed Web page.
  • 1.2 Chef Example: Casual Internet User
  • A more casual use of the present invention is described next. Consider a scenario where a chef who casually uses the Internet to find recipes receives an email from a customer to look at a particular URL that has an excellent recipe for Creme Brulee. Ordinarily the chef would visit the site, see the information, and perhaps try the recipe. Using the present invention the e-mail from the customer would contain an attachment for viewing the customers note's on the URL. If the chef did not have the current invention on his computer, activating the attachment would give him the option of automatically navigating to a Web site where he can download the application. Also included in the email would be a URL the chef could simply click on to get to the location where he can download the application.
  • Once the attachment is activated and the present invention's application executes, the Web page of the recipe of interest to the chef appears with all of the customer's notes listed and color-coded. One color for tips about equipment, one color for tricks about making the recipe more successful, and one color for missing steps in the recipe's procedure.
  • The chef uses this information and tries the recipe. He adds several more tips about equipment and adds a new color for a new category of notes titled Customer Feedback. He then uses the present invention to send this new set of notes to several other chefs and to the customer who sent the original notes. Now all the people that receive the e-mail can view the same URL and the same set of notes and make notes of their own. Some they can store locally, others they can store on a network, and of both sets of notes they can choose which ones or which set of notes to send to others. They may choose to send a single sub-note, several sub-notes, or a full note containing any number of combinations of additional notes and sub-notes.
  • The chef can save his notes and sub-notes and print them individually or in sets or even related sets based on his own needs. The chef may later receive notes from the people he sent his notes to; he can view those notes on the recipe Web page and include the notes sent to him in his own collection of notes and sub-notes. The invention is preferable implemented using a Web annotation system 502 (FIG. 5). The Web annotation system 502 is described in the following section.
  • 2. Structure of the Present Invention
  • FIG. 5 is a block diagram of a Web annotation system 502 according to a preferred embodiment of the present invention. The Web annotation system 502 includes a user interface 504, a notes engine 506, a Web pages engine 509, a notes database 508, and a Web pages database 509. The notes database 508 includes annotations (also called notes and sub-notes or note sections) that are attached to Web pages generated and/or processed by applications 512. The Web pages database 509 may be used to store Web pages, or a Web page's images or its text, that are associated with notes stored in notes database 508 for greater speed in re-loading the data objects when the user returns to the note or sub-note on the Web page. The applications 512 include any computer applications that generate and/or process information accessible via the Internet.
  • The notes engine 506 manages the notes database 508. More particularly, the notes engine 506 enables users to create, modify, delete, link, view, create hierarchies of annotations (or notes and sub-notes), categorize, classify, view the location or address of the selected Web page, view the name or title of the selected Web page, re-link notes to changed Web pages, and otherwise manipulate the notes and sub-notes in the notes database 508. Users gain access to the functions supported by the notes engine 506 via the user interface 504.
  • The Web pages engine 507 manages the Web pages database 509. More particularly, the Web pages engine 507 enables users to cache or store, or otherwise maintain, Web pages and parts of Web pages stored in Web pages database 509 for greater speed in re-loading the Web page when the user returns to the note or sub-note on the Web page. The caching feature of the present invention means that the present invention does not need to make a connection to a Web site. Users gain access to the functions supported by the Web pages engine 507 via the user interface 504.
  • In performing its function, the Web annotation system 502 drives, controls, manipulates, and otherwise interacts with the applications 512. For example, the Web annotation system 502 controls the applications 512 so as to open Web pages (i.e., access Web sites containing Web pages), display particular portions of Web pages, highlight portions of Web pages using particular fonts, patterns, and/or colors, display icons and/or buttons, etc.
  • Preferably, the present invention achieves this functionality by interacting with applications 512 that support an interface 510 defining the interaction between computer applications. In one embodiment of the present invention, the interface 510 uses the Object Linking Embedded (OLE) standard. The OLE standard is well known and defines the manner in which one software application may drive, control, manipulate, and otherwise interact with another software application. The OLE standard is described in many publicly available documents, such as Microsoft OLE Programmers Reference, Volumes I and II, 1993, which are herein incorporated by reference in their entirety. The OLE standard is based on the Component Object Model (COM). The COM enables programmer to develop objects that can be accessed by any COM-compliant application.
  • In a preferred embodiment of the present invention, the interface 510 uses JScript and Dynamic HTML (DHTML) standards. Both of these standards are also based on the COM, as the OLE standard discussed above. JScript is Microsoft's extended implementation of ECMAScript (ECMA262), an international standard based on the Netscape's JavaScript and Microsoft's JScript languages. JScript is implemented as a Windows Script engine. This means that it can be “plugged in” to any application that supports Windows Script, such as Internet Explorer, Active Server Pages, and Window Script Host. It also means that any application supporting Windows Script can use multiple languages, including JScript, VBScript, Perl, and others. JScript can be used for both simple tasks (such as mouseovers on Web pages) and for more complex tasks (such as updating a database with ASP or running logon scripts for Windows NT).
  • In general, dynamic HTML refers to Web content that changes each time it is viewed. For example, the same URL could result in a different page depending on any number of parameters, such as: geographic location of the user, time of day, previous pages viewed by the user, and profile of the user. DHTML refers to new HTML extensions that will enable a Web page to react to user input without sending requests to the Web server.
  • It should be understood that the invention is not limited to use with OLE, JScript, or DHTML components. The applications 512 can be any conventional or implementation specific applications, as long as they have the capability of being externally controlled (in this case, as long as they have the capability of being controlled by the Web annotation system 502).
  • Standard windows operations are mentioned in this disclosure. Such operations include selecting text, opening files, moving between windows, resizing windows, editing documents, etc. Such operations are well known and are described in many publicly available documents, such as Microsoft Word for Windows Users Guide, 1994, incorporated herein by reference in its entirety.
  • 3. Preferred Implementation of the Present Invention
  • 3.1. A Preferred Environment
  • In an embodiment of the present invention, components of the present invention (such as the Web annotation system 502) are each implemented using a computer system 602 such as that shown in FIG. 6. The computer system 602 includes one or more processors, such as a processor 604. The processor 604 is connected to a communication bus 606. The computer system 602 also includes a main or primary memory 608, preferably random access memory (RAM). The primary memory 608 has stored therein control logic 610, such as software corresponding to the Web annotation system 502, the notes database 508, and the Web pages database 509.
  • It should be understood that the notes database 508 and/or the Web pages database 509 are not necessarily stored within a single computer. Instead, the notes database 508 and/or the Web pages database 509 may be distributed among multiple computers. Such distribution of the notes database 508 and/or the Web pages database 509 are described in further detail below.
  • The computer system 602 also includes a secondary memory 612. The secondary memory 612 includes, for example, a hard disk drive 614 and/or a removable storage drive 616, representing a floppy disk drive, a magnetic tape drive, a compact disk drive, a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as EPROM or PROM), etc., which is read by and written to by removable storage unit 618. As will be appreciated, the removable storage unit 618 includes a computer usable storage medium having stored therein computer software and/or data. The removable storage drive 616 reads from and/or writes to a removable storage unit 618 in a well known manner. Removable storage unit 618, also called a program storage device or a computer program product, represents a floppy disk, magnetic tape, compact disk, etc.
  • Computer programs (also called computer control logic) are stored in main memory 608 and/or the secondary memory 612. Such computer programs, when executed, enable the computer system 602 to perform the functions of the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor 604 to perform the functions of the present invention. Accordingly, such computer programs represent controllers of the computer system 602. The Web annotation system 502 preferably represents a computer program executing in the computer system 602.
  • The computer system 602 also includes a communication interface 620. The communications interface 620 enables the computer system 602 to communicate and interact with locally or remotely located external devices 624 via a communications medium 622. In particular, communications interface 620 enables the computer system 602 to send and receive software and data to/from the external devices 624. Examples of the communications interface 622 include a modem, a network interface (such as an Ethernet card), a communications port, etc.
  • The computer system 602 also includes a display unit 626, such as a computer monitor, and one or more input devices, such as a keyboard and a pointing device (such as a mouse, trackball, etc.).
  • In one embodiment, the invention is directed to a system 602 as shown in FIG. 6, and having the functionality described herein. In another embodiment, the invention is directed to a computer program product having stored therein computer software (having the functionality described herein) for controlling computer systems, such as computer system 602. In another embodiment, the invention is directed to a system and method for transmitting and/or receiving computer software (having the functionality described herein) to/from external devices 624.
  • 3.2. A Preferred Software Programming Language and Network Architecture
  • As discussed above, computer programs when executed, enable computer 602 to perform the functions of the present invention as discussed herein. In a preferred embodiment, the present invention is implemented using computer programs written in an object-oriented programming language. Object-oriented programming is a type of programming in which programmers define not only the data type of a data structure, but also the types of operations (functions) that can be applied to the data structure. In this way, the data structure becomes an object that includes both data and functions. In addition, programmers can create relationships between one object and another. For example, objects can inherit characteristics from other objects.
  • One of the principal advantages of object-oriented programming techniques over procedural programming techniques is that they enable programmers to create modules that do not need to be changed when a new type of object is added. A programmer can simply create a new object that inherits many of its features from existing objects. This makes object-oriented programs easier to modify. To perform object-oriented programming, one needs an object-oriented programming language (OOPL). C++ and Smalltalk are two of the more popular languages, and there are also object-oriented versions of Pascal. While a preferred embodiment of the present invention is implemented using computer programs written in an object-oriented programming language, the present invention can also be implemented using procedural programming languages, etc.
  • As discussed above, one or more of computers 602 is connected by a network. A preferred embodiment of the present invention uses a type of network architecture called a peer-to-peer object architecture. Before peer-to-peer object architecture can be understood, a type of network architecture called client/server architecture must be described. Client/server architecture is a network architecture in which each computer or process on the network is either a client or a server. Servers are computers or processes dedicated to managing disk drives (file servers), printers (print servers), applications/functions or network traffic (network servers). In fact, a server is any computer or device that allocates resources for an application. Clients are personal computers or workstations on which users run applications. Clients rely on servers for resources, such as files, devices, execution of functions and even processing power.
  • FIG. 7 illustrates an example of the dynamic steps to establish communication that occur between a client and a server executing an object-oriented program. In FIG. 7A, the server has switchboard object 702 and listen object 704 waiting for a request from the client. In FIG. 7B, init object 706 determines that it needs to perform a specific task. In FIG. 7C, init object 706 creates comm object 708. Comm object 708 is used to communicate with the server. Then, comm object 708 makes a connection to listen object 704 in FIG. 7D. Once comm object 708 makes the connection, listen object 710 creates comm object 710 and relocates comm object 710 to switchboard object 702. Comm object 710 is used to communicate back to the client (i.e., between the two piers), via comm object 708.
  • At this point, as shown in FIG. 7F, there is two-way communication between the client and the server (i.e., between the two piers) through comm object 708 and comm object 710. Init object 706 knows which receiver object needs to be created by the server (i.e., receiving pier) to preform the specific task required. Therefore, once this communication is established, init object 706 sends a request to the server (i.e., receiving pier) to create the specific receiver object. In FIG. 7G, switchboard object 702 receives the request, via comm object 710, and creates receiver object 712. Once receiver object 712 is created, comm object 710 is relocated to receiver object 712 in FIG. 7H. Now, as shown in FIG. 7I, init object 706 and receiver object 712, via comm object 708 and comm object 710, can communicate back and forth until receiver object 712 completes the task requested by init object 706.
  • As stated above, a preferred embodiment of the present invention uses a type of network architecture called a peer-to-peer object architecture. A peer-to-peer object architecture is when each computer in the network has equivalent capabilities and responsibilities. This differs from client/server architectures, in which some computers are dedicated to serving the others. Therefore, in a preferred embodiment of the present invention, all computers 602 can operate as either a server or a client.
  • As discussed above, one advantage of using an object-oriented programming language is that it allows programmers to create modules that do not need to be changed when a new type of object is added. This advantage will be further illustrated as the present invention is described in detail.
  • 4. Features and Capabilities of the Present Invention
  • In one embodiment of the present invention, Web annotation system 502 is implemented as computer 602 operating as described in reference to FIG. 6 above. Computer 602 executes computer programs to enable it to perform the features and capabilities (or functions) of the present invention. Thus, Web annotation system 502 executes computer programs to perform its functions. As discussed above, the computer programs executed by Web annotation system 502 are preferably written in an object-oriented programming language and executed in a peer-to-peer object architecture.
  • An advantage of any object-oriented program, and thus also with computer programs executed by Web annotation system 502, is that they enable programmers to create modules that do not have to be changed when a new type of object is added. An object includes both the data and functions required to perform a task. Thus, by implementing the functions to be performed by Web annotation system 502 as objects, created modules do not need to be changed when a new type of object (or function) is added. This implementation of the present invention reduces complexity and thus increases efficiency.
  • Described above with reference to FIG. 7, is the dynamic steps involved in establishing communication between a client and a server executing an object-oriented program. As Web annotation system 502 of the present invention executes its various functions, the same dynamic steps involved in communication between the server and client occur for each function as shown in FIGS. 7A through 7I. FIG. 7 shows a generic init object 706 and a generic receiver object 712. For each type of function performed by Web annotation system 502, init object 706 and receiver object 712 are replaced by specific init and receiver objects that perform their specific functions.
  • The types of functions performed by Web annotation system 502, through the execution of computer software, note/sub-note organization, linking sub-notes to Web pages, viewing notes, sub-notes and Web pages, editing note/sub-note organization, and so forth. For simplicity, the figures used to illustrate the individual functions of Web annotation system 502 do not include switchboard object 702 and listen object 704 of FIG. 7.
  • The functionality of the present invention implemented as objects shall be further described by reference to FIG. 8. FIG. 8 is a high level view of the functional objects of the Web annotation system 502 in a preferred embodiment of the present invention. The functional objects are organized in a hierarchical fashion and each functional object contains a data object wrapper that supports a COM interface and a data object. Referring to FIG. 8, the functional objects include a Web annotation system object 802, a note repository object 804, a note object 806, a sub-note object 808, a content object 810, an anchor object 812, a Web page repository object 814, a Web page folder object 816, and a Web page object 818. The content object 810 stores data that conveys information. This data is user definable and includes at least information that explains the rationale for linking the sub-note object 808 to a portion of the Web page object 818. The data stored in the content object 810 can be any format or combination of formats, such as text, sound, video, image, executable program, tactile (such as braille), etc. The anchor object 812 is linked by a bookmark link 820 to a portion of the Web page object 818. According to the present invention, the bookmark link 820 is bi-directional.
  • Each note object 806 preferably contains data including its title, the date and time of creation, the data and time of last modification, a listing of all of its sub-notes, etc. Each sub-note object 808 also preferably stores data including its title, the date and time of creation, the data and time of last modification, its content object, its anchor object, privacy settings, etc. The anchor object 812 contains data indicating the color and which pen was highlighted when the pointer was used to select the selected portion to which the sub-note is linked. The anchor object 812 also stores data representing the data object that the sub-note object 808 is linked with. This data may include a URL for non-cached Web pages and a filename for cached Web pages, a frame index array to the frame that contains the annotation, apiece of data (e.g., TextRange bookmark) that describes a text selection on the given frame of the given Web page, pixels that get printed to a screen, etc.
  • A frame index array is a collection of indexes that specify a frame. For example, a simple Web page may contain only one frame. The present invention would indicate this with an empty frame index array. Another example for a Web page that has three frames, and it is the second frame that is annotated by the present invention, the frame index array contains the number 1. (Note that arrays start with an index of 0). Once the frame is specified, the present invention may utilize at least four different ways to specify the selected text. An preferred way is through the use of a TextRange. A TextRange can be created from the current selection. A TextRange can be persisted to a “bookmark” (such as bookmark link 820), which is an opaque piece of data that represents the TextRange. This can be used to store the TextRange at a later time. In another embodiment, the present invention maintains a character offset to the start of the range, and then the number of characters in the TextRange. In yet another embodiment, the present invention maintains a collapsed TextRange bookmark to start the selected text or portion, and the number of characters in the TextRange. In yet another embodiment, the present invention maintains a collapsed TextRange bookmark to the start of the selected text or portion, and another collapsed TextRange bookmark to the end of the selected text.
  • Conceptually, note repository object 804, note object 806, sub-note object 808, content object 810, and anchor object 812 make up the notes database 508 (FIG. 5). Likewise, Web page repository object 814, Web page folder object 816, and Web page object 818 conceptually make up Web pages database 509.
  • The user interface 504 creates, updates, and deletes objects in the Web annotation system 502 preferably using the COM interfaces. In order to do this, the user interface 504 must first gain access to a functional object through the top level object, namely the Web annotation system object 802. The Web annotation system object 802 can return to the user interface 504 the note repository object 804 and/or the Web page repository object 814. Once the user interface 504 has either the note repository object 804 or the Web page repository object 814, it can use either of these (based on its interface) to: navigate to other objects, create child objects, remove child objects, and modify child objects.
  • Each of the functional objects 802-818 shown in FIG. 8 preferably follows a pattern of implementation as shown in FIG. 9. In FIG. 9, the user interface 504 uses a COM interface 902 to access a generic functional object 903 (same as described above). The functional object 903 contains a data object wrapper 906 that supports the COM interface 902 and a data object 908 that can be stored in either a flat file 910 or a database 912. The functional object 903 uses the data access interface 904 to access the data object 908. In theory, the data access interface 904 could go across a network connection to access the data object 908, or it could access the data object 908 stored physically on the same computer. The present invention includes a multitude of functions which enable it to achieve the advantages discussed herein. Many of these functions are discussed in the following sections.
  • 4.1 Note/Sub-Note Organization
  • The present invention supports a note/sub-note hierarchy, where a note may include zero or more sub-notes. This is shown in FIG. 29, for example, where Note A includes Sub-notes A, B, and C. Note B includes Sub-notes B and C (dashed line 2950B is discussed below), Note C includes Sub-notes B, D, and E, and Note D includes Sub-notes E and F.
  • The note/sub-note hierarchy is useful for organizing information. In particular, the note/sub-note hierarchy allows users to group together related sub-notes for organization purposes. Related sub-notes may be grouped together under one note.
  • The note/sub-note hierarchy is extendable to multiple-levels. For example, related notes can be grouped together under a note grouping. In essence, a note itself is also an implementation of a note grouping because a note can contain other notes (or sub-notes). In FIG. 29, for example, Notes A and B are grouped together under Note Grouping A. Notes B, C, and D are grouped together under Note Grouping B. The sharing of Note B between Note Grouping A and Note Grouping B is one embodiment of the present invention. In another embodiment, notes and/or sub-notes are not shared. It should be understood that the invention is not limited to the three level hierarchy shown in the example of FIG. 29. The invention is extendable to more than three levels.
  • The note/sub-note hierarchy of the invention is very flexible. Multiple note groupings may include the same note. For example, both Note Groupings A and B include Note B. Also, multiple notes may include the same sub-note. For example, Notes A, B, and C include Sub-note B.
  • The note/sub-note hierarchy is defined by users. That is, users define which notes are contained in note groupings, and which sub-notes are contained in notes. The invention includes tools for enabling users to define and modify the note/sub-note hierarchy (such tools are discussed below).
  • 4.2 Linking Sub-Notes To Web Pages
  • The present invention allows users to link sub-notes to portions of data object, preferably Web pages. In FIG. 29, for example, Sub-note A is linked to a portion of Web Page A via link 2911. As discussed above, a Web page (or data object) represents any information in any form that can be accessed and/or processed by a computer via the Internet. The Web pages generated and processed by these applications and devices vary widely in subject matter. Also, these Web pages (or data objects in general) come in many forms, such as text files, image files, video files, audio files, computer programs, HTML documents, etc. Accordingly, these Web pages are disparate in both form and content.
  • Users can navigate from sub-notes to Web pages via the links. For example, a user can navigate from Sub-note A to Web Page A via link 2911.
  • The links between sub-notes and Web pages are bidirectional. Thus, in addition to being able to navigate from sub-notes to Web pages via the links, users can also navigate from Web pages to sub-notes via the links. For example, a user can navigate from Web Page A to Sub-note A via link 2911.
  • A note or sub-note may be linked to all or any portion of a Web page. (In the discussion contained herein, attributes of sub-notes also apply to notes.) Multiple sub-notes may be linked to portions of the same Web page. This is true, whether the sub-notes are in the same or different notes. These Web page portions may be completely overlapping, partially overlapping, or non-overlapping. Also, the sub-notes in a note may be linked to portions of a single Web page, or to portions of one or more Web pages.
  • A Web page may be linked to one or more sub-notes (these sub-notes may be in the same note, or in multiple notes). In FIG. 29, for example, Web page A is linked to Sub-notes A, C, and D.
  • Users can navigate from sub-notes in a first note to sub-notes in a second note via common Web pages. In FIG. 29, for example, a user can navigate from Sub-note A in Note A to Sub-note D in Note C via Web Page A, which is linked to both Sub-note A (via link 2911) and Sub-note D (via link 2917).
  • The linking capabilities of the present invention shall be further described by reference to an example scenario presented in FIG. 10. The Web annotation system 502 in the example of FIG. 10 includes notes 1014A and 1014B (these notes are stored in the notes database 508, which is not explicitly shown in FIG. 10). Each note 1014 includes a plurality of sub-notes 1016.
  • Each sub-note 1016 is linked to a Web page 1020. Each Web page 1020 is associated with one or more applications 512. A Web page 1020 is associated with an application 512 if the application 512 is capable of accessing and/or processing the Web page 1020. More particularly, each sub-note 1016 is linked to a portion 1022 of a Web page 1020. A portion 1022 may include all or part of a Web page 1020. Portions 1022 in the same Web page 1020 that are linked to sub-notes 1016 may be distinct (non-overlapping), may completely overlap, or may partially overlap.
  • For purposes of illustration, it is assumed herein that each Web page is associated with a single computer program application. This association between Web pages and applications may be established in any well known manner, such as by file extension. For example, all files having a “wpd” extension are as a default associated with the WORD PERFECT word processing application, all files having a “wks” extension are as a default associated with the LOTUS 1-2-3 spreadsheet application, all files having a “db” extension are as a default associated with the PARADOX database application, etc. These default associations between Web pages and applications are preferably user definable. Preferably, users may override these default associations at the time that a sub-note is linked with a Web page, or at any time thereafter.
  • A note 1014 may contain sub-notes 1016 that are linked to portions 1022 of a single Web page 1020, or multiple Web pages 1020. These Web pages 1020 may be associated with a single application 512, or with multiple applications 512. For example, note 1014A includes sub-notes 1016A, 1016B, 1016C that are linked to portions 1022A, 1022C, 1022B, respectively, of Web pages 1020A, 1020B that are associated with application 512A. Note 1014A also includes a sub-note 1016D that is linked to portion 1022D of object 1020C associated with application 512B.
  • Multiple sub-notes 1016 in the same or different notes 1014 may be linked to the same portion 1022 of a Web page 1020. For example, sub-notes 1016D and 1016F are linked to portion 1022D of object 1020C.
  • In one embodiment of the present invention, a note 1014 is not a Web page. In another embodiment of the present invention, a note 1014 represents a Web page. Accordingly, a sub-note 1016 may be linked to a portion of a note 1014. For example, sub-note 1016E is linked to portion 1022F of note 1014B. Portion 1022F includes sub-note 1016G.
  • Each sub-note 1016 includes a content data that is used to convey information. The content data are user definable. Preferably, the content data includes at least information that explains the rationale for lining the sub-note 1016 to the portion 1022 of the Web page 1020. For example, the content field 1512 could include a description of how the portions 1022 linked to the sub-notes 1016 in the note 1014 are related to one another. The content field 1512 can be any format or combination of formats, such as text, sound, video, image, executable program, tactile (such as braille), etc.
  • The mechanism for liking portions 1022 of Web pages 1020 with sub-notes 1016 is generally represented in FIG. 10 as links 1038. According to the present invention, this linking mechanism 1038 is bi-directional. Thus, a user viewing portion 1022B of Web page 1020A can issue a command to view sub-note 1016C. Also, a user viewing sub-note 1016D can issue a command to automatically launch application 512B, load Web page 1020C, and view portion 1022D.
  • The linking mechanism 1038 of the present invention enables users to easily traverse through related Web pages 1020, and through sub-notes 1016. For example, a user could command the Web annotation system 502 to display the note 1014A. From note 1014A, the user could move from sub-note 1016A to portion 1022A and back again, from sub-note 1016B to portion 1022B and back again, etc. Accordingly, the notes 1014 and sub-notes 1016 represent a trail through portions 1022 in Web pages 1020.
  • The linking mechanism 1038 of the present invention enables users to access portions 1022 of Web pages 1020 in any order. This represents random access technology. For example, a user can access in any order the portions 1022 of Web pages 1020 linked to the sub-notes 1016 in the note 1014A. In this respect, the invention is superior to conventional mechanisms for lining documents, such as that shown in FIG. 1, where documents must be accessed in a predefined order. Such conventional mechanisms represent sequential or linear access technology. Thus, the trail through documents provided by the linking mechanism 1038 of the present invention is much more flexible and user-friendly than the trail provided by conventional linking mechanisms.
  • One or more notes can be grouped together under one note grouping. A note grouping table 1090 or other database construct is used to keep track of which notes are in which note groupings. In the example of FIG. 10, notes 1014A and 1014B are in Note Grouping A. Each note 1014 preferably includes information that identifies which Note Grouping it is in, such that it is possible to traverse from a note to a note grouping, and vice versa. This is described further below. Further levels of organization are also supported by the invention, using the same or extensions of the organizational constructs (note groupings, notes, sub-notes, links, etc.) discussed herein.
  • The note/sub-note hierarchy feature and the linking feature of the invention as described above collectively provide at least two ways to organize information, and to memorialize/institutionalize a person or group's thinking and work product. First, the Web annotation system 502 provides a note/sub-note hierarchy. The note/sub-note hierarchy allows users to group together related sub-notes for organization purposes. That is, related sub-notes may be grouped together under one note. The grouping together of related sub-notes conveys to a certain extent the rationale for the linking together of Web pages 1020.
  • Second, the Web annotation system 502 provides a means for explicitly documenting the trail through Web pages 1020 as established by the linking mechanism 1038. Such documentation is achieved by the sub-notes 1016. As discussed above, each sub-note 1016 includes a content field 1512 (FIG. 15) that is used to convey information. The content field 1512 preferably includes at least information that explains the rationale for linking the sub-note 1016 to the portion 1022 of the Web page 1020. Thus, the rationale for the trail established by the linking mechanism 1038 is explicitly explained by the information contained in the sub-notes 1016.
  • Note that there is no guarantee that a Web page stored on a Web site is not changed or even deleted. Thus, there is no guarantee that the information stored by the present invention for the linked portion of a Web page is valid if the user does not use the caching function provided by the present invention. If the user does not use the caching function, there are ways in which the present invention checks to ensure a Web page has not changed, including utilizing a checksum, comparing the “last modified” date that is returned on the Web page access to the “last modified” date that the present invention is expecting.
  • 4.3 Examples of Note/Sub-Note Organization and Linking Sub-Notes to Web Pages
  • The note/sub-note hierarchy feature and the linking feature of the invention shall now be further described in this section by the use of examples. These examples will also serve to illustrate the general operation of the Web annotation system 502.
  • FIG. 11 is a legend 1102 of colors 1106, 1110, 1114, 1118, 1122 used by the present invention for color coding purposes. Colors 1106, 1110, 1114, 1118, 1122 are preferably red, green, yellow, cyan, and magenta, although other colors could alternatively be used. Colors 1106, 1110, 1114, 1118, 1122 could represent different patterns and/or fonts in addition to or instead of colors. This is especially useful when the notes application 302 is used with a computer having a black and while monitor. In one embodiment, the colors/patterns/fonts are user definable (this embodiment is discussed further below).
  • The legend 1102 depicts different symbols 1108, 1112, 1116, 1120, 1126 used by the present invention. For purposes of the present invention, symbols 1108, 1112, 1116, 1120, and 1124 are associated with colors 1106, 1110, 1114, 1118, and 1122, respectively. When displaying these symbols 1108, 1112, 1116, 1120, 1126, the invention fills the symbols 1108, 1112, 1116, 1120, 1126 with their associated colors 1106, 1110, 1114, 1118, 1122, respectively.
  • FIG. 12 depicts an example computer display 1202 of the display unit 626 (FIG. 6). The computer display 1202 is currently displaying a notes toolbox window 1206, a Web page window 1208, a notes/Web page directory window 1212, and a notes text window 1214. Also shown in FIG. 12 is a pointer 1220 corresponding to the mouse or other pointing device, such as a trackball.
  • The Web page window 1208 is generated by an application that can process Web pages, such as a Web browser or the Aureka Workbench available from Aurigin, Inc., Mountain View, Calif. The Web page window 1208 is currently displaying a portion of Aurigin's home page.
  • The notes/Web page directory window 1212 displays the directory of either the notes or the Web pages accessed by the present invention. The directory is displayed in a tree format. The notes/Web page directory window 1212 includes a directory button 1218. When the user clicks on the directory button 1218, any sub-notes that are stored in the note are displayed.
  • The notes text window 1214 is the area where the user types in his notes about the portion of the Web page that he highlights. The notes text window 1214 also displays the text of one or more notes for the user to review/revise.
  • The notes toolbox window 1206 includes a new note button 1216, a delete button 1236, a plurality of pen buttons 1210, a search button 1230, a show sub-notes button 1232, a launch Web browser button 1234, a file button 1222, an edit button 1224, a view button 1226, and a help button 1228. In the example of FIG. 12 the notes toolbox window 1206 includes five pen buttons 1210, but the notes toolbox window 1206 could alternatively include other numbers of pen buttons 1210.
  • A user presses the new note button 1216 to create a new note. The delete button 1236 is used to delete a note or Web page. Here, the user highlights a note or Web page in the notes/Web page directory window 1212 and then clicks on the delete button 1236.
  • When the user presses the search button 1230 a search window 1302 (FIG. 13) appears. Referring to FIG. 13, the user types in the title of a note or sub-note in the space 1304 and clicks on a search now button 1306. The present invention searches for that particular note. If the note/sub-note is located, the present invention displays the note/sub-note to the user.
  • A user presses the show sub-notes button 1232 to display the sub-notes of a note in the tree of the notes/Web page directory window 1212, and presses the launch Web browser button 1234 to execute a Web browser.
  • A user presses the file button 1222 to display a file menu 1402 (FIG. 14). In the present invention, the term “menu” is used to describe property sheets, herein. Referring to FIG. 14, from the file menu 1402, the user can access functions provided by the Web annotation system 502 for manipulating notes and sub-notes. These functions include creating a new note, creating a new sub-note, importing a note or sub-note, exporting a note or sub-note, sending notes and sub-notes to another person, printing the notes and sub-notes, and exiting the Web annotation system 502. Here, the user is able to send via e-mail a copy of portions of the note database 508 to other users by using a “send to” command in the file menu 1402. If the user sends an e-mail to another user, the recipient gets copies of all of the notes and Web pages necessary to display the information that is sent. The user can also save AWN (Aurigin Web Note) files. These files can be generated using the “export” command in the file menu 1402. Here, the “send to” command simply mails an AWN file to the other user.
  • A user presses the edit button 1224 to display a edit menu 1502 (FIG. 15). Referring to FIG. 15, from the edit menu 1502, the user can access additional functions provided by the Web annotation system 502. These functions include undoing the last function, redoing the undo, cutting a note or sub-note, pasting a note or sub-note, deleting a note or Web page (same as delete button 1236), and finding text in a Web page displayed in the Web page window 1208.
  • When a user presses the view button 1226, a view menu 1602 (FIG. 16) is displayed. From the view menu 1602 in FIG. 16, the functions provided to the user include toggling between a notes directory tree or a Web pages directory tree displayed in the notes/Web page directory window 1212, searching for a note or sub-note (as described above with the search button 1230), loading the original Web page (function that shows the user the original version of the Web page), showing sub-notes in the tree of the notes/Web page directory window 1212 (as described above with the sub-notes button 1232), options, and properties. The options and properties functions of the present invention are described next in more detail.
  • When a user picks the options function from the view menu 1602, an options menu 1702 (FIG. 17) is displayed. Referring to FIG. 17, the options menu has two property pages, a sub-notes page 1704 and a caching page 1706. The sub-files file 1704 provides the user with options on how the sub-notes are displayed. For example, the sub-notes can be shown in the tree in the notes/Web page directory window 1212 (as described above with the sub-notes button 1232), the contents of the sub-note can be displayed beside the title of the note in the tree, and the title and/or URL of the Web page that the sub-note is linked to can be display in the tree.
  • Referring to FIG. 18, the caching page 1706 will now be described. Here, the user can decide whether he wants the Web pages cached for faster retrieval of the Web pages by the present invention.
  • When a user picks the properties function from the view menu 1602, a properties menu 1902 (FIG. 19). In FIG. 19, the properties menu 1902 has a note page 1904. Here, the title of the note is displayed, the date and time it was created, and the date and time it was last modified.
  • A user presses the help button 1224 to display a help menu 2002 (FIG. 20). Referring to FIG. 20, the help menu 2002 provides the typical help functions to the user.
  • Each pen button 1210 includes an image of a pen, such as the pen image in pen button 1210A. The pen images in the pen buttons 1210 are color coded using the colors 1106, 1110, 1114, 1118, 1122 shown in FIG. 11.
  • The pen buttons 1210 are used to select portions of Web pages that are to be linked with sub-notes of notes. The pen buttons 1210 are used as follows. A user selects one of the pen buttons 1210 using the mouse. The pointer 1220 is then used to highlight, in the same color as the pen, what the user selects. The user then manipulates the pointer 1220 to select a portion of the currently displayed Web page (in the case of FIG. 12, a portion of the Web page displayed in the Web page window 1208). The selected portion of the Web page is color coded using the same color as the pen. The Web annotation system 502 creates a new sub-note, and links the sub-note to the selected portion of the Web page.
  • Such operation is shown in FIG. 21. The user selects pen button 1210A, which is color coded using color 1106 (FIG. 11). The user selects text 2102, which is a portion of Aurigin's home Web page displayed in the Web page window 1208. The Web annotation system 502 instructs the application associated with the Web page window 1208 to color code the selected text 2102 using the same color as the pen button 1210A, i.e., color 1106.
  • The Web annotation system 502 creates a new note, called Note A, and displays Note A in the notes text window 1214. The notes text window 1214 has a current note title field 2110 in which the title of the note (i.e., Note A) is displayed. The date and time Note A was created and last modified can be displayed in the note page 1904 of the properties menu 1902 (FIG. 19). The Web annotation system 502 creates a new sub-note with a linking button with the color 1106 and the symbol 1108 (associated with color 1106). This lining button (with color 1106/symbol 1108) is positioned in three locations. The locations are in the notes/Web page directory window 1212 as a linking button 2106, in the notes text window 1214 as a linking button 2108, and outside the Web page window next to the selected text 2102 as lining button 2104. The Web annotation system 502 links the linking buttons 2104-2108 to the selected text 2102.
  • At this point the user types in the desired content for the sub-note associated with linking buttons 2104-2108 in a content area 2108 in the notes text window 1214. Once the user is finished typing in the desired content in the active content area 2108, the same content is displayed next to the linking button 2106 in notes/Web page directory window 1212 and replaces “no text.” This result will be shown in FIG. 22.
  • Alternatively, instead of the content of a sub-note being displayed next to the linking button 2106 in notes/Web page directory window 1212, the user can have the present invention display either the linked Web page's title or the linked Web page's URL. The user can change the option displayed by using the options menu 1712 and sub-notes page 1704 (FIG. 17).
  • Linking button 2104, associated with the selected text 2102, is used to navigate to and display the sub-note (i.e., under Note A) that is linked to the selected text 2102. At any time, if the user wishes to view the sub-note linked to the selected text 1202, then the user need only click on one of the linking buttons 2104-2108. This causes the Web annotation system 502 to display Note A and the associated sub-note in the notes/Web page directory window 1212 and the notes text window 1214.
  • FIG. 22 continues the scenario of FIG. 21. In FIG. 227, the user selects pen button 1210B, which is color coded using color 1110 (FIG. 11). The user selects text 2202, which is a portion of Aurigin's home Web page displayed in the Web page window 1208. The Web annotation system 502 instructs the application associated with the Web page window 1208 to color code the selected text 2202 using the same color as the pen button 1210B, i.e., color 1110. The Web annotation system 502 creates a second sub-note with a linking button with the color 1110 and the symbol 1112 (associated with color 1110). This linking button (with color 1110/symbol 1112) is positioned in three locations. The locations are in the notes/Web page directory window 1212 as a linking button 2206, in the notes text window 1214 as a linking button 2208, and outside the Web page window next to the selected text 2202 as linking button 2204. The Web annotation system 502 links the linking buttons 2204-2208 to the selected text 2202. At this point the user types in the desired content for the second sub-note associated with linking buttons 2204-2208.
  • Note that this second sub-note is added to existing Note A, because Note A was being displayed when the user selected text 2202. Also note that selected text 2202 overlaps with selected text 2102. The present invention allows portions in a Web page that are to be linked with sub-notes to be distinct, to partially overlap, or to completely overlap. Such functionality of the invention enables users to precisely associate sub-notes with portions in Web pages.
  • Sub-notes in a note can be linked to portions of Web pages associated with different applications. This is done in a similar manner as described in U.S. Pat. No. 5,806,079, incorporated herein by reference. Thus, the invention can be used to mark or “bookmark” text based and non-text based Web pages for fast reference and retrieval.
  • As will be apparent from the foregoing, the Web annotation system 502 can operate with any application that supports the interface 510 (FIG. 5). The interface 510 preferably uses the JScript and DHTML standards. Both of these standards are also based on the COM. It should be understood, however, that the Web annotation system 502 is not limited to use with the JScript and DHTML standards. The Web annotation system 502 can be used with any standard that allows one software application to interact with another.
  • 4.4 Viewing Notes, Sub-Notes, and Data Objects
  • In a preferred embodiment, the present invention supports a view mode for displaying the contents of the notes database 508 that is designed to be like a sheet of paper that the user can write his notes on. Other view modes that the present invention supports include a note centric view, an object centric view, and a link centric view, all of which are described in detail in U.S. Pat. No. 5,806,079.
  • The view mode designed to be like a sheet of paper is further described with reference to FIG. 23. The present invention maintains the notes in the order in which the user created them (unless reordered by the user as will be described below). Referring to FIG. 23, the order in which the user created the notes is maintained in the notes/Web page directory window 1212 and the notes text window 1214. Note that this is true, regardless of the order of the links and their associated text in the Web page window 1208.
  • 4.5 Editing Note/Sub-Note Organization
  • The invention includes many flexible features and functions for modifying and replicating the note grouping/note/sub-note hierarchy. These are described below.
  • 4.5.1 Modification
  • The invention enables users to modify the note grouping/note/sub-note hierarchy. In other words, the invention enables users to switch or copy notes from one note grouping to another, or switch or copy sub-notes from one note to another.
  • One way in which a user can modify the note grouping/note/sub-note hierarchy is move sub-note from one note to another by using well known copy/cut and paste operations (via the cut, paste, and delete commands on the edit menu 1502 (FIG. 15)). Also, a user can change the linkage and/or order between sub-notes and Web page portions by clicking and dragging the linking buttons.
  • 4.5.2 Replication
  • A great deal of time and effort may go into the creation of a note grouping/note/sub-note hierarchical database. Typically, a database is specific to a particular task or project. However, it is often the case that parts of a database are applicable to another task or project. For efficiency purposes, users would like to reuse a database generated for one project to the extent possible in another project. Users may also want to e-mail copies of notes and sub-notes to other users. The invention provides powerful tools for enabling a user to identify and replicate portions of an existing database that may be relevant to another project. These replicated portions constitute the foundation of a new hierarchical database.
  • In some cases, a user may already know which parts of a database are pertinent to another project. In such cases, the user may select those parts and replicate (copy) them to a new database. Here, the user may select just those parts and e-mail a copy of them to one of more users. As discussed above with reference to FIG. 14 and file menu 1402, the user is able to send via e-mail a copy of portions of the note database 508 to other users by using a “send to” command in the file menu 1402. If the user sends an e-mail to another user, the recipient gets copies of all of the notes and Web pages necessary to display the information that is sent. The user can also save AWN (Aurigin Web Note) files. These files can be generated using the “export” command in the file menu 1402. Here, the “sent to” command simply mails an AWN file to the other user.
  • In other cases, the user does not know which parts of a database are pertinent to another project. In these cases, the user can use the invention's searching capabilities to identify note groupings, notes, sub-notes, and/or Web page portions that are relevant to this other project. The user can then replicate these identified note groupings, notes, sub-notes, and Web page portions to a new database. FIG. 25 illustrates a new database that was created based on a search conducted on the example database of FIG. 29. The invention supports searching based on key words, date/time of creation/modification, creator, icon tags, color, shape, Web page title, note title, content, etc. The searching capabilities of the invention are discussed below.
  • 4.6 User Interface
  • As discussed above, the Web annotation system 502 includes a user interface 504. Referring to FIG. 24, the user interface 504 enables a user 2404 to interact with the notes database 508 and source material 2410, representing Web pages (these Web pages may be stored in Web pages database 509). The user 2404 interacts with the user interface 504 so as to create note groupings, notes, and sub-notes, establish and modify the note grouping/note/sub-note hierarchy, establish and modify the links between sub-notes and Web page portions, and in all other ways interact with the notes database 508 and the source material 2410.
  • It is very important that the user interface 504 provide the user 2404 with an easy to use (i.e., user friendly) interface to the notes database 508, the source material 2410, and to the features and functions provided by the Web annotation system 502. If the user interface 504 is user friendly, then the user 2404 is more likely to utilize the Web annotation system 502 to document his thinking and work product.
  • The user interface 504 may be implemented using any user interface tools, approaches, techniques, technology and/or applications that currently exist, or that will be developed in the future. In one embodiment, the user interface 504 is implemented as a computer based graphical user interface (GUI). Example screen shots from this GUI are shown in FIGS. 12-23.
  • In another embodiment, the user interface 504 is implemented in whole or in part using virtual reality (VR) technology. Significant VR technology has been developed, and more is currently being developed. Virtual reality is discussed in many publicly available documents, such as Virtual Reality Applications and Explorations, edited by Alan Wexelblat, Academic Press, Cambridge, Mass., 1993, and On the Cutting Edge of Technology, Sams Publishing, Carmel, Ind., 1993 which are incorporated herein by reference in their entities.
  • It should be understood, however, that the invention is adapted and intended to operate with other user interface technology that currently exists, or that will be developed in the future.
  • FIG. 26 represents an example VR scenario 2602 according to a preferred embodiment of the invention. The user is represented in VR scenario 2602 by a hand 2604. As will be appreciated by persons skilled in the VR arts, the user selects and manipulates objects in the VR world of FIG. 26 by using the virtual hand 2604, just-like the user selects and manipulates objects in the real world using his own hand. Other techniques for manipulating objects in the VR world will be apparent to persons skilled in the VR arts. For example, manipulation may be accomplished by voice command, or by thought (tied to brain waves or brain impulses), or by body gestures, etc.
  • In the example of FIG. 26, the user selects a book 2608 from a library 2606. The user opens the book 2608 until a passage 2610 of interest is found. The user selects this passage 2610 and then links this passage 2610 to a sub-note 2618 in Note A. Such linkage may automatically occur upon the selection of the passage 2610 (since such selection results in the creation of sub-note 2618, and in the creation of the link between sub-note 2618 and the passage 2610, as described above). Alternatively, the user can link passage 2610 with sub-note 2618 by moving the hand 2604 from the passage 2610 to the sub-note 2618.
  • The user can enter comments into the sub-note 2618 using any input mechanism or procedure, such as typing on a real or virtual keyboard, audibly dictating the comments, etc.
  • Any of the displays and screen shots discussed herein, such as those shown in FIGS. 12-23, can be displayed and manipulated in the VR world. The user can manipulate the items and objects in those displays via the VR hand 2604 or any other virtual construct, instead of or in addition to a computer (physical or virtual) keyboard and mouse. The combination of the Web annotation system 502 with virtual reality creates a very powerful, user friendly application.
  • In the discussion herein, the user is often said to issue a command, press a button, select an option from a menu, review a computer display, input/key in information or commands, or perform some other type of action that requires interaction with the computer. It should be understood that, according to the present invention, such interaction can be achieved using any type of user interface, including a conventional computer interface (using a keyboard and mouse, for example), or a virtual reality interface, as just described above.
  • 4.7 Security
  • In one embodiment of the present invention, security is not addressed. Yet in another embodiment, the invention may include many functions, features, and capabilities to maintain the security of the information contained in the note database 508. These security features can generally be categorized as follows: (1) security on individual note groupings, notes, sub-notes, links, and objects; and (2) security of the note database 508 as a whole. These two security features are discussed below.
  • 4.7.1 Security on Individual Note Groupings, Notes, Sub-Notes, Links, and Web pages
  • A person, group, or organization may wish to limit access to note groupings, notes, sub-notes, links, and/or Web pages. Only people or groups who satisfy some specified criteria would have access to such note groupings, notes, sub-notes, links, and/or Web pages. The present invention supports features for securing individual note groupings, notes, sub-notes, links, and Web pages.
  • A note grouping, note, sub-note, link, or Web page may be secured based on a number of criteria, including creator, owner, password, security level, or any other well known security criteria. For example, if a sub-note is secured based on the creator criteria, then only the creator may access the sub-note. If a sub-note is secured based on password, then only persons who have the correct password may access the sub-note. If a sub-note is secured based on security level, then only persons having the appropriate security level will have access to the sub-note.
  • In one embodiment, a person or group who satisfies the current security criteria for a note grouping, note, sub-note, link, or Web page may modify the security criteria for the note grouping, note, sub-note, link, or Web page. In other embodiments, only persons or groups who have satisfy a specified, alternate security criteria (such as administrators) may change existing security criteria.
  • If a note grouping is secured, then only persons who satisfy the specified criteria may gain access to the note grouping, and the notes, sub-notes, and connectors/links contained in the note grouping.
  • If a note is secured, then only persons who satisfy the specified criteria may gain access to the note, and the sub-notes and connectors/links contained in the note.
  • If a sub-note is secured, then only persons who satisfy the specified criteria may gain access to the sub-note, and the link contained in the note.
  • If a link (that links a sub-note to a Web page portion) or a connector (that establishes the note grouping/note/sub-note hierarchy) is secured, then only persons who satisfy the specified criteria may gain access to and traverse the link/connector.
  • This effect of security is illustrated in the example of FIG. 27. Note A is displayed in a note window 2706. It is assumed that Note A is not secured, or that the current user satisfies the security criteria associated with Note A. Note A includes Sub-notes A, B, and C. It is assumed that Sub-notes A and B are not secured, or that the current user satisfies the security criteria respectively associated with Sub-notes A and B. Accordingly, Sub-notes A and B are displayed. Sub-note C is secured. However, the current user does not satisfy the security criteria of Sub-note C. Thus, Sub-note C is not displayed.
  • It is assumed that the current user satisfies the security criteria respectively associated with link 2714. Thus, the link 2714 is active. The current user may manipulate and traverse link 2714. Thus, the Web page associated with link 2714 is displayed in application window 2720. The current user does not satisfy the security criteria of link 2716. Thus, link 2716 is inactive. The current user may not manipulate or traverse link 2716. Thus, the Web page associated with link 2716 is not displayed. It is irrelevant whether the current user does or does not satisfy the security criteria of link 2718. In either case, link 2718 is inactive since its Sub-note C is inactive (in other embodiments, the security state of a link is separate and distinct from the security state of its sub-note).
  • 4.7.2 Security on the Note Database as a Whole
  • According to some embodiments of the present invention, the notes database 508 is stored in a single computer. In other embodiments of the present invention, the notes database 508 is distributed among multiple databases. Procedures and technology for distributing the notes database 508, and for working with the distributed notes database 508, will be apparent to persons skilled in the relevant art(s).
  • In some circumstances, the distribution of the notes database 508 is advantageous for implementation, performance, and robustness reasons. The motivations and advantages of distributed database systems in this regard are well known.
  • According to the present invention, the notes database 508 is also distributed for security reasons. In some situations, it is necessary to maintain the confidentiality and secrecy of the notes database 508. Distributing the notes database 508 aids in this effort, and it ensures that the inadvertent or improper disclosure of one part of the notes database 508 maintained at one site does not result in the disclosure of the other parts of the notes database 508 at other sites.
  • In some cases, it is critical that the linkage information contained in the notes database 508 be kept secret. The present invention utilizes techniques in addition to the data distribution approached described above to secure the linkage information in the notes database 508. These additional techniques also relate to data distribution.
  • In particular, the present invention preferably partitions the notes database 508 into a note information database 2406 and a note/object linking information database 2408. The note/object linking information database 2408 contains the linkage information that specifies how sub-notes are linked to Web page portions. The note information database 2406 includes all information about notes and sub-notes except for the linkage information.
  • The note information database 2406 is distributed among a first set of sites. The note/object linking information database 2408 is distributed among a second set of sites. The first and second sets of sites may be the same, may be completely different, or may be partially the same.
  • FIG. 28 illustrates an example implementation of the invention. In this example, the note information database 2406 is distributed among sites 2804 and 2808. The note/object linking information database 2408 is distributed among sites 2806, 2810, and 2812. These sites are connected via a network 2820, which may represent any type of communication medium in any form or configuration, such as a public network (the Internet, for example), a private network (such as a virtual network), dial up telephone lines, etc. The communication medium can include any type of communication links, such as fiber optics, coaxial cable, wireless, satellite links, etc., or any combination of these.
  • The invention uses other techniques for securing the notes database 508. In some embodiments, for example, all or part of the notes database 508 is encrypted. For example, references contained in the note information database 2406 to the note/object lining information database 2408 are encrypted using any well known encryption mechanism or algorithm, such as key encryption. Encryption of the notes database 508 is further described below.
  • 4.8 Search Capabilities
  • The invention supports powerful search features for identifying note groupings, notes, sub-notes, links, and/or Web pages that satisfy user supplied search criteria. Users can perform key word searches, searches based on date/time of creation or modification, searches based on icon tagging (icons can be predefined or user defined), searches based on creator or owner, searches based on security/privacy levels, color, shape, Web page title, etc. Preferably, sub-notes are indexed and searchable. Also, fields (predefined or user defined) within note groupings, notes, and sub-notes are indexed and searchable.
  • The user can limit the search to a user-defined path through the note/sub-note hierarchy (for example, the user can limit the search to a path that starts with a user specified note grouping, note, sub-note, link, etc.).
  • The operation of the search capabilities of the present invention are described further below.
  • 5. Notes Database
  • A detailed implementation of the notes database 508 according to an embodiment of the present invention shall now be described. As stated above, with reference to FIG. 8, the notes database 508 (as well as the Web pages database 509) are implemented as functional objects. Conceptually, note repository object 804, note object 806, sub-note object 808, content object 810, and anchor object 812 make up the notes database 508. The content object 810 stores data that conveys information. These data are user definable and includes at least information that explains the rationale for linking the sub-note object 808 to a portion of the Web page object 818. The data stored in the content object 810 can be any format or combination of formats, such as text, sound, video, image, executable program, tactile (such as braille), etc. The anchor object 812 is linked by a bookmark link 820 to the Web page object 818. According to the present invention, the bookmark link 820 is bi-directional.
  • Each note object 806 contains data including its title, the date and time of creation, the data and time of last modification, a listing of all of its sub-notes, etc. Each sub-note object 808 also contains data including its title, the date and time of creation, the data and time of last modification, its content object, its anchor object, privacy settings, etc. The anchor object contains data including the color and which pen was highlighted when the pointer 1220 was used to select the selected portion to which the sub-note is linked, etc.
  • FIG. 30 illustrates an example notes database 508 that stores Notes A, B, and C. As described above with reference to FIG. 8, the user interface 504 (FIG. 5) creates, updates, and deletes objects in the Web annotation system 502 preferably using the COM interfaces. In order to do this, the user interface 504 must first gain access to a functional object through the top level object, namely the Web annotation system object 802. The Web annotation system object 802 can return to the user interface 504 the note repository object 804 and/or the Web page repository object 814. Once the user interface 504 has either the note repository object 804 or the Web page repository object 814, it can use either of these (based on its interface) to: navigate to other objects, create child objects, remove child objects, and modify child objects.
  • In FIG. 30, the note repository object 804 includes three note objects, namely a note A object 806A, a note B object 806B, and a note C object 806C. The note A object 806A is comprised of two sub-note objects, namely sub-note object 808A and sub-note object 808B. The sub-note object 808A comprises a content object 810A and an anchor object 812A. The sub-note object 808B comprises a content object 810B and an anchor object 812B.
  • The note B object 806B is also comprised of two sub-note objects, namely sub-note object 808C and sub-note object 808D. The sub-note object 808C comprises a content object 810C and an anchor object 812C. The sub-note object 808D comprises a content object 810D and an anchor object 812D.
  • The note C object 806C is comprised of three sub-note objects, namely sub-note object 808E, sub-note object 808F, and sub-note object 808G. The sub-note object 808E comprises a content object 810E and an anchor object 812E. The sub-note object 808F comprises a content object 810F and an anchor object 812F. The sub-note object 808G comprises a content object 810G and an anchor object 812G.
  • In order to more fully explain the notes database 508 (and the relationship between notes and portions of Web pages of the present invention), an example Web pages database 509 is also shown in FIG. 30. As stated above with reference to FIG. 8, Web page repository object 814, Web page folder object 816, and Web page object 818 conceptually make up Web pages database 509. In FIG. 30, Web page repository object 814 includes two Web page folders, namely Web page folder object 816A and Web page folder object 816B. The Web page folder object 816A comprises a Web page object 818A, a Web page object 818B, and a Web page object 818C. The Web page folder object 816B comprises a Web page object 818D and a Web page object 818E.
  • Bookmark links will next be discussed with reference to FIG. 30. Note that in a preferred embodiment of the present invention, the bookmark links are bi-directional links. A bookmark link 820A links together the sub-note object 808A (and its content object 810A) with the portion of a Web page it relates to, namely a portion of the Web page object 818E. A bookmark link 820B links together the sub-note object 808B with a portion of the Web page object 818D. In a similar manner, a bookmark link 820C also links together the sub-note object 808C to a portion of the Web page object 818D. Note that sub-note object 808B and sub-note object 808C are both linked to the same Web page object 818D. The portion of Web page object 818D that sub-note object 808B and sub-note object 808C are linked to can be the same portion, can be different portions, or can be two portions that overlap.
  • A bookmark link 820D links together the sub-note object 808D with a portion of the Web page object 818C, a bookmark link 820E links together the sub-note object E with a portion of the Web page object 818B, a bookmark link 820F links together the sub-note object F with a portion of the Web page object 818B, and finally, a bookmark link 820G links together the sub-note object G with a portion of the Web page object 818A.
  • The notes database 508 could be implemented in ways other than that shown in FIG. 30, and described above. In particular, the notes database 508 could be implemented using any well known data structure or organization. Various data structures are described in many publicly available documents, such as Niklaus Wirth, Algorithms+Data Structures=Programs, Prentice Hall, 1976, which is herein incorporated by reference in its entirety.
  • 6. Operation of the Invention
  • The operation of the present invention shall now be described with reference to a flowchart 3102 shown in FIG. 31. Flowchart 3102 illustrates the manner in which a user interacts with the Web annotation system 502 to organize Web pages, and to manipulate notes attached to portions of Web pages.
  • Such user interaction with the Web annotation system 502 is preferably achieved through interaction with a user interface 504 that forms part of the Web annotation system 502. As apparent from the discussion below, the user interface 504 of the present invention is very powerful and flexible. In particular, the user interface 504 allows users to access the functionality of the Web annotation system 502 in any number of ways. Accordingly, the operational steps shown in flowchart 3102 and in other flowcharts discussed below represent one way (i.e., one operational sequence) of accessing the functions provided by the Web annotation system 502. Users may access and traverse the functions provided by the Web annotation system 502 in any number of other ways via interaction with the menus provided by the user interface 504. Such other ways (i.e., such other operational sequences) will be apparent to persons skilled in the relevant art(s).
  • In step 3104, the user issues a command to an operating system executing in the computer system 602. The user may issue this command via a keyboard or a well known point-and-click approach, or via a body gesture, thought, or voice command when using a VR user interface, or via any other well known means for entering a command.
  • If the user issued a command to launch an application, then control line 3110 is taken. If the user issued a command to create a new note/sub-note, and this command was issued using the file menu 1402, then control line 3112 is taken. If the user issued a command to create a new note/sub-note, and this command was issued using a pen (such as pen 1210A in FIG. 12) or VR hand 2604 or the like, then control line 3114 is taken. If the user issued a command to view a note, and this command was issued by selecting a linking button in a Web page, then control line 3116 is taken. If the user issued a command to search a note, and this command was issued from the view menu 1602 or search button 1230, then control line 3118 is taken. If the user issued a command to e-mail a copy of a portion of notes database 508, and this command was issued from the file menu 1402, then control line 3119 is taken. If the user issued a command to find a specified text in the current Web page via edit menu 1502, then control line 3120 is taken. If the user issued a command to modify the privacy/security settings associated with a note grouping, note, sub-note, or link, then control line 3121 is taken. If the user issued a command to edit one or more notes via the edit menu 1502 or by clicking on the appropriate area in the notes text window 1214, then control line 3122 is taken. If the user issued a command to show sub-notes in the notes/Web page directory window 1212 via view menu 1602, then control line 3124 is taken. If the user issued a command to toggle between viewing notes or Web pages in the notes/Web page directory window 1212 via view menu 1602, then control line 3126 is taken. If the user issued a command to change or view options via the view menu window 1602, then control line 3128 is taken. If the user issued a command to change or view properties via the view menu window 1602, then control line 3130 is taken. These control flows and commands are discussed below.
  • 6.1 Launch an Application
  • If the user in step 3104 issued a command to launch an application, then step 3106 is performed.
  • In step 3106, the operating system in the computer system 602 invokes the user-specified application in a well known manner. The application is preferably a Web browser, but may also be a word processing application, a spread sheet application, a database application, a communication application, a video/audio processing application, a financial application, etc. The invoked application displays an application window. Typically, the user commands the application to load a Web page, and uses the application to process the Web page.
  • In the user interface environment of the present invention, control from step 3106 may then flow to any number of directions. In some cases, control flows back to step 3104, as shown in FIG. 31.
  • 6.2 Create a Note/Sub-Note (From the File Menu)
  • One way for the user to issue a command to create a new note or sub-note is to open the file menu 1402 (by pressing the file menu button 1222), and then select the “New Note” function or the “New Sub-Note” function. In response to this command, the Web annotation system 502 performs the steps of flowchart 3202 in FIG. 32.
  • In step 3204, the notes engine 506 of the Web annotation system 502 determines whether a note is currently highlighted in the computer display (i.e., the display unit 2826). That is, the notes engine 506 determines whether a note is currently active. If a note is not currently highlighted or active, then step 3210 is performed. Otherwise, step 3206 is performed.
  • In step 3206, the notes engine 506 determines whether the user has issued a command to highlight a different note (i.e., deactivate the note that was currently being highlighted). The user issues such a command if he wishes to insert the new sub-note in a new note, as opposed to the currently active note. If the notes engine 506 determines that the user has not issued a command to deactivate the note that is currently being highlighted, then step 3212 is performed (described below). In step 3212, the note currently being highlighted is called the active note for reference purposes. Otherwise, step 3208 is performed.
  • In step 3208, the notes engine 506 closes or deactivates the note.
  • In step 3210, the notes engine 506 creates a new note. As represented by a flowchart 3302 in FIG. 33, the notes engine 506 creates a new note by creating and storing a new note object (such as note object 806 in FIG. 8) in the notes database 508 (step 3306). The notes engine 506 adds the new note object to the note repository object 804 (step 3308). Procedures for adding data to an object are well known. The notes engine 506 in step 3310 initializes the new note object by storing its title in the note object (this name is preferably entered by the user). At this point, the Web annotation system 502 may also prompt the user for security/privacy settings for the new note object. Any security/privacy settings input by the user are also stored in the new note object.
  • Also at this point, the Web annotation system 502 may receive from the user a command identifying a notes group (either existing or new) to which the Web annotation system 502 should add the new note object. If the user provides this information, then the Web annotation system 502 modifies the note grouping table 1090 (FIG. 10) accordingly.
  • Referring again to FIG. 32, also in step 3210, the user interface 504 displays the new note (i.e., note object) in the notes/Web page directory window 1212 and the notes text window 1214. The new note is called the active note for reference purposes.
  • In step 3212, the notes engine 506 creates a new sub-note. As indicated in a flowchart 3402 in FIG. 34, the notes engine 506 creates a new sub-note by creating a new sub-note object (such as sub-note object 808 in FIG. 8) in step 3406. In step 3408, the notes engine 506 generates a sub-note identifier for the new sub-note object. The sub-note identifier is unique among all sub-note objects. The sub-note identifier may be composed of the title of the note (i.e., the active note) concatenated with the current date/time stamp. Other procedures for deriving the sub-note identifier could alternatively be used.
  • In step 3410, the notes engine 506 stores the sub-note identifier in the sub-note object. The notes engine 506 also stores information identifying the new sub-note object in the note object. In step 3412, the notes engine 506 adds the new sub-note object to the active notes object's sub-note objects. At this point, the notes engine 506 may also receive a command from the user indicating the privacy/security setting of the new sub-note object. If the user enters this information, then the notes engine 506 stores the privacy/setting of the new sub-note object in the sub-note object.
  • Referring again to FIG. 32, the user interface 504 in step 3214 enables the user to link the new sub-note to a portion of a Web page. It may be necessary for the user to open the Web page in a well known manner prior to the performance of step 3214. Alternatively, the Web page may already have been opened by the user. In any-case, in step 3214, the user selects one of the pen buttons 1210 in order to obtain a pen. The user then uses this pen to activate the pointer 1220 (in the manner discussed above) to select a portion of the Web page. Procedures for selecting portions of Web pages are well known. The procedure for selecting a portion of a Web page is dependent on the application associated with the Web page. The notes engine 506 commands the application associated with the Web page to color code the selected portion using the color associated with the pen.
  • In step 3216, the notes engine 506 links the selected portion of the Web page object to the new sub-note object. In step 3218, the notes engine 506 updates the displays of the Web page and the active note so as to graphically reflect this linkage. The notes engine 506 performs steps 3216 and 3218 in the manner shown in a flowchart 3502 of FIG. 35.
  • In step 3506, the notes engine 506 stores information identifying the Web page in the sub-note object. This information may be the file name of the Web page, for example. The notes engine 506 may also store in the sub-note object information identifying the application associated with the Web page. The notes engine 506 may obtain the information to be stored in the sub-note object by querying the application associated with the Web page.
  • In step 3508, the notes engine 506 stores in the new sub-note object information that identifies the location of the selected portion in the Web page. If the Web page is a text document, for example, then this information may comprise page and line information. The notes engine 506 preferably obtains this location identification information by querying the application associated with the Web page. Also in step 3508, the notes engine 506 stores in the sub-note object information that indicates the range, of the selected portion in the Web page.
  • As discussed above, in some embodiments the object identifier data, the location identifier data, and the range data are partitioned into the note/object linking information database 2408 (along with any link privacy settings). All other information is stored in the note information database 2406.
  • In step 3510, the notes engine 506 stores in the sub-note object's anchor object the pen-data that identifies the pen that the user used in step 3214 to select a portion of the Web page. Preferably, the notes engine 506 stores pen data identifying the color of the pen, and the symbol associated with the pen. In one embodiment of the present invention, the notes engine 506 may store privacy/security settings information for the sub-note and/or the link, if the user enters this information.
  • In step 3512, the notes engine 506 commands the application associated with the Web page to display a linking button proximate or adjacent to the selected portion. The linking button is displayed using the color of the pen used to select this selected portion, and using the symbol associated with this color (see FIG. 11). The notes engine 506 associates the sub-note identifier for the new sub-note with this linking button. In this manner, the notes engine 506 can locate the new sub-note if the user presses the lining button (such operation is described below).
  • In step 3514, the notes engine 506 displays a linking button (identical to that described in step 3512) in the notes/Web page directory window 1212 and the notes display window 1214 for the note.
  • Referring again to FIG. 32, the user interface 504 in step 3220 enables the user to enter information in the appropriate area in the notes display window 1214 for the new sub-note. Such information can be of any format, such as text, sound, video, tactile, computer program, etc. The notes engine 506 stores this information in the content object (such as content object 810 of FIG. 8) of the new sub-note's object. The user may also enter privacy settings at this time for the note, sub-note, or link. The notes engine 506 stores any such information entered by the user in the appropriate locations of the sub-note object.
  • 6.3 Create a Note/Sub-Note (Using a Pen)
  • Another way for the user to issue a command to create a new note or sub-note is to press one of the pen buttons 1210, and then use the resulting pointer 1220 to select a portion of the Web page currently being displayed. A new sub-note is then created and linked to this selected portion. This approach does not require the user to use the file menu 1402. The operation of the Web annotation system 502 in accordance with this approach is represented by a flowchart 3602 shown in FIG. 36.
  • In step 3604, the user selects one of the pen buttons 1210 in order to obtain a pen. The user then uses this pen to activate the pointer 1220 (in the manner discussed above) to select a portion of the Web page. The notes engine 506 commands the application associated with the Web page to color code the selected portion using the color associated with the pen.
  • In step 3606, the notes engine 506 of the Web annotation system 502 determines whether a note is currently highlighted in the computer display (i.e., the display unit 2826). That is, the notes engine 506 determines whether a note is currently active. If a note is not currently highlighted or active, then step 3612 is performed. Otherwise, step 3608 is performed.
  • In step 3608, the notes engine 506 determines whether the user has issued a command to highlight a different note (i.e., deactivate the note that was currently being highlighted). The user issues such a command if he wishes to insert the new sub-note in a new note, as opposed to the currently active note. If the notes engine 306 determines that the user has not issued a command to close the note that is currently being displayed, then step 3614 is performed (described below). (In step 3614, the note currently being displayed is called the active note for reference purposes.) Otherwise, step 3610 is performed.
  • In step 3610, the notes engine 306 deactivates the note.
  • In step 3612, the notes engine 506 creates a new note. As represented above with reference to FIG. 33, the notes engine 506 creates a new note by creating and storing a new note object (such as note object 806 in FIG. 8) in the notes database 508 (step 3306). The notes engine 506 adds the new note object to the note repository object 804 (step 3308). The notes engine 506 in step 3310 initializes the new note object by storing its title in the note object (this name is preferably entered by the user). At this point, the Web annotation system 502 may also prompt the user for security/privacy settings for the new note object. Any security/privacy settings input by the user are also stored in the new note object. Also in step 3612, the user interface 504 displays the new note (i.e., note object) in the notes/Web page directory window 1212 and the notes text window 1214. The new note is called the active note for reference purposes.
  • In step 3614, the notes engine 506 creates a new sub-note. As indicated above with reference to FIG. 34, the notes engine 506 creates a new sub-note by creating a new sub-note object (such as sub-note object 808 in FIG. 8) in step 3406.
  • In step 3616, the notes engine 506 links the selected portion of the Web page to the new sub-note (in the manner discussed above).
  • In step 3618, the notes engine 506 updates the displays of the Web page and the active note so as to graphically reflect this linkage (in the manner discussed above).
  • The user interface 504 in step 3620 enables the user to enter information in the appropriate area in the notes display window 1214 for the new sub-note (in the manner discussed above). Such information can be of any format, such as text, sound, video, tactile, computer program, etc. The notes engine 506 stores this information in the content object (such as content object 810 of FIG. 8) of the new sub-note's object. Any security/privacy settings entered by the user are also stored.
  • 6.4 View Note (By Selecting a Linking Button in a Web Page)
  • One way for the user to issue a command to view an existing sub-note is to select (using the well known point-and-click approach) the linking button displayed proximate to the portion of the Web page that is linked to the sub-note. For example, in FIG. 4, the user can issue a command to view Sub-note A by selecting the linking button 2104 next to the portion 2102 of the Web page that is linked to Sub-note A. The operation of the Web annotation system 502 in this regard is represented by a flowchart 3702 in FIG. 37.
  • In step 3704, the user selects the linking button displayed proximate to the portion of the Web page of interest. For illustrative purposes, suppose that the user clicked on the linking button 2204 corresponding to portion 2202 of the Web page titled “aurigin.com” (FIG. 22).
  • In step 3706, the notes engine 506 in response to this user action identifies the note and sub-note corresponding to linking button 2204. The manner in which the notes engine 506 performs step 3706 is represented by a flowchart 3802 in FIG. 38. In step 3806, the notes engine 506 identifies the sub-note identifier that is associated with the linking button 2204. The lining button 2204 preferably has stored with it the sub-note identifier (or some other type of reference or address to a sub-note). In step 3808, the notes engine 506 searches in a well known manner through the notes database 508 until it locates the sub-note having the sub-note identifier determined in step 3806. For illustrative purposes, assume that the notes engine 506 in step 3808 determines that Sub-note B (see FIG. 29) has the sub-note identifier determined in step 3806.
  • In step 3720, the notes engine 506 determines whether security/privacy criteria associated with the link (corresponding to the linking button), the sub-note (identified in step 3706), and the note (identified in step 3706) are satisfied. The notes engine 506 retrieves this security/privacy criteria information from the associated note node and sub-note node, and then compares the retrieved security/privacy criteria information to the situation at hand. For example, if the security/privacy criteria is keyed to the current user's password, then the notes engine 506 compares the password of the current user (which the current user previously entered, or is now asked to enter) with that retrieved from the note and/or sub-note. If the security/privacy criteria is not satisfied, then the user cannot view the note and/or sub-note. If this is the case, then an error message is displayed in step 3722. If the security/privacy criteria is satisfied, then control flows to step 3708.
  • In step 3708, the notes engine 506 determines whether the note that includes the sub-note identified in step 3706 is currently being displayed in the computer display. In the example discussed above, the notes engine 506 in step 3708 determines whether Note B is currently being displayed in the computer display. If Note B is currently being displayed in the computer display, then control flows to step 3712 (described below). Otherwise, step 3710 is performed.
  • In step 3710, the notes engine 506 displays in a notes display window 1214 the note that includes the sub-note identified in step 3706.
  • In step 3712, the notes engine 506 scrolls through the note in the notes display window 1214 until the sub-note identified in step 3706 is displayed in the notes display window 1214.
  • 6.5 Search a Note
  • Referring again to FIG. 31, if the user issued a command to search a note, and this command was issued from the view menu 1602 or search button 1230, then control line 3118 is taken. The operation of the Web annotation system 502 in accordance with function is represented by a flowchart 3902 shown in FIG. 39. In step 3904, the user clicks on the search button 1230 or indicated via the view menu 1602 that he would like to search notes for a specific text string.
  • In step 3906, a search window is displayed. In step 3908, the user types in the search window the text string to be searched for by the present invention. In step 3910, the present invention searches the notes database 508 (specifically the content object 810 of each sub-note object 808 (FIG. 8)) for the indicated text string. In step 3912, if the text string is not found, then control passes to step 3914 where the present invention displays to the user that no matches were found. Alternatively, the control passes to step 3916.
  • In step 3916, the notes engine 506 scrolls through the note in the notes display window 1214 until the sub-note identified in step 3910 is displayed in the notes display window 1214. In step 3918, the notes engine 506 also displays the associated Web page.
  • 6.6 E-Mail Notes to a Recipient
  • Referring again to FIG. 31, if the user issued a command to e-mail a copy of a portion of notes database 508, and this command was issued from the file menu 1402, then control line 3119 is taken. The operation of the Web annotation system 502 in accordance with function is represented by a flowchart 4002 shown in FIG. 40. In step 4004, the user clicks indicates via the file menu 1402 (by using the “send to” command) that he would like to e-mail a copy of a portion of notes database 508 and any associated Web pages to another user. In step 4006, the present invention displays an e-mail window to the user.
  • In step 4008, the user utilizes the e-mail window to indicate to the Web annotation system 502 the notes/sub-notes he wants sent to an e-mail recipient. In step 4010, the user indicates the recipient's e-mail address to the present invention. The user can also save AWN (Aurigin Web Note) files. These files can be generated using the “export” command in the file menu 1402. Here, the “sent to” command simply mails an AWN file to the other user.
  • In step 4012, the Web annotation system 502 generates an attachment that contains a copy of all of the notes/sub-notes and their associated Web pages. Also in step 4012, the Web annotation system 502 sends the attachment to the e-mail recipient.
  • In step 4014, if the e-mail recipient's machine already has a copy of the present invention, control passes to step 4018. Alternatively, control passes to step 4016. In step 4016, the present invention indicates to the recipient where he can download a copy of the present invention to his machine. Control then passes to step 4018. In step 4018, when the recipient clicks on the attachment sent by the present invention, the present invention automatically loads in the application to display the Web pages.
  • 6.7 Find Specified Text in the Current Web Page
  • The user initiates a search for a text string in the current Web page by selecting the “Find” command in the edit menu 1502. The operation of the Web annotation system 502 while performing searching is represented by a flowchart 4102 in FIG. 41. In step 4104, the user interface 504 enables the user to enter search criteria. The user enters the text string to search. The user can limit the search criteria by indicating whether to match “whole words only,” case, and/or how to search (up or down the Web page). In step 4106, the notes engine 506 searches through the text of the current Web page (as limited by the user) to locate any and all text strings that satisfy the search criteria. In step 4108, the user interface 504 highlights the first text string located in the current Web page. If no text strings are found, the present invention indicates this to the user.
  • 6.8 Modify Privacy/Security Settings
  • Flowchart 4202 in FIG. 42 represents the operation of the invention when enabling the user to modify the privacy/security settings associated with a note grouping, note, sub-note, or link.
  • In step 4204, the user selects a note grouping, note, sub-note, or link using any of the selection procedures discussed herein.
  • In step 4206, the Web annotation system 502 verifies that the privacy/security criteria associated with the selected item is satisfied. Such verification is described above. If the privacy/security criteria is not satisfied, then the user is not allowed to modify the privacy/security settings. In this case, an error message is displayed in step 4210. If the privacy/security criteria is satisfied, then in step 4208 the user is allowed to enter new privacy/security settings for the selected item. This new privacy/security setting is then stored.
  • 6.9 Edit One or More Notes
  • The present invention allows users to modify the sub-notes that are in notes. For example, a user may rearrange the ordering of sub-notes within a note. The user can delete sub-notes from a note. The user can also copy (replicate) or move sub-notes from one note to other notes. The user can also move, delete, or otherwise modify the notes that are in the note groups. The user can also modify the linkage between sub-notes and Web page portions. In other words, the invention allows the user to easily modify the note grouping/note/sub-note hierarchy by processing step 3108 (FIG. 31). Such operation of step 3108 is further illustrated by reference to FIG. 43.
  • A user rearranges sub-notes in a note, or moves/copies sub-notes between notes by selecting the desired sub-notes, and then dragging and dropping the selected sub-notes to the desired locations. In FIG. 43, for example, assume that the user wishes to move sub-note 4302 so that it is displayed between sub-notes 4304 and 4306. In this case, the user selects sub-note 4302 in a well known manner, and then drags selected sub-note 4302 until it is located between sub-notes 4304 and 4306. The user then drops sub-note 4302 between sub-notes 4304 and 4306 in a well known manner. This can be done in both notes/Web page directory window 1212 and the notes text window 1214.
  • Suppose that the user wishes to move sub-note 4302 to Note B. In this case, the user selects sub-note 4302 in a well known manner, and then drags selected sub-note 4302 until it is positioned over Note B. The user then drops sub-note 4302 into Note B. This is done in only the notes/Web page directory window 1212.
  • The user modifies the notes within a note group and the linkage between sub-notes and Web page portions in a similar manner.
  • In response to such user commands, the notes engine 506 moves/copies sub-notes between the sub-note objects, modifies the note grouping table 1090, and/or modifies the linkage information in the sub-note nodes.
  • 6.10 Show Sub-Notes
  • Referring again to FIG. 31, if the user issued a command to show sub-notes in the notes/Web page directory window 1212 via view menu 1602, then control line 3124 is taken. Such operation is further described with reference to flowchart 4602 in FIG. 46. In step 4604, the user indicates to the present invention to show the content of the sub-notes in the notes/Web page directory window 1212 by selecting the “Show Sub-notes In Tree” command in the view menu 1602.
  • 6.11 Toggle Between Notes and Web Pages View
  • If the user issued a command to toggle between viewing notes or Web pages in the notes/Web page directory window 1212 via view menu 1602, then control line 3126 is taken. Such operation is further described with reference to flowchart 4702 in FIG. 47. In step 4704, the user can toggle between displaying the notes tree or Web pages tree in the notes/Web page directory window 1212 by either selecting the “Notes” command or the “Web Pages” command in the view menu 1602.
  • 6.12 Change or View Options
  • If the user issued a command to change or view options via the view menu window 1602, then control line 3128 is taken. Such operation is further described with reference to flowchart 4802 in FIG. 48. In step 4804, the user can select either the sub-notes page 1704 or the caching page 1706 by selecting the options menu 1702 (FIG. 17). Referring to FIG. 17, the sub-files file 1704 provides the user with options on how the sub-notes are displayed. For example, the sub-notes can be shown in the tree in the notes/Web page directory window 1212 (as described above with the sub-notes button 1232), the contents of the sub-note can be displayed beside the title of the note in the tree, and the title and/or URL of the Web page that the sub-note is linked to can be display in the tree. The caching option, when checked, in the caching page 1706 indicates to the present invention to cache Web pages in the Web pages database 509 for faster retrieval of the Web pages by the present invention.
  • 6.13 Change or View Properties
  • If the user issued a command to change or view properties via the view menu window 1602, then control line 3130 is taken. Such operation is further described with reference to flowchart 4902 in FIG. 49. In step 4904, the user selects the properties function from the view menu 1602 and a properties menu 1902 (FIG. 19) is displayed. Referring to FIG. 19, the properties menu 1902 has a note page 1904. Here, the title of the note is displayed (and can be changed by the user), the date and time it was created, and the date and time it was last modified.
  • 7. Applications of the Invention
  • The invention is applicable to any application that would benefit from the enhanced organization of information. Such applications include, but are not limited to: (1) law related projects, such as licensing studies, litigation efforts, opinions of counsel (such as patentability, patent validity, and patent infringement studies); (2) scientific and/or engineering related projects, such as research and development projects; (3) electronic text books, handbooks, user manuals, encyclopedias, and other electronic reference works, including multimedia reference works; (4) auditory and visual documents; (5) virtual library; (6) review course, such as legal bar review course, business review courses, CPA courses, medical review courses, etc.; (7) virtual classrooms; (8) business-related Internet research; and (9) casual Internet use.
  • Other applications of the invention will be apparent based on the discussion contained herein. Two such applications are discussed in some detail below.
  • 7.1 Movie Production
  • The invention is applicable to the entertainment industry, such as the motion picture industry. The invention could be used to organize the great amounts of information that is collected and generated during the development of a movie and stored on the Internet. This scenario is represented in simplified form in FIG. 44.
  • Generally, a movie is developed in three phases: a pre-production phase, a production phase, and a post production phase. The present invention could be used to organize, memorialize, and institutionalize the information collected and generated during these phases. Specifically, a note 4402 could be created for the pre-production phase. Also, a note 4404 could be created for the production phase, and another note 4406 could be created for the post production phase.
  • The pre-production note 4402 could include sub-notes that link to Web pages used to research the movie's topic. For example, suppose the movie involved lions. One sub-note, called Sub-note A, could be linked to a chapter in a book 4426 dealing with lions stored on a Web page. Another sub-note, Sub-note B, could be linked to a segment of a video 4428 pertaining to lions stored on a Web page. Other sub-notes, such as Sub-notes C-E, could be linked to drafts 4430 of the script on Web pages. These sub-notes could include comments/edits on the drafts 4430. Other sub-notes (not shown) could be linked to other pre-production related objects, such as contracts with actors, travel itineraries, budget reports, purchase orders for costumes and props, etc.
  • The production note 4404 could include sub-notes that are linked to production Web pages, such as the final draft of the script 4434, various scenes 4434, various takes 4434, clips, shots, frames, etc. Such scenes 4434, takes 4434, clips, shots, and frames would be in a form useable by a computer.
  • The post production note 4406 could include sub-notes that are linked to post-production Web pages, such as the theatrical production 4424 of the movie, the video production 4424 of the movie, the movie soundtrack, etc.
  • There are many advantageous for using the present invention to create movies. First and perhaps foremost, the present invention will lend order to the creation of a movie and to the memorialization and documentation of the movie production. Accordingly, movie production will be more efficient and effective.
  • Second, the use of the invention to create movies will create great marketing opportunities. Currently, there is limited distribution of movies and their related materials. For most movies, only the theatrical version and perhaps the home video version are sold and distributed. Limited source materials (such as the “Making of” type publications) are available to the public.
  • The present invention allows any and all versions of any given movie to be easily packaged, distributed and sold. One need only copy the pertinent notes, sub-notes, and Web pages to a computer readable medium (such as one or more compact disks), and distribute and sell copies of the computer readable medium to the public.
  • Also, for movie historians and other interested parties, the materials that were used to create the movie (such as the pre-production information and the production information) can be easily packaged, distributed, and sold. Again, one need only copy the pertinent notes, sub-notes, and Web pages to a computer readable medium, and distribute and sell copies of the computer readable medium to the public.
  • Further, the use of the invention will enable movie aficionados to create their own versions of a movie. This is the case, since the soundtrack, scenes, takes, clips, shots, and/or frames are stored as Web pages, and are linked to sub-notes. Such personalized movie making packages can be easily packaged, distributed, and sold. Again, one need only copy the pertinent notes, sub-notes, and Web pages to a computer readable medium, and distribute and sell copies of the computer readable medium to the public.
  • 7.2 Bar Review Program
  • The invention could be used to create attorney bar review course materials. These materials could be used as a supplement to a traditional bar review course, or as an alternative to a bar review course.
  • A portion of an example notes database 508 for a bar review course is shown in FIG. 45. Bar review course materials typically include a number of sample tests. According to the present invention, a note is associated with each question of each sample test. For example, note 4502 is associated with Question 1. Sub-note A is linked to the portion 4506 of a sample test Web page 4504 that corresponds to Question 1. Sub-note B is linked to the portion 4508 of the sample test Web page 4504 that corresponds to the answer to Question 1.
  • Suppose that Question 1 pertains to an area of Torts law. Question 1 note 4502 may also include a Sub-note C that is linked to a portion 4516 of a torts text 4514 in an electronic legal library 4512. This portion 4516 deals with the substantive torts law of Question 1. A student may find it very useful to study this portion 4516 when working with Question 1.
  • The notes database 508 could also include a torts note 4510 that the deals specifically with torts. This torts note 4510 could have sub-notes, such as Sub-notes G and H, that are linked to portions of the torts text 4514. Sub-notes G and H could have commentary on these portions of the torts text 4514. The Question 1 note 4502 could then have a Sub-note D that points to Sub-note G in the torts note 4510. Sub-note G points to the same portion 4516 in the torts text 4514 pointed to by Sub-note C (typically, the Question 1 note 4502 would include Sub-note C or Sub-note D, but not both). Notes dealing with questions other than Question 1 could then point to the sub-notes in the torts note 4510, as necessary, thereby enhancing reusability.
  • The notes database 508 could also include a case analysis note 4526 that includes sub-notes that point to cases in electronic case reporters 4522. These sub-notes could include commentary and analysis of such cases. The Question 1 note 4502 could include a Sub-note E that is linked to a Sub-note F in the case analysis note 4528. This Sub-note F is linked to a case 4524 that deals with the issues of Question 1. Students may find it useful to review this case 4524 when working with Question 1.
  • 8. Conclusion
  • While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.

Claims (2)

1. A system for linking notes to Web pages, comprising:
means for enabling a user to select a portion of a Web page;
means for creating an annotation;
means for linking said annotation to said selected portion;
means for receiving a request from a user viewing said annotation to display said selected portion linked to said annotation; and
means for invoking an application to view said selected portion, if said application is not already invoked, and for causing said application to load said Web page and present said selected portion.
2-22. (canceled)
US11/078,584 1993-11-19 2005-03-14 System, method, and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages Abandoned US20050160357A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/078,584 US20050160357A1 (en) 1993-11-19 2005-03-14 System, method, and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
US08/155,752 US5623681A (en) 1993-11-19 1993-11-19 Method and apparatus for synchronizing, displaying and manipulating text and image documents
US34112994A 1994-11-18 1994-11-18
US08/423,676 US5623679A (en) 1993-11-19 1995-04-18 System and method for creating and manipulating notes each containing multiple sub-notes, and linking the sub-notes to portions of data objects
US08/632,801 US5806079A (en) 1993-11-19 1996-04-17 System, method, and computer program product for using intelligent notes to organize, link, and manipulate disparate data objects
US08/662,377 US5799325A (en) 1993-11-19 1996-06-12 System, method, and computer program product for generating equivalent text files
US09/057,557 US6389434B1 (en) 1993-11-19 1998-04-09 System, method, and computer program product for creating subnotes linked to portions of data objects after entering an annotation mode
US09/057,644 US6018749A (en) 1993-11-19 1998-04-09 System, method, and computer program product for generating documents using pagination information
US13937699P 1999-06-16 1999-06-16
US09/455,528 US6877137B1 (en) 1998-04-09 1999-12-07 System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages
US11/078,584 US20050160357A1 (en) 1993-11-19 2005-03-14 System, method, and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/455,528 Continuation US6877137B1 (en) 1993-11-19 1999-12-07 System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages

Publications (1)

Publication Number Publication Date
US20050160357A1 true US20050160357A1 (en) 2005-07-21

Family

ID=34381836

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/455,528 Expired - Fee Related US6877137B1 (en) 1993-11-19 1999-12-07 System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages
US11/078,584 Abandoned US20050160357A1 (en) 1993-11-19 2005-03-14 System, method, and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/455,528 Expired - Fee Related US6877137B1 (en) 1993-11-19 1999-12-07 System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages

Country Status (1)

Country Link
US (2) US6877137B1 (en)

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030112276A1 (en) * 2001-12-19 2003-06-19 Clement Lau User augmentation of content
US20050210059A1 (en) * 2004-03-18 2005-09-22 International Business Machines Corporation Method and system for creation and retrieval of global annotations
US20060048058A1 (en) * 2001-05-25 2006-03-02 Learning Tree International System and method for electronic presentations
US7162688B1 (en) * 2000-07-27 2007-01-09 Robert B Gillig Method for automated generation and assembly of specifications documents in CADD environments
US20070050445A1 (en) * 2005-08-31 2007-03-01 Hugh Hyndman Internet content analysis
WO2007059237A2 (en) * 2005-11-14 2007-05-24 Trailfire, Inc. Distributing web applications across a pre-existing web
US20070300160A1 (en) * 2005-11-14 2007-12-27 Ferrel Patrick J Distributing web applications across a pre-existing web
US20080021977A1 (en) * 2006-07-24 2008-01-24 International Business Machines Corporation Methods, systems, and computer program products for dynamically annotating web pages passed via a messaging application
US20080276190A1 (en) * 2007-04-03 2008-11-06 Sugarcrm Inc. Customer Relationship Management System with Quicknotes
US20090055242A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content identification and classification apparatus, systems, and methods
US20090055368A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content classification and extraction apparatus, systems, and methods
US20090089653A1 (en) * 2007-09-28 2009-04-02 Microsoft Corporation Auto-generation and syndication of tables as forms
US20090327855A1 (en) * 2008-06-27 2009-12-31 Google Inc. Annotating webpage content
US20100211461A1 (en) * 2006-10-19 2010-08-19 Moon-Sung Choi System for Displaying and Managing Information on Webpage Using Indicator
US20100262908A1 (en) * 2009-04-14 2010-10-14 Freedom Scientific, Inc. Document Navigation Method
US20110010372A1 (en) * 2007-09-25 2011-01-13 Sadanand Sahasrabudhe Content quality apparatus, systems, and methods
US7890989B1 (en) 2000-10-24 2011-02-15 Sony Corporation Automated context-sensitive updating on content in an audiovisual storage system
US20110143327A1 (en) * 2008-08-12 2011-06-16 Bli Education Limited Method for facilitating assessment of a coursework answer and moderating the assessment
US20120066580A1 (en) * 2005-04-12 2012-03-15 Jesse David Sukman System for extracting relevant data from an intellectual property database
US20130091240A1 (en) * 2011-10-07 2013-04-11 Jeremy Auger Systems and methods for context specific annotation of electronic files
US8463790B1 (en) 2010-03-23 2013-06-11 Firstrain, Inc. Event naming
US8510646B1 (en) * 2008-07-01 2013-08-13 Google Inc. Method and system for contextually placed chat-like annotations
USD705790S1 (en) 2011-12-28 2014-05-27 Target Brands, Inc. Display screen with graphical user interface
USD705792S1 (en) 2011-12-28 2014-05-27 Target Brands, Inc. Display screen with graphical user interface
US8782042B1 (en) 2011-10-14 2014-07-15 Firstrain, Inc. Method and system for identifying entities
US8805840B1 (en) 2010-03-23 2014-08-12 Firstrain, Inc. Classification of documents
USD715818S1 (en) * 2011-12-28 2014-10-21 Target Brands, Inc. Display screen with graphical user interface
US8977613B1 (en) 2012-06-12 2015-03-10 Firstrain, Inc. Generation of recurring searches
US9348803B2 (en) 2013-10-22 2016-05-24 Google Inc. Systems and methods for providing just-in-time preview of suggestion resolutions
US9529785B2 (en) 2012-11-27 2016-12-27 Google Inc. Detecting relationships between edits and acting on a subset of edits
US9971752B2 (en) 2013-08-19 2018-05-15 Google Llc Systems and methods for resolving privileged edits within suggested edits
US10481771B1 (en) 2011-10-17 2019-11-19 Google Llc Systems and methods for controlling the display of online documents
US10546311B1 (en) 2010-03-23 2020-01-28 Aurea Software, Inc. Identifying competitors of companies
US10592480B1 (en) 2012-12-30 2020-03-17 Aurea Software, Inc. Affinity scoring
US10643227B1 (en) 2010-03-23 2020-05-05 Aurea Software, Inc. Business lines
US11934770B2 (en) 2022-04-08 2024-03-19 D2L Corporation System and methods for context specific annotation of electronic files

Families Citing this family (253)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6877137B1 (en) * 1998-04-09 2005-04-05 Rose Blush Software Llc System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages
KR970701888A (en) * 1994-01-27 1997-04-12 워렌 리차드 보비 SOFTWARE NOTES
US20060129944A1 (en) * 1994-01-27 2006-06-15 Berquist David T Software notes
US20050131992A1 (en) * 2003-12-11 2005-06-16 Eric Goldstein System, method and apparatus for selecting, displaying, managing, tracking and transferring access to content of web pages and other sources
US6834276B1 (en) * 1999-02-25 2004-12-21 Integrated Data Control, Inc. Database system and method for data acquisition and perusal
US7165069B1 (en) * 1999-06-28 2007-01-16 Alexa Internet Analysis of search activities of users to identify related network sites
US7016851B1 (en) * 1999-09-30 2006-03-21 Eugene M. Lee Systems and methods for preparation of an intellectual property filing in accordance with jurisdiction- and/or agent specific requirements
US7016852B1 (en) * 1999-09-30 2006-03-21 Eugene M. Lee Fee transaction system and method for intellectual property acquisition and/or maintenance
US20090307577A1 (en) * 2001-08-28 2009-12-10 Lee Eugene M System for providing a binding cost for foreign filing a patent application
US20020138297A1 (en) * 2001-03-21 2002-09-26 Lee Eugene M. Apparatus for and method of analyzing intellectual property information
JP2001209659A (en) * 1999-12-15 2001-08-03 Xerox Corp System and method for annotating object in the case that annotation device is different from viewing device
US6859909B1 (en) * 2000-03-07 2005-02-22 Microsoft Corporation System and method for annotating web-based documents
US7373313B1 (en) * 2000-04-25 2008-05-13 Alexa Internet Service for enabling users to share information regarding products represented on web pages
US7287232B2 (en) * 2000-05-08 2007-10-23 Fujitsu Limited Information display system having graphical user interface switchingly controlling information display on display screen
AU2001268167A1 (en) * 2000-06-02 2001-12-11 First To File, Inc. Computer-implemented method for securing intellectual property
US6721921B1 (en) * 2000-07-26 2004-04-13 Itm Associates Method and system for annotating documents using an independent annotation repository
US6973456B1 (en) * 2000-08-10 2005-12-06 Ross Elgart Database system and method for organizing and sharing information
US8397163B1 (en) * 2000-08-14 2013-03-12 Deep Sran Device, method, and system for providing an electronic reading environment
JP4974405B2 (en) * 2000-08-31 2012-07-11 ソニー株式会社 Server use method, server use reservation management apparatus, and program storage medium
AU2002227040A1 (en) * 2000-11-27 2002-06-03 First To File, Inc. Computer implemented method for controlling document edits
US20020065675A1 (en) * 2000-11-27 2002-05-30 Grainger Jeffry J. Computer implemented method of managing information disclosure statements
US20020111824A1 (en) * 2000-11-27 2002-08-15 First To File, Inc. Method of defining workflow rules for managing intellectual property
US20020111953A1 (en) * 2000-11-27 2002-08-15 First To File, Inc. Docketing system
US20020093528A1 (en) * 2000-11-27 2002-07-18 First To File, Inc. User interface for managing intellectual property
US20020065677A1 (en) * 2000-11-27 2002-05-30 First To File, Inc. Computer implemented method of managing information disclosure statements
US20020065676A1 (en) * 2000-11-27 2002-05-30 First To File, Inc. Computer implemented method of generating information disclosure statements
US7100114B1 (en) * 2000-12-11 2006-08-29 International Business Machines Corporation System and process for creating bookmark web pages using web browser intermediaries
US7418657B2 (en) * 2000-12-12 2008-08-26 Ebay, Inc. Automatically inserting relevant hyperlinks into a webpage
JP3664475B2 (en) * 2001-02-09 2005-06-29 インターナショナル・ビジネス・マシーンズ・コーポレーション Information processing method, information processing system, program, and recording medium
US7158971B1 (en) * 2001-03-07 2007-01-02 Thomas Layne Bascom Method for searching document objects on a network
US7386792B1 (en) 2001-03-07 2008-06-10 Thomas Layne Bascom System and method for collecting, storing, managing and providing categorized information related to a document object
US7647373B2 (en) * 2001-03-13 2010-01-12 Eplus Capital, Inc. System and process for network collaboration through embedded annotation and rendering instructions
US8484177B2 (en) 2001-03-21 2013-07-09 Eugene M. Lee Apparatus for and method of searching and organizing intellectual property information utilizing a field-of-search
US7602379B2 (en) * 2001-06-19 2009-10-13 Hewlett-Packard Development Company, L.P. Digital annotator
KR20030009704A (en) * 2001-07-23 2003-02-05 한국전자통신연구원 System for drawing patent map using technical field word, its method
US9460414B2 (en) * 2001-08-28 2016-10-04 Eugene M. Lee Computer assisted and/or implemented process and system for annotating and/or linking documents and data, optionally in an intellectual property management system
US9541977B1 (en) 2001-08-28 2017-01-10 Eugene M. Lee Computer-implemented method and system for automated claim charts with context associations
US7885987B1 (en) 2001-08-28 2011-02-08 Lee Eugene M Computer-implemented method and system for managing attributes of intellectual property documents, optionally including organization thereof
US7921357B2 (en) * 2002-05-23 2011-04-05 Lebow David G Highlighting comparison method
US20030225858A1 (en) * 2002-05-30 2003-12-04 International Business Machines Corporation Method and apparatus for traversing Web pages in a network data processing system
US7200803B2 (en) * 2002-06-27 2007-04-03 Microsoft Corporation System and method for visually categorizing electronic notes
US7305611B2 (en) * 2002-08-22 2007-12-04 Platform Digital Llc Authoring tool for remote experience lessons
US7634729B2 (en) * 2002-11-10 2009-12-15 Microsoft Corporation Handwritten file names
US7284200B2 (en) * 2002-11-10 2007-10-16 Microsoft Corporation Organization of handwritten notes using handwritten titles
US20040196306A1 (en) * 2003-04-04 2004-10-07 Microsoft Corporation Method and system for flagging digital ink note content
US7269787B2 (en) * 2003-04-28 2007-09-11 International Business Machines Coporation Multi-document context aware annotation system
JP4014160B2 (en) * 2003-05-30 2007-11-28 インターナショナル・ビジネス・マシーンズ・コーポレーション Information processing apparatus, program, and recording medium
US8327255B2 (en) * 2003-08-07 2012-12-04 West Services, Inc. Computer program product containing electronic transcript and exhibit files and method for making the same
US7418656B1 (en) * 2003-10-03 2008-08-26 Adobe Systems Incorporated Dynamic annotations for electronics documents
US20050086634A1 (en) * 2003-10-16 2005-04-21 International Business Machines Corporation Web page development environment that displays frequency of use information
US7562287B1 (en) 2005-08-17 2009-07-14 Clipmarks Llc System, method and apparatus for selecting, displaying, managing, tracking and transferring access to content of web pages and other sources
WO2007109444A2 (en) * 2006-03-17 2007-09-27 Schmitt William C Common format learning device
US7792792B2 (en) * 2006-05-22 2010-09-07 Microsoft Corporation Synchronizing structured web site contents
JP5233220B2 (en) 2006-10-11 2013-07-10 株式会社リコー Page additional information sharing management method
US20080215589A1 (en) * 2006-11-10 2008-09-04 Getingate, Inc. System, Method, and Computer-Readable Medium for Collection and Distribution of User-Supplied Comments Associated with Network and Local Content
US8515912B2 (en) 2010-07-15 2013-08-20 Palantir Technologies, Inc. Sharing and deconflicting data changes in a multimaster database system
US7962495B2 (en) 2006-11-20 2011-06-14 Palantir Technologies, Inc. Creating data in a data store using a dynamic ontology
US8595635B2 (en) 2007-01-25 2013-11-26 Salesforce.Com, Inc. System, method and apparatus for selecting content from web sources and posting content to web logs
US8930331B2 (en) 2007-02-21 2015-01-06 Palantir Technologies Providing unique views of data based on changes or rules
US8924844B2 (en) * 2007-03-13 2014-12-30 Visual Cues Llc Object annotation
US8024652B2 (en) * 2007-04-10 2011-09-20 Microsoft Corporation Techniques to associate information between application programs
US20080256114A1 (en) * 2007-04-10 2008-10-16 Microsoft Corporation Techniques to display associated information between application programs
US20080256434A1 (en) * 2007-04-10 2008-10-16 Morris Robert P Methods, Systems, And Computer Program Products For Associating User-Provided Annotation Data With Markup Content Of A Resource
US8612469B2 (en) 2008-02-21 2013-12-17 Globalenglish Corporation Network-accessible collaborative annotation tool
US20090217196A1 (en) * 2008-02-21 2009-08-27 Globalenglish Corporation Web-Based Tool for Collaborative, Social Learning
US20090217185A1 (en) * 2008-02-22 2009-08-27 Eugene Goldfarb Container generation system for a customizable application
US8515786B2 (en) 2008-02-22 2013-08-20 Accenture Global Services Gmbh Rule generation system adapted for an insurance claim processing system
US8478769B2 (en) 2008-02-22 2013-07-02 Accenture Global Services Limited Conversational question generation system adapted for an insurance claim processing system
US20100151431A1 (en) * 2008-03-27 2010-06-17 Knowledge Athletes, Inc. Virtual learning
US8429194B2 (en) 2008-09-15 2013-04-23 Palantir Technologies, Inc. Document-based workflows
US8533582B2 (en) * 2009-03-20 2013-09-10 Xerox Corporation Trail-based data content discovery, organization, and processing
US8856645B2 (en) * 2009-03-20 2014-10-07 Xerox Corporation Generating formatted documents based on collected data content
US20100269089A1 (en) * 2009-04-21 2010-10-21 Vinod R Panicker Method and system for generation of reusable design patterns
US10424000B2 (en) 2009-05-30 2019-09-24 Edmond K. Chow Methods and systems for annotation of digital information
US8301631B2 (en) * 2009-05-30 2012-10-30 Edmond Kwok-Keung Chow Methods and systems for annotation of digital information
US9015166B2 (en) 2009-05-30 2015-04-21 Edmond Kwok-Keung Chow Methods and systems for annotation of digital information
US8234370B2 (en) * 2009-06-30 2012-07-31 International Business Machines Corporation Determining web analytics information
US20110202864A1 (en) * 2010-02-15 2011-08-18 Hirsch Michael B Apparatus and methods of receiving and acting on user-entered information
US8321382B2 (en) * 2010-03-25 2012-11-27 Xerox Corporation Validating aggregate documents
US9262396B1 (en) 2010-03-26 2016-02-16 Amazon Technologies, Inc. Browser compatibility checker tool
JP5062291B2 (en) * 2010-05-14 2012-10-31 船井電機株式会社 COMMUNICATION METHOD, INFORMATION TERMINAL DEVICE, DISPLAY DEVICE, AND COMMUNICATION SYSTEM PROVIDED WITH THE SAME
US8332408B1 (en) * 2010-08-23 2012-12-11 Google Inc. Date-based web page annotation
US7904574B1 (en) * 2010-09-24 2011-03-08 Bryant Christopher Lee Managing locally stored web-based database data
US8775444B2 (en) 2010-10-29 2014-07-08 Xerox Corporation Generating a subset aggregate document from an existing aggregate document
US9471145B2 (en) 2011-01-06 2016-10-18 Blackberry Limited Electronic device and method of displaying information in response to a gesture
US9423878B2 (en) 2011-01-06 2016-08-23 Blackberry Limited Electronic device and method of displaying information in response to a gesture
US9465440B2 (en) * 2011-01-06 2016-10-11 Blackberry Limited Electronic device and method of displaying information in response to a gesture
JP5987315B2 (en) * 2011-03-18 2016-09-07 株式会社リコー Display control apparatus and program
US9430583B1 (en) 2011-06-10 2016-08-30 Salesforce.Com, Inc. Extracting a portion of a document, such as a web page
US9092482B2 (en) 2013-03-14 2015-07-28 Palantir Technologies, Inc. Fair scheduling for mixed-query loads
US8799240B2 (en) 2011-06-23 2014-08-05 Palantir Technologies, Inc. System and method for investigating large amounts of data
US9547693B1 (en) 2011-06-23 2017-01-17 Palantir Technologies Inc. Periodic database search manager for multiple data sources
US9003423B1 (en) * 2011-07-29 2015-04-07 Amazon Technologies, Inc. Dynamic browser compatibility checker
US8732574B2 (en) 2011-08-25 2014-05-20 Palantir Technologies, Inc. System and method for parameterizing documents for automatic workflow generation
US8504542B2 (en) 2011-09-02 2013-08-06 Palantir Technologies, Inc. Multi-row transactions
US8560494B1 (en) 2011-09-30 2013-10-15 Palantir Technologies, Inc. Visual data importer
US9378526B2 (en) 2012-03-02 2016-06-28 Palantir Technologies, Inc. System and method for accessing data objects via remote references
US9489271B1 (en) * 2012-03-29 2016-11-08 Veritas Technologies Llc User interface for restoring databases
US9753926B2 (en) 2012-04-30 2017-09-05 Salesforce.Com, Inc. Extracting a portion of a document, such as a web page
US9798768B2 (en) 2012-09-10 2017-10-24 Palantir Technologies, Inc. Search around visual queries
US9081975B2 (en) 2012-10-22 2015-07-14 Palantir Technologies, Inc. Sharing information between nexuses that use different classification schemes for information access control
US9348677B2 (en) 2012-10-22 2016-05-24 Palantir Technologies Inc. System and method for batch evaluation programs
US9471370B2 (en) 2012-10-22 2016-10-18 Palantir Technologies, Inc. System and method for stack-based batch evaluation of program instructions
US9501761B2 (en) 2012-11-05 2016-11-22 Palantir Technologies, Inc. System and method for sharing investigation results
US9443098B2 (en) * 2012-12-19 2016-09-13 Pandexio, Inc. Multi-layered metadata management system
US9123086B1 (en) 2013-01-31 2015-09-01 Palantir Technologies, Inc. Automatically generating event objects from images
US10409900B2 (en) * 2013-02-11 2019-09-10 Ipquants Limited Method and system for displaying and searching information in an electronic document
CA2902485C (en) 2013-02-25 2019-05-21 Patrick Soon-Shiong Link association analysis systems and methods
US10037314B2 (en) 2013-03-14 2018-07-31 Palantir Technologies, Inc. Mobile reports
US9367463B2 (en) 2013-03-14 2016-06-14 Palantir Technologies, Inc. System and method utilizing a shared cache to provide zero copy memory mapped database
US8937619B2 (en) 2013-03-15 2015-01-20 Palantir Technologies Inc. Generating an object time series from data objects
US8818892B1 (en) 2013-03-15 2014-08-26 Palantir Technologies, Inc. Prioritizing data clusters with customizable scoring strategies
US9740369B2 (en) 2013-03-15 2017-08-22 Palantir Technologies Inc. Systems and methods for providing a tagging interface for external content
US8868486B2 (en) 2013-03-15 2014-10-21 Palantir Technologies Inc. Time-sensitive cube
US8909656B2 (en) 2013-03-15 2014-12-09 Palantir Technologies Inc. Filter chains with associated multipath views for exploring large data sets
US9965937B2 (en) 2013-03-15 2018-05-08 Palantir Technologies Inc. External malware data item clustering and analysis
US10275778B1 (en) 2013-03-15 2019-04-30 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive investigation based on automatic malfeasance clustering of related data in various data structures
US9898167B2 (en) * 2013-03-15 2018-02-20 Palantir Technologies Inc. Systems and methods for providing a tagging interface for external content
US8930897B2 (en) 2013-03-15 2015-01-06 Palantir Technologies Inc. Data integration tool
US8903717B2 (en) 2013-03-15 2014-12-02 Palantir Technologies Inc. Method and system for generating a parser and parsing complex data
US8917274B2 (en) 2013-03-15 2014-12-23 Palantir Technologies Inc. Event matrix based on integrated data
US8799799B1 (en) 2013-05-07 2014-08-05 Palantir Technologies Inc. Interactive geospatial map
US9335897B2 (en) 2013-08-08 2016-05-10 Palantir Technologies Inc. Long click display of a context menu
US9223773B2 (en) 2013-08-08 2015-12-29 Palatir Technologies Inc. Template system for custom document generation
US8713467B1 (en) 2013-08-09 2014-04-29 Palantir Technologies, Inc. Context-sensitive views
US9785317B2 (en) 2013-09-24 2017-10-10 Palantir Technologies Inc. Presentation and analysis of user interaction data
US8938686B1 (en) 2013-10-03 2015-01-20 Palantir Technologies Inc. Systems and methods for analyzing performance of an entity
US8812960B1 (en) 2013-10-07 2014-08-19 Palantir Technologies Inc. Cohort-based presentation of user interaction data
TWI651640B (en) * 2013-10-16 2019-02-21 3M新設資產公司 Organize digital notes on the user interface
US9116975B2 (en) 2013-10-18 2015-08-25 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive simultaneous querying of multiple data stores
US8924872B1 (en) 2013-10-18 2014-12-30 Palantir Technologies Inc. Overview user interface of emergency call data of a law enforcement agency
US9773000B2 (en) 2013-10-29 2017-09-26 Pandexio, Inc. Knowledge object and collaboration management system
US9021384B1 (en) 2013-11-04 2015-04-28 Palantir Technologies Inc. Interactive vehicle information map
US8868537B1 (en) 2013-11-11 2014-10-21 Palantir Technologies, Inc. Simple web search
US9898451B2 (en) 2013-11-26 2018-02-20 Adobe Systems Incorporated Content adaptation based on selected reviewer comment
US9105000B1 (en) 2013-12-10 2015-08-11 Palantir Technologies Inc. Aggregating data from a plurality of data sources
US9734217B2 (en) 2013-12-16 2017-08-15 Palantir Technologies Inc. Methods and systems for analyzing entity performance
US9552615B2 (en) 2013-12-20 2017-01-24 Palantir Technologies Inc. Automated database analysis to detect malfeasance
US10356032B2 (en) 2013-12-26 2019-07-16 Palantir Technologies Inc. System and method for detecting confidential information emails
US8832832B1 (en) 2014-01-03 2014-09-09 Palantir Technologies Inc. IP reputation
US9043696B1 (en) 2014-01-03 2015-05-26 Palantir Technologies Inc. Systems and methods for visual definition of data associations
US9483162B2 (en) 2014-02-20 2016-11-01 Palantir Technologies Inc. Relationship visualizations
US9009827B1 (en) 2014-02-20 2015-04-14 Palantir Technologies Inc. Security sharing system
US9727376B1 (en) 2014-03-04 2017-08-08 Palantir Technologies, Inc. Mobile tasks
US9547422B2 (en) * 2014-03-07 2017-01-17 Blackberry Limited System and method for capturing notes on electronic devices
US8924429B1 (en) 2014-03-18 2014-12-30 Palantir Technologies Inc. Determining and extracting changed data from a data source
US9857958B2 (en) 2014-04-28 2018-01-02 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive access of, investigation of, and analysis of data objects stored in one or more databases
US9009171B1 (en) 2014-05-02 2015-04-14 Palantir Technologies Inc. Systems and methods for active column filtering
US9535974B1 (en) 2014-06-30 2017-01-03 Palantir Technologies Inc. Systems and methods for identifying key phrase clusters within documents
US9619557B2 (en) 2014-06-30 2017-04-11 Palantir Technologies, Inc. Systems and methods for key phrase characterization of documents
US10572496B1 (en) 2014-07-03 2020-02-25 Palantir Technologies Inc. Distributed workflow system and database with access controls for city resiliency
US9785773B2 (en) 2014-07-03 2017-10-10 Palantir Technologies Inc. Malware data item analysis
US9202249B1 (en) 2014-07-03 2015-12-01 Palantir Technologies Inc. Data item clustering and analysis
US9021260B1 (en) 2014-07-03 2015-04-28 Palantir Technologies Inc. Malware data item analysis
US9256664B2 (en) 2014-07-03 2016-02-09 Palantir Technologies Inc. System and method for news events detection and visualization
US20160026923A1 (en) 2014-07-22 2016-01-28 Palantir Technologies Inc. System and method for determining a propensity of entity to take a specified action
US9454281B2 (en) 2014-09-03 2016-09-27 Palantir Technologies Inc. System for providing dynamic linked panels in user interface
US9501851B2 (en) 2014-10-03 2016-11-22 Palantir Technologies Inc. Time-series analysis system
US9767172B2 (en) 2014-10-03 2017-09-19 Palantir Technologies Inc. Data aggregation and analysis system
US9785328B2 (en) 2014-10-06 2017-10-10 Palantir Technologies Inc. Presentation of multivariate data on a graphical user interface of a computing system
US9984133B2 (en) 2014-10-16 2018-05-29 Palantir Technologies Inc. Schematic and database linking system
US9229952B1 (en) 2014-11-05 2016-01-05 Palantir Technologies, Inc. History preserving data pipeline system and method
US9043894B1 (en) 2014-11-06 2015-05-26 Palantir Technologies Inc. Malicious software detection in a computing system
US9367872B1 (en) 2014-12-22 2016-06-14 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive investigation of bad actor behavior based on automatic clustering of related data in various data structures
US9348920B1 (en) 2014-12-22 2016-05-24 Palantir Technologies Inc. Concept indexing among database of documents using machine learning techniques
US10362133B1 (en) 2014-12-22 2019-07-23 Palantir Technologies Inc. Communication data processing architecture
US10552994B2 (en) 2014-12-22 2020-02-04 Palantir Technologies Inc. Systems and interactive user interfaces for dynamic retrieval, analysis, and triage of data items
US9817563B1 (en) 2014-12-29 2017-11-14 Palantir Technologies Inc. System and method of generating data points from one or more data stores of data items for chart creation and manipulation
US9335911B1 (en) 2014-12-29 2016-05-10 Palantir Technologies Inc. Interactive user interface for dynamic data analysis exploration and query processing
US9870205B1 (en) 2014-12-29 2018-01-16 Palantir Technologies Inc. Storing logical units of program code generated using a dynamic programming notebook user interface
US10372879B2 (en) 2014-12-31 2019-08-06 Palantir Technologies Inc. Medical claims lead summary report generation
US10387834B2 (en) * 2015-01-21 2019-08-20 Palantir Technologies Inc. Systems and methods for accessing and storing snapshots of a remote application in a document
US10803106B1 (en) 2015-02-24 2020-10-13 Palantir Technologies Inc. System with methodology for dynamic modular ontology
US9727560B2 (en) 2015-02-25 2017-08-08 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
US9891808B2 (en) 2015-03-16 2018-02-13 Palantir Technologies Inc. Interactive user interfaces for location-based data analysis
US9886467B2 (en) 2015-03-19 2018-02-06 Plantir Technologies Inc. System and method for comparing and visualizing data entities and data entity series
US9348880B1 (en) 2015-04-01 2016-05-24 Palantir Technologies, Inc. Federated search of multiple sources with conflict resolution
US10126846B2 (en) * 2015-04-09 2018-11-13 Blackberry Limited Portable electronic device including touch-sensitive display and method of controlling selection of information
US9454785B1 (en) 2015-07-30 2016-09-27 Palantir Technologies Inc. Systems and user interfaces for holistic, data-driven investigation of bad actor behavior based on clustering and scoring of related data
US9996595B2 (en) 2015-08-03 2018-06-12 Palantir Technologies, Inc. Providing full data provenance visualization for versioned datasets
US9456000B1 (en) 2015-08-06 2016-09-27 Palantir Technologies Inc. Systems, methods, user interfaces, and computer-readable media for investigating potential malicious communications
US9600146B2 (en) 2015-08-17 2017-03-21 Palantir Technologies Inc. Interactive geospatial map
US10489391B1 (en) 2015-08-17 2019-11-26 Palantir Technologies Inc. Systems and methods for grouping and enriching data items accessed from one or more databases for presentation in a user interface
US10102369B2 (en) 2015-08-19 2018-10-16 Palantir Technologies Inc. Checkout system executable code monitoring, and user account compromise determination system
US10853378B1 (en) 2015-08-25 2020-12-01 Palantir Technologies Inc. Electronic note management via a connected entity graph
US11150917B2 (en) 2015-08-26 2021-10-19 Palantir Technologies Inc. System for data aggregation and analysis of data from a plurality of data sources
US9485265B1 (en) 2015-08-28 2016-11-01 Palantir Technologies Inc. Malicious activity detection system capable of efficiently processing data accessed from databases and generating alerts for display in interactive user interfaces
US10706434B1 (en) 2015-09-01 2020-07-07 Palantir Technologies Inc. Methods and systems for determining location information
US9514205B1 (en) 2015-09-04 2016-12-06 Palantir Technologies Inc. Systems and methods for importing data from electronic data files
US9576015B1 (en) 2015-09-09 2017-02-21 Palantir Technologies, Inc. Domain-specific language for dataset transformations
US10558339B1 (en) 2015-09-11 2020-02-11 Palantir Technologies Inc. System and method for analyzing electronic communications and a collaborative electronic communications user interface
US9772934B2 (en) 2015-09-14 2017-09-26 Palantir Technologies Inc. Pluggable fault detection tests for data pipelines
JP6736856B2 (en) * 2015-09-16 2020-08-05 富士ゼロックス株式会社 Medical document management device, medical document management system and program
US10296617B1 (en) 2015-10-05 2019-05-21 Palantir Technologies Inc. Searches of highly structured data
US9542446B1 (en) 2015-12-17 2017-01-10 Palantir Technologies, Inc. Automatic generation of composite datasets based on hierarchical fields
US9823818B1 (en) 2015-12-29 2017-11-21 Palantir Technologies Inc. Systems and interactive user interfaces for automatic generation of temporal representation of data objects
US10089289B2 (en) 2015-12-29 2018-10-02 Palantir Technologies Inc. Real-time document annotation
US9652510B1 (en) 2015-12-29 2017-05-16 Palantir Technologies Inc. Systems and user interfaces for data analysis including artificial intelligence algorithms for generating optimized packages of data items
US9612723B1 (en) 2015-12-30 2017-04-04 Palantir Technologies Inc. Composite graphical interface with shareable data-objects
US10248722B2 (en) 2016-02-22 2019-04-02 Palantir Technologies Inc. Multi-language support for dynamic ontology
US10698938B2 (en) 2016-03-18 2020-06-30 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
US10554516B1 (en) 2016-06-09 2020-02-04 Palantir Technologies Inc. System to collect and visualize software usage metrics
US9678850B1 (en) 2016-06-10 2017-06-13 Palantir Technologies Inc. Data pipeline monitoring
US10007674B2 (en) 2016-06-13 2018-06-26 Palantir Technologies Inc. Data revision control in large-scale data analytic systems
US10719188B2 (en) 2016-07-21 2020-07-21 Palantir Technologies Inc. Cached database and synchronization system for providing dynamic linked panels in user interface
US10324609B2 (en) 2016-07-21 2019-06-18 Palantir Technologies Inc. System for providing dynamic linked panels in user interface
US10133782B2 (en) 2016-08-01 2018-11-20 Palantir Technologies Inc. Techniques for data extraction
US10621314B2 (en) 2016-08-01 2020-04-14 Palantir Technologies Inc. Secure deployment of a software package
US11256762B1 (en) 2016-08-04 2022-02-22 Palantir Technologies Inc. System and method for efficiently determining and displaying optimal packages of data items
US10552531B2 (en) 2016-08-11 2020-02-04 Palantir Technologies Inc. Collaborative spreadsheet data validation and integration
US10373078B1 (en) 2016-08-15 2019-08-06 Palantir Technologies Inc. Vector generation for distributed data sets
EP3282374A1 (en) 2016-08-17 2018-02-14 Palantir Technologies Inc. User interface data sample transformer
US10437840B1 (en) 2016-08-19 2019-10-08 Palantir Technologies Inc. Focused probabilistic entity resolution from multiple data sources
US10650086B1 (en) 2016-09-27 2020-05-12 Palantir Technologies Inc. Systems, methods, and framework for associating supporting data in word processing
US10152306B2 (en) 2016-11-07 2018-12-11 Palantir Technologies Inc. Framework for developing and deploying applications
US10102229B2 (en) 2016-11-09 2018-10-16 Palantir Technologies Inc. Validating data integrations using a secondary data store
US10318630B1 (en) 2016-11-21 2019-06-11 Palantir Technologies Inc. Analysis of large bodies of textual data
US10261763B2 (en) 2016-12-13 2019-04-16 Palantir Technologies Inc. Extensible data transformation authoring and validation system
US11157951B1 (en) 2016-12-16 2021-10-26 Palantir Technologies Inc. System and method for determining and displaying an optimal assignment of data items
US9946777B1 (en) 2016-12-19 2018-04-17 Palantir Technologies Inc. Systems and methods for facilitating data transformation
US10460602B1 (en) 2016-12-28 2019-10-29 Palantir Technologies Inc. Interactive vehicle information mapping system
US9922108B1 (en) 2017-01-05 2018-03-20 Palantir Technologies Inc. Systems and methods for facilitating data transformation
US10509844B1 (en) 2017-01-19 2019-12-17 Palantir Technologies Inc. Network graph parser
US10192061B2 (en) * 2017-01-24 2019-01-29 Wipro Limited Method and a computing device for providing privacy control in a surveillance video
US10180934B2 (en) 2017-03-02 2019-01-15 Palantir Technologies Inc. Automatic translation of spreadsheets into scripts
US10572576B1 (en) 2017-04-06 2020-02-25 Palantir Technologies Inc. Systems and methods for facilitating data object extraction from unstructured documents
US10824604B1 (en) 2017-05-17 2020-11-03 Palantir Technologies Inc. Systems and methods for data entry
US10956406B2 (en) 2017-06-12 2021-03-23 Palantir Technologies Inc. Propagated deletion of database records and derived data
US10534595B1 (en) 2017-06-30 2020-01-14 Palantir Technologies Inc. Techniques for configuring and validating a data pipeline deployment
US10691729B2 (en) 2017-07-07 2020-06-23 Palantir Technologies Inc. Systems and methods for providing an object platform for a relational database
US10403011B1 (en) 2017-07-18 2019-09-03 Palantir Technologies Inc. Passing system with an interactive user interface
US10204119B1 (en) 2017-07-20 2019-02-12 Palantir Technologies, Inc. Inferring a dataset schema from input files
US10754820B2 (en) 2017-08-14 2020-08-25 Palantir Technologies Inc. Customizable pipeline for integrating data
US11016936B1 (en) 2017-09-05 2021-05-25 Palantir Technologies Inc. Validating data for integration
US10956508B2 (en) 2017-11-10 2021-03-23 Palantir Technologies Inc. Systems and methods for creating and managing a data integration workspace containing automatically updated data models
US11379525B1 (en) 2017-11-22 2022-07-05 Palantir Technologies Inc. Continuous builds of derived datasets in response to other dataset updates
EP3718025A1 (en) 2017-11-28 2020-10-07 Soyarslan, Osman Levent Superimposed communication by object oriented resource manipulation on a data network
US10552524B1 (en) 2017-12-07 2020-02-04 Palantir Technolgies Inc. Systems and methods for in-line document tagging and object based data synchronization
US10783162B1 (en) 2017-12-07 2020-09-22 Palantir Technologies Inc. Workflow assistant
US10360252B1 (en) 2017-12-08 2019-07-23 Palantir Technologies Inc. Detection and enrichment of missing data or metadata for large data sets
US11176116B2 (en) 2017-12-13 2021-11-16 Palantir Technologies Inc. Systems and methods for annotating datasets
US10853352B1 (en) 2017-12-21 2020-12-01 Palantir Technologies Inc. Structured data collection, presentation, validation and workflow management
GB201800595D0 (en) 2018-01-15 2018-02-28 Palantir Technologies Inc Management of software bugs in a data processing system
US10599762B1 (en) 2018-01-16 2020-03-24 Palantir Technologies Inc. Systems and methods for creating a dynamic electronic form
US11599369B1 (en) 2018-03-08 2023-03-07 Palantir Technologies Inc. Graphical user interface configuration system
US10754822B1 (en) 2018-04-18 2020-08-25 Palantir Technologies Inc. Systems and methods for ontology migration
US10885021B1 (en) 2018-05-02 2021-01-05 Palantir Technologies Inc. Interactive interpreter and graphical user interface
US11461355B1 (en) 2018-05-15 2022-10-04 Palantir Technologies Inc. Ontological mapping of data
US11263263B2 (en) 2018-05-30 2022-03-01 Palantir Technologies Inc. Data propagation and mapping system
US11061542B1 (en) 2018-06-01 2021-07-13 Palantir Technologies Inc. Systems and methods for determining and displaying optimal associations of data items
US10795909B1 (en) 2018-06-14 2020-10-06 Palantir Technologies Inc. Minimized and collapsed resource dependency path
US11119630B1 (en) 2018-06-19 2021-09-14 Palantir Technologies Inc. Artificial intelligence assisted evaluations and user interface for same
CN109522390B (en) * 2018-11-14 2020-11-13 山东大学 Search result display method and device

Citations (89)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US32632A (en) * 1861-06-25 Water-elevator
US34476A (en) * 1862-02-25 Improvement in hose-couplings
US4205780A (en) * 1977-03-21 1980-06-03 Teknekron, Inc. Document processing system and method
US4270182A (en) * 1974-12-30 1981-05-26 Asija Satya P Automated information input, storage, and retrieval system
US4486857A (en) * 1982-10-06 1984-12-04 Quickview Partners Display system for the suppression and regeneration of characters in a series of fields in a stored record
US4533910A (en) * 1982-11-02 1985-08-06 Cadtrak Corporation Graphics display system with viewports of arbitrary location and content
US4555775A (en) * 1982-10-07 1985-11-26 At&T Bell Laboratories Dynamic generation and overlaying of graphic windows for multiple active program storage areas
US4622545A (en) * 1982-09-30 1986-11-11 Apple Computer, Inc. Method and apparatus for image compression and manipulation
US4709348A (en) * 1986-06-13 1987-11-24 International Business Machines Corporation Interactive page length adjustment with automatic pagination
US4736308A (en) * 1984-09-06 1988-04-05 Quickview Systems Search/retrieval system
US4748618A (en) * 1986-05-21 1988-05-31 Bell Communications Research, Inc. Telecommunications interface
US4772882A (en) * 1986-07-18 1988-09-20 Commodore-Amiga, Inc. Cursor controller user interface system
US4785408A (en) * 1985-03-11 1988-11-15 AT&T Information Systems Inc. American Telephone and Telegraph Company Method and apparatus for generating computer-controlled interactive voice services
US4788538A (en) * 1986-11-17 1988-11-29 Lotus Development Corporation Method and apparatus for determining boundaries of graphic regions
US4847604A (en) * 1987-08-27 1989-07-11 Doyle Michael D Method and apparatus for identifying features of an image on a video display
US4873623A (en) * 1985-04-30 1989-10-10 Prometrix Corporation Process control interface with simultaneously displayed three level dynamic menu
US4884223A (en) * 1985-07-05 1989-11-28 Hybond, Inc. Dynamic force measurement system
US4899292A (en) * 1988-03-02 1990-02-06 Image Storage/Retrieval Systems, Inc. System for storing and retrieving text and associated graphics
US4899136A (en) * 1986-04-28 1990-02-06 Xerox Corporation Data processor having a user interface display with metaphoric objects
US4914732A (en) * 1985-10-16 1990-04-03 Supra Products, Inc. Electronic key with interactive graphic user interface
US4931783A (en) * 1988-07-26 1990-06-05 Apple Computer, Inc. Method and apparatus for removable menu window
US4935865A (en) * 1988-06-02 1990-06-19 The United States Of America As Represented By The Secretary Of The Air Force Computer controlled electropolishing system
US4939507A (en) * 1986-04-28 1990-07-03 Xerox Corporation Virtual and emulated objects for use in the user interface of a display screen of a display processor
US5008853A (en) * 1987-12-02 1991-04-16 Xerox Corporation Representation of collaborative multi-user activities relative to shared structured data objects in a networked workstation environment
US5062060A (en) * 1987-01-05 1991-10-29 Motorola Inc. Computer human interface comprising user-adjustable window for displaying or printing information
US5072412A (en) * 1987-03-25 1991-12-10 Xerox Corporation User interface with multiple workspaces for sharing display system objects
US5120944A (en) * 1989-10-10 1992-06-09 Unisys Corp. Image-based document processing system providing enhanced workstation balancing
US5148154A (en) * 1990-12-04 1992-09-15 Sony Corporation Of America Multi-dimensional user interface
US5155806A (en) * 1989-03-15 1992-10-13 Sun Microsystems, Inc. Method and apparatus for displaying context sensitive help information on a display
US5157768A (en) * 1989-03-15 1992-10-20 Sun Microsystems, Inc. Method and apparatus for displaying context sensitive help information on a display
US5163104A (en) * 1988-02-24 1992-11-10 Transtechnology Corporation Digital image processing technique including improved gray scale compression
US5222160A (en) * 1989-12-28 1993-06-22 Fujitsu Limited Document revising system for use with document reading and translating system
US5228123A (en) * 1990-01-04 1993-07-13 Heckel Paul C Interface and application development management system based on a gene metaphor
US5237158A (en) * 1989-10-10 1993-08-17 Unisys Corporation Image-based document processing system providing for priority document shipment
US5241671A (en) * 1989-10-26 1993-08-31 Encyclopaedia Britannica, Inc. Multimedia search system using a plurality of entry path means which indicate interrelatedness of information
US5253362A (en) * 1990-01-29 1993-10-12 Emtek Health Care Systems, Inc. Method for storing, retrieving, and indicating a plurality of annotations in a data cell
US5276616A (en) * 1989-10-16 1994-01-04 Sharp Kabushiki Kaisha Apparatus for automatically generating index
US5319745A (en) * 1991-09-16 1994-06-07 Societe Nationale Industrielle Et Aerospatiale Method and apparatus for processing alphanumeric and graphic information to create a data base
US5349170A (en) * 1989-10-10 1994-09-20 Unisys Corporation Image-based document processing system providing enhanced transaction balancing
US5392428A (en) * 1991-06-28 1995-02-21 Robins; Stanford K. Text analysis system
US5404514A (en) * 1989-12-26 1995-04-04 Kageneck; Karl-Erbo G. Method of indexing and retrieval of electronically-stored documents
US5404295A (en) * 1990-08-16 1995-04-04 Katz; Boris Method and apparatus for utilizing annotations to facilitate computer retrieval of database material
US5428778A (en) * 1992-02-13 1995-06-27 Office Express Pty. Ltd. Selective dissemination of information
US5432897A (en) * 1992-04-30 1995-07-11 Nippon Steel Corporation Method and an apparatus for editing tree structures in display
US5440481A (en) * 1992-10-28 1995-08-08 The United States Of America As Represented By The Secretary Of The Navy System and method for database tomography
US5442778A (en) * 1991-11-12 1995-08-15 Xerox Corporation Scatter-gather: a cluster-based method and apparatus for browsing large document collections
US5444615A (en) * 1993-03-24 1995-08-22 Engate Incorporated Attorney terminal having outline preparation capabilities for managing trial proceeding
US5469354A (en) * 1989-06-14 1995-11-21 Hitachi, Ltd. Document data processing method and apparatus for document retrieval
US5481666A (en) * 1993-08-25 1996-01-02 Taligent, Inc. Object-oriented navigation system
US5519857A (en) * 1989-06-14 1996-05-21 Hitachi, Ltd. Hierarchical presearch type text search method and apparatus and magnetic disk unit used in the apparatus
US5537526A (en) * 1993-11-12 1996-07-16 Taugent, Inc. Method and apparatus for processing a display document utilizing a system level document framework
US5544302A (en) * 1993-06-03 1996-08-06 Taligent, Inc. Object-oriented framework for creating and using container objects with built-in properties
US5550976A (en) * 1992-12-08 1996-08-27 Sun Hydraulics Corporation Decentralized distributed asynchronous object oriented system and method for electronic data management, storage, and communication
US5551055A (en) * 1992-12-23 1996-08-27 Taligent, Inc. System for providing locale dependent user interface for presenting control graphic which has different contents or same contents displayed in a predetermined order
US5557722A (en) * 1991-07-19 1996-09-17 Electronic Book Technologies, Inc. Data processing system and method for representing, generating a representation of and random access rendering of electronic documents
US5559942A (en) * 1993-05-10 1996-09-24 Apple Computer, Inc. Method and apparatus for providing a note for an application program
US5581686A (en) * 1992-12-01 1996-12-03 Microsoft Corporation Method and system for in-place interaction with contained objects
US5583982A (en) * 1992-12-23 1996-12-10 Object Technology Licensing Corporation Dialog system
US5584035A (en) * 1990-07-31 1996-12-10 Hewlett-Packard Company Object based system comprising user interface permitting manipulation of objects by users
US5592608A (en) * 1993-10-15 1997-01-07 Xerox Corporation Interactively producing indices into image and gesture-based data using unrecognized graphical objects
US5592607A (en) * 1993-10-15 1997-01-07 Xerox Corporation Interactive method and system for producing address-correlated information using user-specified address zones
US5596700A (en) * 1993-02-17 1997-01-21 International Business Machines Corporation System for annotating software windows
US5604901A (en) * 1992-04-13 1997-02-18 International Business Machines Corporation Interrogation index file comparison
US5623679A (en) * 1993-11-19 1997-04-22 Waverley Holdings, Inc. System and method for creating and manipulating notes each containing multiple sub-notes, and linking the sub-notes to portions of data objects
US5623681A (en) * 1993-11-19 1997-04-22 Waverley Holdings, Inc. Method and apparatus for synchronizing, displaying and manipulating text and image documents
US5625833A (en) * 1988-05-27 1997-04-29 Wang Laboratories, Inc. Document annotation & manipulation in a data processing system
US5628003A (en) * 1985-08-23 1997-05-06 Hitachi, Ltd. Document storage and retrieval system for storing and retrieving document image and full text data
US5689434A (en) * 1992-08-10 1997-11-18 Ingersoll-Rand Company Monitoring and control of fluid driven tools
US5696963A (en) * 1993-11-19 1997-12-09 Waverley Holdings, Inc. System, method and computer program product for searching through an individual document and a group of documents
US5757983A (en) * 1990-08-09 1998-05-26 Hitachi, Ltd. Document retrieval method and system
US5799325A (en) * 1993-11-19 1998-08-25 Smartpatents, Inc. System, method, and computer program product for generating equivalent text files
US5806079A (en) * 1993-11-19 1998-09-08 Smartpatents, Inc. System, method, and computer program product for using intelligent notes to organize, link, and manipulate disparate data objects
US5809317A (en) * 1992-12-30 1998-09-15 Intel Corporation Creating and maintaining hypertext links among heterogeneous documents by the establishment of anchors and connections among anchors
US5812834A (en) * 1995-02-21 1998-09-22 Nec Corporation Single chip microcomputer having a plurality of timer counters
US5838906A (en) * 1994-10-17 1998-11-17 The Regents Of The University Of California Distributed hypermedia method for automatically invoking external application providing interaction and display of embedded objects within a hypermedia document
US5959769A (en) * 1996-08-23 1999-09-28 Minolta Co., Ltd. Binoculars having correction device correcting alignment errors introduced in the optical axis during assembly
US5977455A (en) * 1996-04-02 1999-11-02 Dekalb Genetics Corporation Inbred corn plants WKBC5, and seeds thereof
US5985863A (en) * 1996-09-12 1999-11-16 Vertex Pharmaceuticals, Inc. Compositions and methods for decreasing IGIF and IFN-γ production by administering an ICE inhibitor
US5991087A (en) * 1993-11-12 1999-11-23 I-O Display System Llc Non-orthogonal plate in a virtual reality or heads up display
US5999929A (en) * 1997-09-29 1999-12-07 Continuum Software, Inc World wide web link referral system and method for generating and providing related links for links identified in web pages
US6243761B1 (en) * 1998-03-26 2001-06-05 Digital Equipment Corporation Method for dynamically adjusting multimedia content of a web page by a server in accordance to network path characteristics between client and server
US20010019544A1 (en) * 1997-12-30 2001-09-06 Telefonaktiebolaget Lm Ericsson Method for improving the handing over a connection from one SGSN to another SGSN
US6366923B1 (en) * 1998-03-23 2002-04-02 Webivore Research, Llc Gathering selected information from the world wide web
US6401131B1 (en) * 1997-06-19 2002-06-04 International Business Machines Corporation Web server enabling attachment of HTML and non-HTML files to web pages
US6433795B1 (en) * 1996-11-08 2002-08-13 America Online, Inc. System for integrating an on-line service community with a foreign service
US6484156B1 (en) * 1998-09-15 2002-11-19 Microsoft Corporation Accessing annotations across multiple target media streams
US6571295B1 (en) * 1996-01-31 2003-05-27 Microsoft Corporation Web page annotating and processing
US6687877B1 (en) * 1999-02-17 2004-02-03 Siemens Corp. Research Inc. Web-based call center system with web document annotation
US6877137B1 (en) * 1998-04-09 2005-04-05 Rose Blush Software Llc System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE32632E (en) 1982-07-19 1988-03-29 Apple Computer, Inc. Display system
US4959769A (en) 1983-10-03 1990-09-25 Wang Laboratories, Inc. Structures and methods for representing and processing documents
US4812834A (en) 1985-08-01 1989-03-14 Cadtrak Corporation Graphics display system with arbitrary overlapping viewports
JPH0797373B2 (en) 1985-08-23 1995-10-18 株式会社日立製作所 Document matching system
US4893256A (en) 1986-04-04 1990-01-09 International Business Machines Corporation Interactive video composition and presentation systems
GB8719572D0 (en) 1987-08-19 1987-09-23 Krebs M S Sigscan text retrieval system
US4977455B1 (en) 1988-07-15 1993-04-13 System and process for vcr scheduling
USRE34476E (en) 1990-05-14 1993-12-14 Norwood Donald D Hybrid information management system for handwriting and text
US5568639A (en) 1993-11-24 1996-10-22 Menai Corporation Method and apparatus for providing an object-oriented file structuring system on a computer

Patent Citations (98)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US34476A (en) * 1862-02-25 Improvement in hose-couplings
US32632A (en) * 1861-06-25 Water-elevator
US4270182A (en) * 1974-12-30 1981-05-26 Asija Satya P Automated information input, storage, and retrieval system
US4205780A (en) * 1977-03-21 1980-06-03 Teknekron, Inc. Document processing system and method
US4622545A (en) * 1982-09-30 1986-11-11 Apple Computer, Inc. Method and apparatus for image compression and manipulation
US4486857B1 (en) * 1982-10-06 1993-10-12 Quickview Partners Display system for the suppression and regeneration of characters in a series of fields in a stored record
US4486857A (en) * 1982-10-06 1984-12-04 Quickview Partners Display system for the suppression and regeneration of characters in a series of fields in a stored record
US4555775B1 (en) * 1982-10-07 1995-12-05 Bell Telephone Labor Inc Dynamic generation and overlaying of graphic windows for multiple active program storage areas
US4555775A (en) * 1982-10-07 1985-11-26 At&T Bell Laboratories Dynamic generation and overlaying of graphic windows for multiple active program storage areas
US4533910A (en) * 1982-11-02 1985-08-06 Cadtrak Corporation Graphics display system with viewports of arbitrary location and content
US4736308A (en) * 1984-09-06 1988-04-05 Quickview Systems Search/retrieval system
US4785408A (en) * 1985-03-11 1988-11-15 AT&T Information Systems Inc. American Telephone and Telegraph Company Method and apparatus for generating computer-controlled interactive voice services
US4873623A (en) * 1985-04-30 1989-10-10 Prometrix Corporation Process control interface with simultaneously displayed three level dynamic menu
US4884223A (en) * 1985-07-05 1989-11-28 Hybond, Inc. Dynamic force measurement system
US5628003A (en) * 1985-08-23 1997-05-06 Hitachi, Ltd. Document storage and retrieval system for storing and retrieving document image and full text data
US4914732A (en) * 1985-10-16 1990-04-03 Supra Products, Inc. Electronic key with interactive graphic user interface
US4939507A (en) * 1986-04-28 1990-07-03 Xerox Corporation Virtual and emulated objects for use in the user interface of a display screen of a display processor
US4899136A (en) * 1986-04-28 1990-02-06 Xerox Corporation Data processor having a user interface display with metaphoric objects
US4748618A (en) * 1986-05-21 1988-05-31 Bell Communications Research, Inc. Telecommunications interface
US4709348A (en) * 1986-06-13 1987-11-24 International Business Machines Corporation Interactive page length adjustment with automatic pagination
US4772882A (en) * 1986-07-18 1988-09-20 Commodore-Amiga, Inc. Cursor controller user interface system
US4788538A (en) * 1986-11-17 1988-11-29 Lotus Development Corporation Method and apparatus for determining boundaries of graphic regions
US5062060A (en) * 1987-01-05 1991-10-29 Motorola Inc. Computer human interface comprising user-adjustable window for displaying or printing information
US5072412A (en) * 1987-03-25 1991-12-10 Xerox Corporation User interface with multiple workspaces for sharing display system objects
US4847604A (en) * 1987-08-27 1989-07-11 Doyle Michael D Method and apparatus for identifying features of an image on a video display
US5008853A (en) * 1987-12-02 1991-04-16 Xerox Corporation Representation of collaborative multi-user activities relative to shared structured data objects in a networked workstation environment
US5163104A (en) * 1988-02-24 1992-11-10 Transtechnology Corporation Digital image processing technique including improved gray scale compression
US4899292A (en) * 1988-03-02 1990-02-06 Image Storage/Retrieval Systems, Inc. System for storing and retrieving text and associated graphics
US5625833A (en) * 1988-05-27 1997-04-29 Wang Laboratories, Inc. Document annotation & manipulation in a data processing system
US4935865A (en) * 1988-06-02 1990-06-19 The United States Of America As Represented By The Secretary Of The Air Force Computer controlled electropolishing system
US4931783A (en) * 1988-07-26 1990-06-05 Apple Computer, Inc. Method and apparatus for removable menu window
US5155806A (en) * 1989-03-15 1992-10-13 Sun Microsystems, Inc. Method and apparatus for displaying context sensitive help information on a display
US5157768A (en) * 1989-03-15 1992-10-20 Sun Microsystems, Inc. Method and apparatus for displaying context sensitive help information on a display
US5469354A (en) * 1989-06-14 1995-11-21 Hitachi, Ltd. Document data processing method and apparatus for document retrieval
US5519857A (en) * 1989-06-14 1996-05-21 Hitachi, Ltd. Hierarchical presearch type text search method and apparatus and magnetic disk unit used in the apparatus
US5349170A (en) * 1989-10-10 1994-09-20 Unisys Corporation Image-based document processing system providing enhanced transaction balancing
US5237158A (en) * 1989-10-10 1993-08-17 Unisys Corporation Image-based document processing system providing for priority document shipment
US5120944A (en) * 1989-10-10 1992-06-09 Unisys Corp. Image-based document processing system providing enhanced workstation balancing
US5276616A (en) * 1989-10-16 1994-01-04 Sharp Kabushiki Kaisha Apparatus for automatically generating index
US5241671A (en) * 1989-10-26 1993-08-31 Encyclopaedia Britannica, Inc. Multimedia search system using a plurality of entry path means which indicate interrelatedness of information
US5241671C1 (en) * 1989-10-26 2002-07-02 Encyclopaedia Britannica Educa Multimedia search system using a plurality of entry path means which indicate interrelatedness of information
US5404514A (en) * 1989-12-26 1995-04-04 Kageneck; Karl-Erbo G. Method of indexing and retrieval of electronically-stored documents
US5222160A (en) * 1989-12-28 1993-06-22 Fujitsu Limited Document revising system for use with document reading and translating system
US5228123A (en) * 1990-01-04 1993-07-13 Heckel Paul C Interface and application development management system based on a gene metaphor
US5253362A (en) * 1990-01-29 1993-10-12 Emtek Health Care Systems, Inc. Method for storing, retrieving, and indicating a plurality of annotations in a data cell
US5584035A (en) * 1990-07-31 1996-12-10 Hewlett-Packard Company Object based system comprising user interface permitting manipulation of objects by users
US5757983A (en) * 1990-08-09 1998-05-26 Hitachi, Ltd. Document retrieval method and system
US5404295A (en) * 1990-08-16 1995-04-04 Katz; Boris Method and apparatus for utilizing annotations to facilitate computer retrieval of database material
US5148154A (en) * 1990-12-04 1992-09-15 Sony Corporation Of America Multi-dimensional user interface
US5392428A (en) * 1991-06-28 1995-02-21 Robins; Stanford K. Text analysis system
US5557722A (en) * 1991-07-19 1996-09-17 Electronic Book Technologies, Inc. Data processing system and method for representing, generating a representation of and random access rendering of electronic documents
US5319745A (en) * 1991-09-16 1994-06-07 Societe Nationale Industrielle Et Aerospatiale Method and apparatus for processing alphanumeric and graphic information to create a data base
US5442778A (en) * 1991-11-12 1995-08-15 Xerox Corporation Scatter-gather: a cluster-based method and apparatus for browsing large document collections
US5428778A (en) * 1992-02-13 1995-06-27 Office Express Pty. Ltd. Selective dissemination of information
US5604901A (en) * 1992-04-13 1997-02-18 International Business Machines Corporation Interrogation index file comparison
US5432897A (en) * 1992-04-30 1995-07-11 Nippon Steel Corporation Method and an apparatus for editing tree structures in display
US5689434A (en) * 1992-08-10 1997-11-18 Ingersoll-Rand Company Monitoring and control of fluid driven tools
US5440481A (en) * 1992-10-28 1995-08-08 The United States Of America As Represented By The Secretary Of The Navy System and method for database tomography
US5581686A (en) * 1992-12-01 1996-12-03 Microsoft Corporation Method and system for in-place interaction with contained objects
US5550976A (en) * 1992-12-08 1996-08-27 Sun Hydraulics Corporation Decentralized distributed asynchronous object oriented system and method for electronic data management, storage, and communication
US5583982A (en) * 1992-12-23 1996-12-10 Object Technology Licensing Corporation Dialog system
US5551055A (en) * 1992-12-23 1996-08-27 Taligent, Inc. System for providing locale dependent user interface for presenting control graphic which has different contents or same contents displayed in a predetermined order
US5809317A (en) * 1992-12-30 1998-09-15 Intel Corporation Creating and maintaining hypertext links among heterogeneous documents by the establishment of anchors and connections among anchors
US5596700A (en) * 1993-02-17 1997-01-21 International Business Machines Corporation System for annotating software windows
US5444615A (en) * 1993-03-24 1995-08-22 Engate Incorporated Attorney terminal having outline preparation capabilities for managing trial proceeding
US5559942A (en) * 1993-05-10 1996-09-24 Apple Computer, Inc. Method and apparatus for providing a note for an application program
US5544302A (en) * 1993-06-03 1996-08-06 Taligent, Inc. Object-oriented framework for creating and using container objects with built-in properties
US5481666A (en) * 1993-08-25 1996-01-02 Taligent, Inc. Object-oriented navigation system
US5592608A (en) * 1993-10-15 1997-01-07 Xerox Corporation Interactively producing indices into image and gesture-based data using unrecognized graphical objects
US5592607A (en) * 1993-10-15 1997-01-07 Xerox Corporation Interactive method and system for producing address-correlated information using user-specified address zones
US5991087A (en) * 1993-11-12 1999-11-23 I-O Display System Llc Non-orthogonal plate in a virtual reality or heads up display
US5537526A (en) * 1993-11-12 1996-07-16 Taugent, Inc. Method and apparatus for processing a display document utilizing a system level document framework
US5623679A (en) * 1993-11-19 1997-04-22 Waverley Holdings, Inc. System and method for creating and manipulating notes each containing multiple sub-notes, and linking the sub-notes to portions of data objects
US5696963A (en) * 1993-11-19 1997-12-09 Waverley Holdings, Inc. System, method and computer program product for searching through an individual document and a group of documents
US5799325A (en) * 1993-11-19 1998-08-25 Smartpatents, Inc. System, method, and computer program product for generating equivalent text files
US5809318A (en) * 1993-11-19 1998-09-15 Smartpatents, Inc. Method and apparatus for synchronizing, displaying and manipulating text and image documents
US5623681A (en) * 1993-11-19 1997-04-22 Waverley Holdings, Inc. Method and apparatus for synchronizing, displaying and manipulating text and image documents
US6018749A (en) * 1993-11-19 2000-01-25 Aurigin Systems, Inc. System, method, and computer program product for generating documents using pagination information
US5845301A (en) * 1993-11-19 1998-12-01 Smartpatents, Inc. System, method, and computer program product for displaying and processing notes containing note segments linked to portions of documents
US5848409A (en) * 1993-11-19 1998-12-08 Smartpatents, Inc. System, method and computer program product for maintaining group hits tables and document index tables for the purpose of searching through individual documents and groups of documents
US5950214A (en) * 1993-11-19 1999-09-07 Aurigin Systems, Inc. System, method, and computer program product for accessing a note database having subnote information for the purpose of manipulating subnotes linked to portions of documents
US5806079A (en) * 1993-11-19 1998-09-08 Smartpatents, Inc. System, method, and computer program product for using intelligent notes to organize, link, and manipulate disparate data objects
US5991780A (en) * 1993-11-19 1999-11-23 Aurigin Systems, Inc. Computer based system, method, and computer program product for selectively displaying patent text and images
US5838906A (en) * 1994-10-17 1998-11-17 The Regents Of The University Of California Distributed hypermedia method for automatically invoking external application providing interaction and display of embedded objects within a hypermedia document
US5812834A (en) * 1995-02-21 1998-09-22 Nec Corporation Single chip microcomputer having a plurality of timer counters
US6571295B1 (en) * 1996-01-31 2003-05-27 Microsoft Corporation Web page annotating and processing
US5977455A (en) * 1996-04-02 1999-11-02 Dekalb Genetics Corporation Inbred corn plants WKBC5, and seeds thereof
US5959769A (en) * 1996-08-23 1999-09-28 Minolta Co., Ltd. Binoculars having correction device correcting alignment errors introduced in the optical axis during assembly
US5985863A (en) * 1996-09-12 1999-11-16 Vertex Pharmaceuticals, Inc. Compositions and methods for decreasing IGIF and IFN-γ production by administering an ICE inhibitor
US6433795B1 (en) * 1996-11-08 2002-08-13 America Online, Inc. System for integrating an on-line service community with a foreign service
US6401131B1 (en) * 1997-06-19 2002-06-04 International Business Machines Corporation Web server enabling attachment of HTML and non-HTML files to web pages
US5999929A (en) * 1997-09-29 1999-12-07 Continuum Software, Inc World wide web link referral system and method for generating and providing related links for links identified in web pages
US20010019544A1 (en) * 1997-12-30 2001-09-06 Telefonaktiebolaget Lm Ericsson Method for improving the handing over a connection from one SGSN to another SGSN
US6366923B1 (en) * 1998-03-23 2002-04-02 Webivore Research, Llc Gathering selected information from the world wide web
US6243761B1 (en) * 1998-03-26 2001-06-05 Digital Equipment Corporation Method for dynamically adjusting multimedia content of a web page by a server in accordance to network path characteristics between client and server
US6877137B1 (en) * 1998-04-09 2005-04-05 Rose Blush Software Llc System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages
US6484156B1 (en) * 1998-09-15 2002-11-19 Microsoft Corporation Accessing annotations across multiple target media streams
US6687877B1 (en) * 1999-02-17 2004-02-03 Siemens Corp. Research Inc. Web-based call center system with web document annotation

Cited By (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7162688B1 (en) * 2000-07-27 2007-01-09 Robert B Gillig Method for automated generation and assembly of specifications documents in CADD environments
US7890989B1 (en) 2000-10-24 2011-02-15 Sony Corporation Automated context-sensitive updating on content in an audiovisual storage system
US20060048058A1 (en) * 2001-05-25 2006-03-02 Learning Tree International System and method for electronic presentations
US7454708B2 (en) * 2001-05-25 2008-11-18 Learning Tree International System and method for electronic presentations with annotation of preview material
US20030112276A1 (en) * 2001-12-19 2003-06-19 Clement Lau User augmentation of content
US20050210059A1 (en) * 2004-03-18 2005-09-22 International Business Machines Corporation Method and system for creation and retrieval of global annotations
US20100115393A1 (en) * 2004-03-18 2010-05-06 International Business Machines Corporation Creation and retrieval of global annotations
US7669117B2 (en) * 2004-03-18 2010-02-23 International Business Machines Corporation Method and system for creation and retrieval of global annotations
US8751919B2 (en) 2004-03-18 2014-06-10 International Business Machines Corporation Creation and retrieval of global annotations
US20120066580A1 (en) * 2005-04-12 2012-03-15 Jesse David Sukman System for extracting relevant data from an intellectual property database
US20070050445A1 (en) * 2005-08-31 2007-03-01 Hugh Hyndman Internet content analysis
WO2007059237A3 (en) * 2005-11-14 2009-04-30 Trailfire Inc Distributing web applications across a pre-existing web
US8943035B2 (en) * 2005-11-14 2015-01-27 Patrick J. Ferrel Distributing web applications across a pre-existing web
US20070300160A1 (en) * 2005-11-14 2007-12-27 Ferrel Patrick J Distributing web applications across a pre-existing web
WO2007059237A2 (en) * 2005-11-14 2007-05-24 Trailfire, Inc. Distributing web applications across a pre-existing web
US20080021977A1 (en) * 2006-07-24 2008-01-24 International Business Machines Corporation Methods, systems, and computer program products for dynamically annotating web pages passed via a messaging application
US7827253B2 (en) 2006-07-24 2010-11-02 International Business Machines Corporation Methods, systems, and computer program products for dynamically annotating web pages passed via a messaging application
US9177055B2 (en) * 2006-10-19 2015-11-03 Moon-Sung Choi System for displaying and managing information on webpage using indicator
US20100211461A1 (en) * 2006-10-19 2010-08-19 Moon-Sung Choi System for Displaying and Managing Information on Webpage Using Indicator
US20080276190A1 (en) * 2007-04-03 2008-11-06 Sugarcrm Inc. Customer Relationship Management System with Quicknotes
US20090055368A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content classification and extraction apparatus, systems, and methods
US20090055242A1 (en) * 2007-08-24 2009-02-26 Gaurav Rewari Content identification and classification apparatus, systems, and methods
US20110010372A1 (en) * 2007-09-25 2011-01-13 Sadanand Sahasrabudhe Content quality apparatus, systems, and methods
US20090089653A1 (en) * 2007-09-28 2009-04-02 Microsoft Corporation Auto-generation and syndication of tables as forms
US8190990B2 (en) * 2008-06-27 2012-05-29 Google Inc. Annotating webpage content
CN102132273A (en) * 2008-06-27 2011-07-20 谷歌公司 Annotating webpage content
EP2316081A2 (en) * 2008-06-27 2011-05-04 Google, Inc. Annotating webpage content
EP2316081A4 (en) * 2008-06-27 2012-12-19 Google Inc Annotating webpage content
KR20110027795A (en) * 2008-06-27 2011-03-16 구글 잉크. Annotating webpage content
KR101614178B1 (en) * 2008-06-27 2016-04-29 구글 잉크. Annotating webpage content
US20090327855A1 (en) * 2008-06-27 2009-12-31 Google Inc. Annotating webpage content
US10394942B1 (en) * 2008-07-01 2019-08-27 Google Llc Method and system for contextually placed chat-like annotations
US8510646B1 (en) * 2008-07-01 2013-08-13 Google Inc. Method and system for contextually placed chat-like annotations
US20110143327A1 (en) * 2008-08-12 2011-06-16 Bli Education Limited Method for facilitating assessment of a coursework answer and moderating the assessment
US8712317B2 (en) * 2008-08-12 2014-04-29 Sherston Software Limited Method for facilitating assessment of a coursework answer and moderating the assessment
US8209607B2 (en) * 2009-04-14 2012-06-26 Freedom Scientific, Inc. Document navigation method
US20100262908A1 (en) * 2009-04-14 2010-10-14 Freedom Scientific, Inc. Document Navigation Method
US8463790B1 (en) 2010-03-23 2013-06-11 Firstrain, Inc. Event naming
US9760634B1 (en) 2010-03-23 2017-09-12 Firstrain, Inc. Models for classifying documents
US8805840B1 (en) 2010-03-23 2014-08-12 Firstrain, Inc. Classification of documents
US11367295B1 (en) 2010-03-23 2022-06-21 Aurea Software, Inc. Graphical user interface for presentation of events
US10643227B1 (en) 2010-03-23 2020-05-05 Aurea Software, Inc. Business lines
US10546311B1 (en) 2010-03-23 2020-01-28 Aurea Software, Inc. Identifying competitors of companies
US10489441B1 (en) 2010-03-23 2019-11-26 Aurea Software, Inc. Models for classifying documents
US8463789B1 (en) 2010-03-23 2013-06-11 Firstrain, Inc. Event detection
US11314929B2 (en) 2011-10-07 2022-04-26 D2L Corporation System and methods for context specific annotation of electronic files
US20130091240A1 (en) * 2011-10-07 2013-04-11 Jeremy Auger Systems and methods for context specific annotation of electronic files
US9483454B2 (en) * 2011-10-07 2016-11-01 D2L Corporation Systems and methods for context specific annotation of electronic files
US9965508B1 (en) 2011-10-14 2018-05-08 Ignite Firstrain Solutions, Inc. Method and system for identifying entities
US8782042B1 (en) 2011-10-14 2014-07-15 Firstrain, Inc. Method and system for identifying entities
US10481771B1 (en) 2011-10-17 2019-11-19 Google Llc Systems and methods for controlling the display of online documents
USD715818S1 (en) * 2011-12-28 2014-10-21 Target Brands, Inc. Display screen with graphical user interface
USD705792S1 (en) 2011-12-28 2014-05-27 Target Brands, Inc. Display screen with graphical user interface
USD705790S1 (en) 2011-12-28 2014-05-27 Target Brands, Inc. Display screen with graphical user interface
US8977613B1 (en) 2012-06-12 2015-03-10 Firstrain, Inc. Generation of recurring searches
US9292505B1 (en) 2012-06-12 2016-03-22 Firstrain, Inc. Graphical user interface for recurring searches
US9529785B2 (en) 2012-11-27 2016-12-27 Google Inc. Detecting relationships between edits and acting on a subset of edits
US10592480B1 (en) 2012-12-30 2020-03-17 Aurea Software, Inc. Affinity scoring
US11087075B2 (en) 2013-08-19 2021-08-10 Google Llc Systems and methods for resolving privileged edits within suggested edits
US10380232B2 (en) 2013-08-19 2019-08-13 Google Llc Systems and methods for resolving privileged edits within suggested edits
US9971752B2 (en) 2013-08-19 2018-05-15 Google Llc Systems and methods for resolving privileged edits within suggested edits
US11663396B2 (en) 2013-08-19 2023-05-30 Google Llc Systems and methods for resolving privileged edits within suggested edits
US9348803B2 (en) 2013-10-22 2016-05-24 Google Inc. Systems and methods for providing just-in-time preview of suggestion resolutions
US11934770B2 (en) 2022-04-08 2024-03-19 D2L Corporation System and methods for context specific annotation of electronic files

Also Published As

Publication number Publication date
US6877137B1 (en) 2005-04-05

Similar Documents

Publication Publication Date Title
US6877137B1 (en) System, method and computer program product for mediating notes and note sub-notes linked or otherwise associated with stored or networked web pages
AU712382B2 (en) A system and method for using intelligent notes to organize, link, and manipulate disparate data objects
US5806079A (en) System, method, and computer program product for using intelligent notes to organize, link, and manipulate disparate data objects
KR100984400B1 (en) System and method for filtering and organizing items based on common elements
KR101120755B1 (en) System and method for virtual folder and item sharing including utilization of static and dynamic lists
KR100996763B1 (en) System amd method utilizing virtual folders
Karger et al. Haystack: A customizable general-purpose information management tool for end users of semistructured data
Grønbæk et al. From Web to workplace: designing open hypermedia systems
US7526483B2 (en) System and method for virtual folder sharing including utilization of static and dynamic lists
JP4378292B2 (en) File system shell
JP3593473B2 (en) Method for sharing electronic book contents and memo information and recording medium for electronic book viewing program
US20020161603A1 (en) Interactive publishing system providing content management
JPWO2004023310A1 (en) File management method based on network structure, operation target display restriction program, and recording medium
Myers et al. Electronic laboratory notebooks for collaborative research
JPH0869473A (en) Document management device and data processor with document management function
Miles-Board et al. Supporting management reporting: a writable web case study
Paoli Cooperative work on the network: edit the WWW!
US20070055928A1 (en) User workflow lists to organize multimedia files
Cousins Reification and affordances in a user interface for interacting with heterogeneous distributed applications
Iturrioz et al. Toward the semantic desktop: The semouse approach
Liew et al. Towards a new generation of information environment for the use of e-documents
Lai et al. DeskQuest–A Multiple-View System for Creating, Tagging, Searching and Grouping Personal Data
Schraefel et al. Intensional hypertext
Guan et al. Modeling interactive Memex-like applications based on self-modifiable Petri nets
Douglas et al. Capturing volatile information: Server-side solutions for a WWW notebook

Legal Events

Date Code Title Description
AS Assignment

Owner name: AURIGIN SYSTEMS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RIVETTE, KEVIN G.;RAPPAPORT, IRVING S.;HOHMANN, LUKE;AND OTHERS;REEL/FRAME:016075/0019;SIGNING DATES FROM 20000228 TO 20000308

Owner name: MICROPATENT LLC, CONNECTICUT

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AURIGIN SYSTEMS, INC.;REEL/FRAME:016067/0366

Effective date: 20020509

Owner name: ROSE BLUSH SOFTWARE LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROPATENT LLC;REEL/FRAME:016067/0399

Effective date: 20040323

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: INTELLECTUAL VENTURES ASSETS 151 LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:F. POSZAT HU, L.L.C.;REEL/FRAME:050915/0329

Effective date: 20191031

AS Assignment

Owner name: DATACLOUD TECHNOLOGIES, LLC, GEORGIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES ASSETS 151 LLC;REEL/FRAME:051463/0934

Effective date: 20191115