CA2381737A1 - Framework for managing data that provides correlation information in a distributed computing system - Google Patents
Framework for managing data that provides correlation information in a distributed computing system Download PDFInfo
- Publication number
- CA2381737A1 CA2381737A1 CA002381737A CA2381737A CA2381737A1 CA 2381737 A1 CA2381737 A1 CA 2381737A1 CA 002381737 A CA002381737 A CA 002381737A CA 2381737 A CA2381737 A CA 2381737A CA 2381737 A1 CA2381737 A1 CA 2381737A1
- Authority
- CA
- Canada
- Prior art keywords
- event
- correlator
- identifier
- events
- characteristic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 claims abstract description 134
- 230000008569 process Effects 0.000 claims abstract description 68
- 230000002123 temporal effect Effects 0.000 claims abstract description 45
- 238000004590 computer program Methods 0.000 claims description 12
- 230000002596 correlated effect Effects 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 26
- 230000004044 response Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 5
- 238000005259 measurement Methods 0.000 description 4
- 230000007723 transport mechanism Effects 0.000 description 4
- 241001208007 Procas Species 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 235000006719 Cassia obtusifolia Nutrition 0.000 description 1
- 235000014552 Cassia tora Nutrition 0.000 description 1
- 244000201986 Cassia tora Species 0.000 description 1
- 244000309466 calf Species 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/52—Network services specially adapted for the location of the user terminal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/561—Adding application-functional data or data for application control, e.g. adding metadata
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/30—Definitions, standards or architectural aspects of layered protocol stacks
- H04L69/32—Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
- H04L69/322—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
- H04L69/329—Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/564—Enhancement of application control based on intercepted application data
Abstract
A framework for managing data that provides correlation information in a distributed computing system is provided. The framework includes a generic correlator data structure and service for generating and managing correlators. The generic correlator data structure defines a generic correlator to uniquely identify a specific event occurring at a specific time on a specific thread of a specific process of a specific application executing on a specific machine in the distributed computing system. The correlator may be used to correlate the specific event with another event, even one occurring on a different machine.
The generic correlator data structure may be extended, optionally, to include additional context data, for example, specific information selected by a service, tool or other application requiring the correlators. Preferably, the generic correlator data structure is configured to include an association to a partner correlator for a correlated event. The service generates a correlator for an event of a series of events on a computer within the distributed system with a temporal identifier representative of the unique temporal order of the event in the series of events. The temporal identifier may be defined by one or more sequential counters each responsive a characteristic of the event. The service may provide the correlator for transporting to another computer in the distributed system for associating with a related event correlator. Accordingly, the service may receive a correlator and associate it with the related correlator.
The generic correlator data structure may be extended, optionally, to include additional context data, for example, specific information selected by a service, tool or other application requiring the correlators. Preferably, the generic correlator data structure is configured to include an association to a partner correlator for a correlated event. The service generates a correlator for an event of a series of events on a computer within the distributed system with a temporal identifier representative of the unique temporal order of the event in the series of events. The temporal identifier may be defined by one or more sequential counters each responsive a characteristic of the event. The service may provide the correlator for transporting to another computer in the distributed system for associating with a related event correlator. Accordingly, the service may receive a correlator and associate it with the related correlator.
Description
ri FRAMEWORK FOR MANAGING DATA THAT PROVIDES CORRELATION
INFORMATION IN A DISTRIBUTED COMPUTING SYSTEM
TECHNICAL FIELD
This invention relates to distributed computing systems, more particularly to a framework for managing data that provides correlation information in a distributed computing system.
BACKGROUND OF THE INVENTION
Distributed computing is a widely prevalent model for computing systems today.
Yet, when problems occur with such systems, analysis is often hampered by the distributed nature of the computing.
Most individual servers in a distributed computing environment are configured, via a logging or other service provider, to generate reasonably useful logs of their own activity.
Servers further provide tools to assist a system administrator to analyze the server logs for problemidentification.
Mostmiddlewareapplicationsthatfacilitatecommunicationbetween applications also provide a logging service and analysis tools. However, it is common today for a distributed application configuration to include six or more independent servers located on a multitude of physical machines. In such a case, often the best available method to correlate the various error or other event logs from each server is to do so manually, using a time stamp typically associated with each log entry to attempt to recreate a chain of events. The sheer volume of log entries often makes this task impossible. Even where the volume of log entries is low enough not to render the task of manual correlation impossible, the task is at best approximate because the correlator (i.e. the time stamp) is often not sufficiently granular, for example, providing millisecond accuracy when nanosecond accuracy is required.
Frequently, the clocks from which the time stamps are derived on the different platforms are not synchronized. It is now recognized that the difficulties in correlating event logs, for of n , example, in order to identify which system is the source of a problem, are a source of difficulty.
Error and other event logs generally lack sufficient correlation information that may enable the log from one system to be meaningfully compared to the log from another, particularly in a distributed computing environment. At present, such systems do not have access to sufficient contextual data particularly as it relates to other systems in the distributed computing environment. Such contextual data may be useful as a correlator between distributed systems. A correlator is data used by a service, tool or other application to associate a first event (e.g. a step taken by a process) with at least tine other event. A
correlator typically comprises data representative of an event identifier selected from one or more geographical and logical identifiers to specify what event occurred and where and a temporal identifier to specify when the event occurred.
Some service provider applications recognize the need for correlators between events that occur within the same or on separate servers in a distributed application environment. For example, one service application, Tivoli~ ARM (application response measurement) measures service response levels for transactions in a distributed environment. Tivoli is a registered trademark of International Business Machines Corporation. ARM
employs transaction correlators to provide a capability to break down a transaction into its component parts, so that the contribution of each part to the total response time can be analyzed. In a clientlserver model of a distributed computing system, for example, transactions often consist of one transaction visible to the user, and any number of nested component transactions that are invoked by the one visible transaction. These component transactions may be referred to as the children of the parent transaction (or the child of another child component transaction). As each component transaction contributes to the total response time of the visible transaction, it is useful to know the response times for each component. This function can be used across components within a single computer, or across multiple computers. The function further assists with transaction path tracing.
~i In accordance with ARM, each application responsible for a component of the overall transaction to be measured is modified to include .calls to ARM via an application programming interface (API). The calls may request correlators for transactions with one or more child transactions, send the assigned correlators to the child transactions) along with the data needed to invoke the child transactions) and pass correlators received from parent transactions to the ARM measurement agents.
ARM measurement agents follow conventions when creating correlators in accordance with a defined format. Included within the correlator is information identifying the computer, the transaction class, the transaction instance, and some flags. The ARM
correlatorformat is somewhat flexible and extendible; however, the correlator and the framework for handling it are specific to the needs of the ARM service. That is, it is not a generic correlator per se for use by one or more varied service applications.
Moreover, ARM
correlators provide identification only to the level of a transaction instance.
There is therefore a need to provide a framework for managing data that provides improved correlation information in a distributed computing system.
SUMMARY OF THE INVENTION
An object of the invention is to provide a framework for managing data that provides correlators in a distributed computing system.
In accordance with a first aspect of the invention, there is a method for providing a correlator for an event of a series of events. The method comprises generating a correlator comprising an event identifier and a temporal identifier. The event identifier comprises one or more identifiers selected from the group comprising a geographical identifier of said event; and a logical identifier of said event. The temporal identifier is representative of the order of the event in the series of events.
In accordance with an embodiment of the invention, there is a method for providing a ~i correlator for an event of a series of events occurring on a computer and for which correlators are desired. In accordance with the method, an event identifier is determined from data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event. A temporal identifier for the event is assigned from data representative of the unique temporal order of the event in the series of events. The correlator is generated from the event identifier and the temporal identifier for the event.
Preferably, to assign the temporal identifier, each event is counted using one or more sequential counters that are responsive to a characteristic of the event. The temporal identifier comprises a count from one or more of fihe one or more sequential counters. Its process may define a first characteristic of the event. One of the sequential counters may define a process sequential counter responsive to the first characteristic to count all the events of the process. In such a case, the temporal identifier comprises a count of the process sequential counter. Further, a thread of the process generating the event may define a second characteristic of the event. One of the sequential counters thus defines a thread sequential counter responsive to the second characteristic to count all the events of the particular thread of the process. The temporal identifier may additionally comprise a count of the thread sequential counter. In instances where an event may require a correlator for use by more than one provider instrumenting the process, a third characteristic of the event may be defined by the provider requiring the correlator. The thread sequential counter is further responsive to the third characteristic to count all of the events of the said thread for the said provider.
In accordance with a preferred method, there is included a step of providing a generic correlator data structure for defining the correlator. The data structure comprises means for defining the event identifier and the temporal identifier and the step of generating comprises configuring an instance of the data structure. The generic correlator data structure may further comprise means for defining optional context information. As such, the method further comprises the steps of determining data representative of an instance of the optional context information; and configuring the instance of the data structure with the data representative of the instance of the optional context information.
The generic correlator data structure may further comprise means for defining an association between the correlatorforthe event defined by the data structure and a partner correlator comprising a correlator for a second event. Accordingly, the method further comprises the steps of determining data representative of the association with the partner correlator and configuring the instance of the data structure for the event with the association. Moreover, steps are provided for receiving data for defining a partner correlator for the event and generating an instance of the generic data structure for the partner correlator in accordance with the data received.
In accordance with a preference of the invention, when the computer is coupled to one or more other computers in a distributed computersysterm, the method further includes the step of providing the correlator for transporting to a first one of the other computers for association with a correlator of a second one of the other computers. It is understood that the first and second other computers need not be different from one another.
Preferably, the method of the invention includes a step of providing the correlator for use to identify the event.
In accordance with a further aspect of the invention, there is provided a computer readable medium for implementing the methods of the invention on a computer. For example, the invention provides a computer readable medium containing executable program instructions for providing a correlator for an event of a series of events occurring on a computer and forwhich correlators are desired. The computer program medium comprises programming instructions for determining an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers forthe event. Programming instructions are further provided for assigning a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive to a characteristic of the event; and generating the correlator comprising the event identifier and the temporal identifier for the event.
In accordance with a further aspect of the invention, there is provided a correlator for an event in a series of events. The correlator comprises an event identifier comprising one or more identifiers selected from the group comprising: a geographical identifier of said event;
and a logical identifier of said event; and a temporal identifier representative of the order of said event in said series of events.
In accordance with a preference of the invention, there is a data structure stored on a computer readable medium representing a correlator. The data structure comprises a field for an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event;
and a field for a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive a characteristic of the event. In accordance with preferences of the invention, the data structure may further comprise at least one of a field for optional correlation information configured in accordance with a protocol for the exchange of information and a field for providing an association to a partner correlator.
BRIEF DESCRIPTION OF THE DRAWINGS
Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
Fig. 1 illustrates a system for managing data that provides correlation information on an exemplary distributed computing environment configured in accordance with the invention;
Fig. 2 illustrates a system for managing data that provides correlation information on another exemplary distributed computing environment configured in accordance with the ~i invention;
Fig. 3 illustrates an exemplary correlator class defining a correlator data structure in accordance with an embodiment of the invention;
Figs. 4A, 4B and 4C show exemplary event occurrence time lines and counter assignments to the events of various process/thread/provider scenarios;
Figs. 5A and 5B illustrate an abject model for a distributed correlator service in accordance with an embodiment of the invention; and Figs. 6A, 6B and 6C show a calling sequence for the classes of Figs. 5A and 5B.
DETAILED DESCRIPTION OF THE INVENTION
Reference is made to Fig. 1 which shows an exemplary distributed or networked computing system 40, namely an Internet web portal having a database, configured in accordance with the invention. The distributed computing environment 40 comprises a plurality of server platforms, collectively 42-50. The respective server platforms are configured to provide various sever applications, namely, an HTTP server 52, a servlet 54, an Enterprise JavaBeansT"" (EJBTM) server 56 client database application 58 and a DB2TM
store procedure 60 (i.e. database). Enterprise JavaBeans and EJB are trademarks of Sun Microsystems Inc. DB2 is a trademark of International Business Machines Corporation.
In exemplary system 40, servlet 54 and EJB server 56 are configured to provide a JavaTM
(trademark of Sun Microsystems Inc.) technology-based web application server, integrating enterprise data and transactions for networked communication.
As is well understood to persons skilled in the art; a server platform typically comprises a computing station having a powerful processor and high capacity mass storage.
The server typically utilizes a multi-tasking operating system allowing multiple applications to run concurrently. While each server platform 42-50 is illustrated as providing a particular server application component, (collectively 52-60) of the distributed computer system 40, it may be understood that an individual server platform may be configured to provide more than one such component.
As illustrated, the server platforms 42-50 are further configured to provide transport or other communication mechanisms, as applicable, to the server applications 52-58. For example, HTTP server 52 is coupled for network communication via HTTP
transport 62 to servlet 54. Servlet 54 is in turn coupled to EJB Server 56 via a Java Object Request Broker (ORB) 64. EJB Server 56 facilitates connection of the servlet 54 to client application 58 via DB2 Java database connectivity (JDBC) 66 while the client application 58 and DB2 store procedure 60 are coupled through DB2 Distributed Relational Database Architecture (DRDA~) middleware 68. DRDA is a trademark of International Business Machines Corporation.
In accordance with the invention, there is provided for each component 52-60 of system 40 a distributed computing system (DCS) service 70-78 for managing correlation data that provides correlators in a distributed computing system. Access to each DCS
service 70-78 is made via one or more provider plug-ins and one or more transport plug-ins for each server. For example, HTTP server 52 includes HTTP DCS provider plug-in 80 for providing access to DCS service 70 by HTTP server 52. DCS HTTP interceptor plug-in 94 provides a request interceptor to DCS 70 for HTTP transport 62. Similarly, HTTP DCS
provider plug-in 82 and Web DCS provider plug-in 84 are provided for servlet 54 while two transport plug-ins, namely DCS HTTP interceptor96 and DCS ORB Interceptor98 are provided, one for each of the transport mechanisms 62 and 64 provided by server 44 for accessing DGS
service 72. Likewise, respective DCS ORB interceptor 100 and DCS JDBC plug-in 102 are provided for DCS service 74 on server 46. Server 46 also includes Web DCS
provider 86 and DB2 DCS provider 88 for respective EJB and DB2 components. Server 48 includes DB2 DCS provider plug-in 90, DCS JDBC transport plug-in 104 and DCS DRDA
transport plug-in 106. Server 50 is provided with DB2 DCS provider plug-in 92 and DCS
DRDA
transport plug-in 108.
si r As described further herein below, the respective DCS Service, provider plug-ins and transport plug-ins for each particular application provide a framework for managing data providing correfator information. The framework may be invoked to generate a correlator for a particular event of an application. A service provider defined by the provider plug-ins may use the correlator locally, for example, as a part of a log entry for the application. The correlator may be transported to another component of the distributed computing system for association with another event. For example, a correlator of a first event of a server application on a first server may be transported via the transport mechanism coupling the first server application to another server application, particularly one such application implemented on a remote server platform. The sharing of such correlators provides a means to link events occurring on different components of a distributed computing system.
Fig. 2 illustrates another exemplary distributed computing environment comprising a clientlserver model configured in accordance with the invention. Distributed computing system 120 includes a client system 122 and a server 124 coupled for communication through a network 142, for example, a local area network (LAN). The network 142, in turn, may be connected to other LANs or a wide area network via a gateway (not shown). Client system 122 includes a client side component 126 of a clientlserver application. Client side component 126 is configured for communication between the client system 122 and the server 124. Client side component 126 may include, for example, interfaces to network 142 providing a transport for handling messages for a function call over network 142.
Server 124 includes a server side component 128 configured for communication via network 142 with client side component 126.
In accordance with the invention there is provided on client system 122 a DCS
provider plug-in 130 for client side component 126. DCS provider plug-in 130 defines a provider service for the client side component such as a logging service requiring logging data artifacts, for example artifact 132 for client side events and, in some instances, logging data artifact 132 includes a DCS correlator 134, and a partner correlator (not shown) for a corresponding server side event. Provider plug-in 130 is coupled to a storage device 136 for recording an event log including the artifact and correlator 132 and 134 and partner correlators, as applicable. Storage device 136 may be local or remote relative to client system 122.
Provider plug-in 130 is further coupled to a DCS service 138 which generates, stores and provides the DCS correlators (134) when invoked by provider plug-in 130 or a transport plug-in such as DCS Middleware plug-in 140. DCS Middleware plug-in 140 is provided for communicating with DCS service 138 to obtain correlators for transporting to server 124 in network communications over network 142. DCS service 138 also associates correlators received in inbound communications (i.e. partner correlators) with appropriate correlators generated by DCS service 138.
Server 124 includes corresponding middleware plug-in 146, DCS service 144 and DCS
provider plug-in 152 that function in a manner similar to their corresponding client side equivalents. Provider plug-in 152 defines a provider service for the server side component 128. The provider service may be a logging service requiring logging data artifacts, such as artifact 150 for server side events including a DCS correlator 147 and, as applicable, a partner correlator 148 for a corresponding client side event. A storage device 154 is coupled, either remotely or locally, to provider plug-in 152 for storing logging data artifact 150 including DCS and partner correlators 147 and 148 in log entries.
When a transport plug-in receives an inbound network communication including a correlator, whether from a client system 122 or server system 124, the correlator is removed and passed to the respective DCS service with which the transport plug-in is coupled in order that the DCS service may associate the inbound correlator as a partner correlator for a correlator generated by the DCS service. This partner correlator is linked to a correlator for an event generated by the DCS Service in response to an invocation by a provider plug-in on the system receiving the partner correlator. This basic mechanism provides a framework for arbitrary applications and systems to create and communicate correlators in a distributed computing environment.
The correlation information is therefore available to a provider such as a loggingltracing;
Reliability, Availability, Serviceability (RAS); Application Response Measurement (ARM);
application service provider (ASP) subscriber context; or performance management service tool or application for collection and correlation with other data.
In addition to providing a service for generating and transporting correlators in a distributed computing environment, the present invention provides a generic correlator for identifying events in such an environment. Fig. 3 illustrates an exemplary class data structure diagram for a correlator 10 including optional extensible context data, namely SOAP
Parameter 15 described further herein below and an optional partner correlator. In accordance with the invention, the generic correlator 10 comprises the following identifiers for characteristics of the event:
~ Hostname - identifying the host machine where a particular process (or Java Virtual Machine (JVM)) is running;
~ Process Identifier (processlD or jvmlD) - uniquely identifying the particular process (or JVM) on a particular machine;
~ Thread Identifier (threadlD) - identifying the current thread for a particular process;
~ Thread Sequence Counter (Thread_seq cntr) - identifying an event counter for a particular thread and for a particular service provider to assist in ordering the events, for example, when clock granularity is insufficient. Also it permits the identification of the reuse of a particular thread within a process, for example, when the counter is reset to zero;
~ Process Sequence Counter (Process seq cntr) - identifying an event counter for all threads on a particular process and for all service providers serving this process to assist in ordering the events, for example, when clocks on different machines in the distributed computing environment are out of synchronization or when clock granularity is insufficient;
~ Provider Identifier (providerlD) (not shown) - identifying the service provider associated with a particular correlator;
14.
~ Unique Identifier (UniquelD) - representing the UUID foran objectlevent instance that is unique within the process/JVM; and ~ Unique Identifier Format (UniquelD format) - identifying the format of the UUID (e.g.
product, version and XML data representation, etc.).
The hostname provides a geographic location identifier indicating where the event originated while the process identifier and thread identifiers provide a logical location reference for an event specifying which event occurred. The process sequence counter and, for processes executing in more than one thread, the thread sequence counter provide temporal references giving order to particular events as described further herein below.
Additional event characteristics are useful for identifying the event.
Preferably, the generic correlatordata structure provides fora providerlD fordistinguishing correlators in situations where more than one service provider is instrumented in an application.
Further the generic correlator data structure preferably includes the unique identifier and unique identifier format that provide additional instance identification capabilities to the generic correlator. The hostname and other event identifiers together with the temporal identifiers provide a generic and hierarchal convention for uniquely specifying an event.
Persons skilled in the art will understand that particular events may be identified sufficiently without configuring all of the event identifier fields of the data structure, selecting geographic and location identifiers as desired.
It is further preferred that the generic correlator data structure 10 is extensible to include optional data the need for which may be determined by the service provider, for transporting between processes. In accordance with the preference SOAP
Parameter class 15 defines:
~ Context Data (context data) - identifying the additional information required to be transported across processes for a particular service provider;
~i ~ Context Data Format (context data format) - identifying the format of the context data information. Exemplary context data formats include data formats defined in accordance with Simple Object Access Protocol (SOAP), an extensible markup language XML-based protocol for the exchange of information in a decentralized, distributed environment; Java Message Service (JMS) protocol or other suitable protocols.
This additional data is not required to establish a carrelator, per se, but may provide additional contextual information or aid with a particular feature of the provider.
It is further preferred that the generic correlator data structure includes correlator information from a partner process. The generic data structure may include such information as follows:
~ Partner Correlator (partner correlator) - identifying, in relation to a current correlator, the correlator for an event (i.e. a partner event) that triggered the particular event of the current correiator.
Correlator 10 also includes exemplary methods for setting and getting various correlator information as is understood to persons skilled in the art. Though not shown, additional methods may be included to convert or format the correlator information as desired. For example, a ToString method may be provided for converting all of the correlator information of a particular correlator to a single String data type for convenient handling. A method for incrementing the process and thread sequence counters enumerates events such that for a particular process, each event is assigned a unique count while for each thread of that particular process, and for each provider instrumented on the thread, each event is also assigned a unique count. Thus, one or more sequence counters that are responsive to characteristics of the event may be used to represent the unique temporal order of the event in a series of events requiring correlators.
With reference to Figs. 4A, 4B and 4C, there is illustrated the assignment of process and thread sequence counters to exemplary event occurrences for, respectively, a single provider instrumented on a multi-threaded process, multiple providers instrumented on a single threaded process and multiple providers instrumented on a multi-threaded process.
For the purposes of simplification, Figs. 4A, 4B and 4C illustrate at most two threads and two providers but it is understood that additional threads or providers are contemplated by the invention.
With reference to Fig. 4A there is illustrated an event line for each of two threads TH1 and TH2 of process ProcA instrumented by single provider, Prov1. The process sequence counter is represented by counter Proc# counting each of the nine sample events. The respective thread sequence counters TH1# and TH2# assign respective counts to the events that occur on the respective threads. Collectively, the nine events produce the following process sequence count and thread sequence count pairs (Proc#, THn#): (1,1 ) (2,1) (3,2) (4,2) (5,3) (6,3) (7,4) (8,4) and (9,5). As understood to persons skilled in the art, the assignment of a unique count to a process sequence counter, for example, of a correlator may be accomplished through well known steps to lock access to the counter supplying the count.
With reference to Fig. 4B there is illustrated an event line for each of two providers Prov1 and Prov2 instrumented on one thread TH1 of a process ProcB. It is noted that for the same nine sample events as depicted in Fig. 4A, the process sequence count and thread sequence count pairs are the same. With reference to Fig. 4C there is shown an event line for each of two providers Prov1 and Prov2 instrumented on two threads TH1 and TH2 of process ProcA to illustrate a further exari~ple of the assignment of a temporal identifier.
Thus the process sequence counter and thread sequence counter assign unique identifiers to event occurrences generally identified by geographic and logical identifiers within the generic correlator structure. The counters provide temporal granularity independent of a time stamp or other system clock reference.
p1 In accordance with an embodiment of the invention, there is provided an object-oriented programming model for managing correlators 10 of Fig. 3 in a distributed computing environment. Figs. 5A-5B illustrate simplified class diagrams indicating basic functional objects and characteristics of an exemplary embodiment of a DCS service in accordance with the present invention. With reference to Fig. 5A, there is illustrated a client class 300, provider class 310, middleware class 320, logging data (LoggingData) class 330 and parameter class (SOAP Parameter) 15. With reference to Fig. 5B, there is illustrated a DCS service class (Service) 350, thread table entry class (ThreadTabIeEntry) 360, middleware table entry class (MwareTabIeEntry) 370, Correlator Table Handler class CT Handler) 380, Correlator Table Entry class (CorrelatorTabieEntry) 390 and Correlator class 10.
Briefly, client class 300 from Fig. 5A defines an exemplary client object coupled via a middleware object defined by middleware class 320 to another object (not shown) in a distributed computing environment. Provider class 310 implements an exemplary service provider, namely a distributed logging service capable of tracking and recording to a log the various events of an application such as the exemplary client objects defined by client class 300. Provider 310 provides an application programming interface (API) configured for correlating client events with corresponding events of the other process (not shown) with which the client operates via the middleware object'as described. Each of the provider and middleware objects access a DCS Service defined by service class 350 of Fig. 5B for generating, storing, accessing and transporting correlators for the events of the client 300 of Fig. 5A.
As is understood to persons skilled in the art, one preferred manner of incorporating a service such as a logging provider into an application is to include invocations of the provider service at selected points in the application code that define an event of interest to be logged by the logging provider. In a distributed computing environment, particular events of interest are those involving communications, via middleware or other transport mechanisms, between the application (e.g. client) executing on one machine and another process (e.g. server) running on second machine located remotely from the first machine.
These events of interest often require correlation.
Provider 310 of Fig. 5A includes various methods such as event and record for use with a logging data object defined by logging data class 330 to provide a logging service API.
Logging data class 330 defines a data structure and methods for distributed logging where there is one instance of the logging data class per execution thread. Logging data class 330 provides methods for setting and getting various exemplary logging data for each event. In the example, the logging data of interest is defined in accordance with the data structures and methods of parameter class 15. In addition to setting data for local logging purposes, provider 310 configures optional data for inclusion in an event correlator 10 of Fig. 5B for transport with the generic correlation data. For example, provider 310 may configure an instance of parameter class 15 to represent a local time stamp for an event for inclusion as an element of context data of a correlator 10 of Fig. 5B by the set context data method.
In order to generate, store and access event correlators for client events, provider 310 of Fig. 5A may invoke various methods of DCS Service class 350 of Fig. 5B as described further herein below.
As noted, middleware objects defined by middleware class 320 of Fig. 5A
provide transport between client objects 300 and one or more other processes (e.g. server objects not shown) for the events of interest logged by the provider objects. Exemplary middleware class 320 is configured to provide objects for either client side or server side communication.
In addition to communicating the data normally required for client/server communications to complete an event, middleware class 320 is further configured in accordance with a preference of the invention to provide for transport of the correlators for the event. The correlators are preferably prepended as a header or otherwise formatted in accordance with a protocol for the middleware.
Middleware class 320 thus includes methods for typical clientlserver communication, including object initialization and termination and to receive and transmit in accordance with a protocol established for the midd(eware as is understood to persons skilled in the art. Middleware class 320 is further configured to include additional code for handling correlators and invoking methods for accessing DCS Service 350. Such additional code may remove a correlator from an inbound communication or include a correlator in an outbound communication. A correlator received on an inbound communication is configured as a partner correlator for partnering with a correlator for the thread of the process of the application receiving the communication. Middleware class 320 thus invokes methods of correlator class 10 and correlatorTabIeEntry class 390 to configure received data as a correlator object. Thereafter, the correlator object may be presented to DCS Service 350 for storing as a partner correlator and for linking with the appropriate correlator. Additionally, methods of the Service may be invoked to obtain the appropriate correiator for an outbound communication and for registering the middleware for the DCS
Service as explained further below.
Middleware class 320 includes the following exemplary methods. InitMiddleware initializes the middleware communications streams for the server application side.
Init_DCS Mware initializes the DCS Service for a particular middleware instance.
SendToMiddleware sends a data stream to a client application and send DCS Mware prepends a correlator data stream as a header to a data stream for transport. RcvFromMware receives the data stream sent by the client application into the server application. Rcv DCS
Mware extracts a correlator data stream header from that data stream to establish a correlator object for partnering with another correlator. TerminateMware terminates the middleware communication stream for the server application side. Exit DCS Mware de-registers a middleware instance from the DCS service. Correspondingly, initClientMware initializes the middleware communications streams for the client application side.
RcvFromMwareClient receives a data stream sent by the server application to the client CA9-2001-00$6 17 si application while sendToMwareClient sends a data stream to the server application, invoking send_DCS_Mware to prepend an appropriate correlator data stream header.
TerminateMwareClient terminates the middleware communication stream fior the client application side.
Referring to Fig. 5B, DCS service 350 illustrates a base class used to provide a distributed context service, managing the correlators 10 for each provider 310 into entries of a table as defined by correlator table entry class 390. Provider class 310 and middleware class 320 access Service 350.
Service 350 includes start and stop methods for respectively initiating and terminating the DCS service class. To facilitate the registration and de-registration with the DCS Service of middleware identified by an instancelD, there is provided a registerMiddleware method and an unregisterMiddleware method as well as a middleware table defined by MwareTabIeEntry 370.
Register and unregister methods facilitate registration and de-registration with the DCS
service of a provider identified by a providerlD. Preferably, the DCS service class is started before a register method is invoked. Otherwise, the DCS service may be started by the register method. The unregister method may stop the DCS service if there are no providers or middleware that remain registered with the DCS Service.
Other methods are provided for storing and accessing a correlator with the DCS
Service.
For example, pushGorrelator enters a correlator into the correlator table (via classes CT Handler 380 and CorrelatorTableEntry 390) to make the correlator available to middleware (via the DCS Service) for transporting on an outbound call from client 300.
PuIICorrelator retrieves a provider's correlator from the DCS service correlator table. By pulling a correlator from the service class, the thread sequence counter and process sequence counter are incremented by the DCS service class as discussed previously.
an The removeAIlCorrelator method removes all correlator entries (regardless of threadlD) from the correlator table for a particular provider. The suspendcorreletor method (assisted by ThreadTabIeEntry class 360) suspends a provider from updating a correlator for a particular thread until the resumeCorrelator method is invoked for the particular correlator.
Preferably, a correlator may be updated even if suspended, to include a partner correlator.
SetPartnerDataStream method, invoked by a middleware, sets the partner correlator for all providers identified in the correlator received by the middleware on an inbound call. The GetDataStream method provides to a middleware the correlator for a particular threadlD
in a byte stream, preferably in a format supported by the middleware, to transport on an outbound middleware call.
Figs. 6A, 6B and 6C illustrate a calling sequence for the classes of Figs 5A
and 5B, for generating and transporting correlators. With reference to the call flow of Fig. 6A, an instance of an application such as client class 300 of Fig. 5A performs a self initialization at call 1 (ClientStartQ) and at call 2 performs a first call to the transport mechanism (a middleware plug-in instance of class 320). Middleware plug-in 320 of Fig. 5A
starts an instance of service class 350 at call 3 and if such is successful, registers with the service instance at call 4, providing a middleware instancelD. An instance of provider service class 310, is instantiated by client 300 (not shown) and the provider calls start() of the DCS
service 350 of Fig. 5B at call 5 to ensure the service is started. If so, the provider instance registers with the service at call 6. Provider proceeds to configure a new logging data object including a correlator at calls 7 and 8. Provider desires a certain optional SOAP
parameter 15 (e.g. a time stamp) to be included in the new correlator 10 of Fig. 5A and invokes a method of the logging data 330 to add the parameter 15 of Fig. 5B
(call 9) which in turn calls correlator class object 10 to set the optional data into the correlator at call 10.
Once a correlator is populated with the parameter, the correlator is stored with the service 350 by provider 310 at call 11. The provider passes the threadlD and providerlD for the correlator to the DCS service to facilitate the completion of a new correlator. The service in turn invokes the CT EntryHandler class 390 to store the correlator instance 10. The provider 310 is now ready to handle particular events of client 300.
Fig. 6B shows a calling sequence for an exemplaly cross product/process calling sequence. Application 300 signals an event to provider 310 (call 1) which pulls a correlator from the service (call 2) for the process and thread instance of application 300. In turn, CT EntryHandler pulls the identified correlator from the table (call 3) and invokes a method of the correlator class 10 (call 4) to increment the thread sequence counter and process sequence counter, storing the values in the correlator before returning same back to the requesting provider plug-in. Provider plug-in updates particular desired optional parameters through a logging data class call 5 that in turn updates the correlator at call 6.
The updated correlator is stored with the service at calls 7 and 8. Provider plug-in records the logging data including the correlator at call 9 and requests service to suspend activity for the particular correlator at call 10.
At call 11 of Fig 6B, application 300 invokes the transport via middleware plug-in to perform a cross process/product function call or communication. At call 12, middleware requests all correlators for the particular threadlD from service 350 as a data stream to transport with the outgoing communication. At call 13, service requests all context for the threadlD
from the CT EntryHandler. At call 14, middleware sends the communication including the correlator. Upon return of a response to the communication at call 15, middleware removes the returning correlator and passes same to service at call 16 for setting as a partner correlator at call 17. Application receives the response at call 18 to the send of call 11 and invokes the provider plug-in to note a new event. Provider resumes the previously suspended correlator at call 20 and pulls the correlator from service at call 21. This provokes a pull from the CT_entryHandler at call 22 and a corresponding increment of the thread sequence counter and provider sequence counter to uniquely identify the event.
Calf 24 to logging data and corresponding call 25 to the correlator object sets context data into the correlator while calls 26 and 27 push the updated correlator back into the service and its table. Call 28 by provider plug-in records the logging data including the correlator.
Note that a retrieval of a correlator (i.e. pullcorrelatorQ) having an associated partner correlator provides an opportunity to flush the partner correlator from the correlator, once the association has been logged, so that subsequent uses of the correlator do not include references to a potentially misleading partner correlator.
Fig. 6C shows a calling sequence to bring down the service and the provider for a particular thread of an application. Calls 1 through 3 show a final pull of a correlator from the service and its table, triggering an increment of the counters. Provider plug-in calls to set context data into the correlator through logging data class at calls 4 and 5. The updated correlator is returned to the service and table at calls 6 and 7 and the logging data recorded at call 8. To bring down the service for the thread, provider plug-in requests that all correlators for the thread be removed by the service at call 9. Following removal of the correlators through the table entry handler 390 of Fig. 5C at call 10, the provider de-registers with the service at call 11 and exits from the transport at call 12.
Middleware also de-registers from service at call 13. Service stops at call 14, having nothing further to serve. Application may also invoke a self-stop method at call 15.
The embodiments) of the invention described above is(are) intended to be exemplary only.
The scope of the invention is therefore intended to be limited solely by the scope of the appended claims.
INFORMATION IN A DISTRIBUTED COMPUTING SYSTEM
TECHNICAL FIELD
This invention relates to distributed computing systems, more particularly to a framework for managing data that provides correlation information in a distributed computing system.
BACKGROUND OF THE INVENTION
Distributed computing is a widely prevalent model for computing systems today.
Yet, when problems occur with such systems, analysis is often hampered by the distributed nature of the computing.
Most individual servers in a distributed computing environment are configured, via a logging or other service provider, to generate reasonably useful logs of their own activity.
Servers further provide tools to assist a system administrator to analyze the server logs for problemidentification.
Mostmiddlewareapplicationsthatfacilitatecommunicationbetween applications also provide a logging service and analysis tools. However, it is common today for a distributed application configuration to include six or more independent servers located on a multitude of physical machines. In such a case, often the best available method to correlate the various error or other event logs from each server is to do so manually, using a time stamp typically associated with each log entry to attempt to recreate a chain of events. The sheer volume of log entries often makes this task impossible. Even where the volume of log entries is low enough not to render the task of manual correlation impossible, the task is at best approximate because the correlator (i.e. the time stamp) is often not sufficiently granular, for example, providing millisecond accuracy when nanosecond accuracy is required.
Frequently, the clocks from which the time stamps are derived on the different platforms are not synchronized. It is now recognized that the difficulties in correlating event logs, for of n , example, in order to identify which system is the source of a problem, are a source of difficulty.
Error and other event logs generally lack sufficient correlation information that may enable the log from one system to be meaningfully compared to the log from another, particularly in a distributed computing environment. At present, such systems do not have access to sufficient contextual data particularly as it relates to other systems in the distributed computing environment. Such contextual data may be useful as a correlator between distributed systems. A correlator is data used by a service, tool or other application to associate a first event (e.g. a step taken by a process) with at least tine other event. A
correlator typically comprises data representative of an event identifier selected from one or more geographical and logical identifiers to specify what event occurred and where and a temporal identifier to specify when the event occurred.
Some service provider applications recognize the need for correlators between events that occur within the same or on separate servers in a distributed application environment. For example, one service application, Tivoli~ ARM (application response measurement) measures service response levels for transactions in a distributed environment. Tivoli is a registered trademark of International Business Machines Corporation. ARM
employs transaction correlators to provide a capability to break down a transaction into its component parts, so that the contribution of each part to the total response time can be analyzed. In a clientlserver model of a distributed computing system, for example, transactions often consist of one transaction visible to the user, and any number of nested component transactions that are invoked by the one visible transaction. These component transactions may be referred to as the children of the parent transaction (or the child of another child component transaction). As each component transaction contributes to the total response time of the visible transaction, it is useful to know the response times for each component. This function can be used across components within a single computer, or across multiple computers. The function further assists with transaction path tracing.
~i In accordance with ARM, each application responsible for a component of the overall transaction to be measured is modified to include .calls to ARM via an application programming interface (API). The calls may request correlators for transactions with one or more child transactions, send the assigned correlators to the child transactions) along with the data needed to invoke the child transactions) and pass correlators received from parent transactions to the ARM measurement agents.
ARM measurement agents follow conventions when creating correlators in accordance with a defined format. Included within the correlator is information identifying the computer, the transaction class, the transaction instance, and some flags. The ARM
correlatorformat is somewhat flexible and extendible; however, the correlator and the framework for handling it are specific to the needs of the ARM service. That is, it is not a generic correlator per se for use by one or more varied service applications.
Moreover, ARM
correlators provide identification only to the level of a transaction instance.
There is therefore a need to provide a framework for managing data that provides improved correlation information in a distributed computing system.
SUMMARY OF THE INVENTION
An object of the invention is to provide a framework for managing data that provides correlators in a distributed computing system.
In accordance with a first aspect of the invention, there is a method for providing a correlator for an event of a series of events. The method comprises generating a correlator comprising an event identifier and a temporal identifier. The event identifier comprises one or more identifiers selected from the group comprising a geographical identifier of said event; and a logical identifier of said event. The temporal identifier is representative of the order of the event in the series of events.
In accordance with an embodiment of the invention, there is a method for providing a ~i correlator for an event of a series of events occurring on a computer and for which correlators are desired. In accordance with the method, an event identifier is determined from data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event. A temporal identifier for the event is assigned from data representative of the unique temporal order of the event in the series of events. The correlator is generated from the event identifier and the temporal identifier for the event.
Preferably, to assign the temporal identifier, each event is counted using one or more sequential counters that are responsive to a characteristic of the event. The temporal identifier comprises a count from one or more of fihe one or more sequential counters. Its process may define a first characteristic of the event. One of the sequential counters may define a process sequential counter responsive to the first characteristic to count all the events of the process. In such a case, the temporal identifier comprises a count of the process sequential counter. Further, a thread of the process generating the event may define a second characteristic of the event. One of the sequential counters thus defines a thread sequential counter responsive to the second characteristic to count all the events of the particular thread of the process. The temporal identifier may additionally comprise a count of the thread sequential counter. In instances where an event may require a correlator for use by more than one provider instrumenting the process, a third characteristic of the event may be defined by the provider requiring the correlator. The thread sequential counter is further responsive to the third characteristic to count all of the events of the said thread for the said provider.
In accordance with a preferred method, there is included a step of providing a generic correlator data structure for defining the correlator. The data structure comprises means for defining the event identifier and the temporal identifier and the step of generating comprises configuring an instance of the data structure. The generic correlator data structure may further comprise means for defining optional context information. As such, the method further comprises the steps of determining data representative of an instance of the optional context information; and configuring the instance of the data structure with the data representative of the instance of the optional context information.
The generic correlator data structure may further comprise means for defining an association between the correlatorforthe event defined by the data structure and a partner correlator comprising a correlator for a second event. Accordingly, the method further comprises the steps of determining data representative of the association with the partner correlator and configuring the instance of the data structure for the event with the association. Moreover, steps are provided for receiving data for defining a partner correlator for the event and generating an instance of the generic data structure for the partner correlator in accordance with the data received.
In accordance with a preference of the invention, when the computer is coupled to one or more other computers in a distributed computersysterm, the method further includes the step of providing the correlator for transporting to a first one of the other computers for association with a correlator of a second one of the other computers. It is understood that the first and second other computers need not be different from one another.
Preferably, the method of the invention includes a step of providing the correlator for use to identify the event.
In accordance with a further aspect of the invention, there is provided a computer readable medium for implementing the methods of the invention on a computer. For example, the invention provides a computer readable medium containing executable program instructions for providing a correlator for an event of a series of events occurring on a computer and forwhich correlators are desired. The computer program medium comprises programming instructions for determining an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers forthe event. Programming instructions are further provided for assigning a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive to a characteristic of the event; and generating the correlator comprising the event identifier and the temporal identifier for the event.
In accordance with a further aspect of the invention, there is provided a correlator for an event in a series of events. The correlator comprises an event identifier comprising one or more identifiers selected from the group comprising: a geographical identifier of said event;
and a logical identifier of said event; and a temporal identifier representative of the order of said event in said series of events.
In accordance with a preference of the invention, there is a data structure stored on a computer readable medium representing a correlator. The data structure comprises a field for an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event;
and a field for a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive a characteristic of the event. In accordance with preferences of the invention, the data structure may further comprise at least one of a field for optional correlation information configured in accordance with a protocol for the exchange of information and a field for providing an association to a partner correlator.
BRIEF DESCRIPTION OF THE DRAWINGS
Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
Fig. 1 illustrates a system for managing data that provides correlation information on an exemplary distributed computing environment configured in accordance with the invention;
Fig. 2 illustrates a system for managing data that provides correlation information on another exemplary distributed computing environment configured in accordance with the ~i invention;
Fig. 3 illustrates an exemplary correlator class defining a correlator data structure in accordance with an embodiment of the invention;
Figs. 4A, 4B and 4C show exemplary event occurrence time lines and counter assignments to the events of various process/thread/provider scenarios;
Figs. 5A and 5B illustrate an abject model for a distributed correlator service in accordance with an embodiment of the invention; and Figs. 6A, 6B and 6C show a calling sequence for the classes of Figs. 5A and 5B.
DETAILED DESCRIPTION OF THE INVENTION
Reference is made to Fig. 1 which shows an exemplary distributed or networked computing system 40, namely an Internet web portal having a database, configured in accordance with the invention. The distributed computing environment 40 comprises a plurality of server platforms, collectively 42-50. The respective server platforms are configured to provide various sever applications, namely, an HTTP server 52, a servlet 54, an Enterprise JavaBeansT"" (EJBTM) server 56 client database application 58 and a DB2TM
store procedure 60 (i.e. database). Enterprise JavaBeans and EJB are trademarks of Sun Microsystems Inc. DB2 is a trademark of International Business Machines Corporation.
In exemplary system 40, servlet 54 and EJB server 56 are configured to provide a JavaTM
(trademark of Sun Microsystems Inc.) technology-based web application server, integrating enterprise data and transactions for networked communication.
As is well understood to persons skilled in the art; a server platform typically comprises a computing station having a powerful processor and high capacity mass storage.
The server typically utilizes a multi-tasking operating system allowing multiple applications to run concurrently. While each server platform 42-50 is illustrated as providing a particular server application component, (collectively 52-60) of the distributed computer system 40, it may be understood that an individual server platform may be configured to provide more than one such component.
As illustrated, the server platforms 42-50 are further configured to provide transport or other communication mechanisms, as applicable, to the server applications 52-58. For example, HTTP server 52 is coupled for network communication via HTTP
transport 62 to servlet 54. Servlet 54 is in turn coupled to EJB Server 56 via a Java Object Request Broker (ORB) 64. EJB Server 56 facilitates connection of the servlet 54 to client application 58 via DB2 Java database connectivity (JDBC) 66 while the client application 58 and DB2 store procedure 60 are coupled through DB2 Distributed Relational Database Architecture (DRDA~) middleware 68. DRDA is a trademark of International Business Machines Corporation.
In accordance with the invention, there is provided for each component 52-60 of system 40 a distributed computing system (DCS) service 70-78 for managing correlation data that provides correlators in a distributed computing system. Access to each DCS
service 70-78 is made via one or more provider plug-ins and one or more transport plug-ins for each server. For example, HTTP server 52 includes HTTP DCS provider plug-in 80 for providing access to DCS service 70 by HTTP server 52. DCS HTTP interceptor plug-in 94 provides a request interceptor to DCS 70 for HTTP transport 62. Similarly, HTTP DCS
provider plug-in 82 and Web DCS provider plug-in 84 are provided for servlet 54 while two transport plug-ins, namely DCS HTTP interceptor96 and DCS ORB Interceptor98 are provided, one for each of the transport mechanisms 62 and 64 provided by server 44 for accessing DGS
service 72. Likewise, respective DCS ORB interceptor 100 and DCS JDBC plug-in 102 are provided for DCS service 74 on server 46. Server 46 also includes Web DCS
provider 86 and DB2 DCS provider 88 for respective EJB and DB2 components. Server 48 includes DB2 DCS provider plug-in 90, DCS JDBC transport plug-in 104 and DCS DRDA
transport plug-in 106. Server 50 is provided with DB2 DCS provider plug-in 92 and DCS
DRDA
transport plug-in 108.
si r As described further herein below, the respective DCS Service, provider plug-ins and transport plug-ins for each particular application provide a framework for managing data providing correfator information. The framework may be invoked to generate a correlator for a particular event of an application. A service provider defined by the provider plug-ins may use the correlator locally, for example, as a part of a log entry for the application. The correlator may be transported to another component of the distributed computing system for association with another event. For example, a correlator of a first event of a server application on a first server may be transported via the transport mechanism coupling the first server application to another server application, particularly one such application implemented on a remote server platform. The sharing of such correlators provides a means to link events occurring on different components of a distributed computing system.
Fig. 2 illustrates another exemplary distributed computing environment comprising a clientlserver model configured in accordance with the invention. Distributed computing system 120 includes a client system 122 and a server 124 coupled for communication through a network 142, for example, a local area network (LAN). The network 142, in turn, may be connected to other LANs or a wide area network via a gateway (not shown). Client system 122 includes a client side component 126 of a clientlserver application. Client side component 126 is configured for communication between the client system 122 and the server 124. Client side component 126 may include, for example, interfaces to network 142 providing a transport for handling messages for a function call over network 142.
Server 124 includes a server side component 128 configured for communication via network 142 with client side component 126.
In accordance with the invention there is provided on client system 122 a DCS
provider plug-in 130 for client side component 126. DCS provider plug-in 130 defines a provider service for the client side component such as a logging service requiring logging data artifacts, for example artifact 132 for client side events and, in some instances, logging data artifact 132 includes a DCS correlator 134, and a partner correlator (not shown) for a corresponding server side event. Provider plug-in 130 is coupled to a storage device 136 for recording an event log including the artifact and correlator 132 and 134 and partner correlators, as applicable. Storage device 136 may be local or remote relative to client system 122.
Provider plug-in 130 is further coupled to a DCS service 138 which generates, stores and provides the DCS correlators (134) when invoked by provider plug-in 130 or a transport plug-in such as DCS Middleware plug-in 140. DCS Middleware plug-in 140 is provided for communicating with DCS service 138 to obtain correlators for transporting to server 124 in network communications over network 142. DCS service 138 also associates correlators received in inbound communications (i.e. partner correlators) with appropriate correlators generated by DCS service 138.
Server 124 includes corresponding middleware plug-in 146, DCS service 144 and DCS
provider plug-in 152 that function in a manner similar to their corresponding client side equivalents. Provider plug-in 152 defines a provider service for the server side component 128. The provider service may be a logging service requiring logging data artifacts, such as artifact 150 for server side events including a DCS correlator 147 and, as applicable, a partner correlator 148 for a corresponding client side event. A storage device 154 is coupled, either remotely or locally, to provider plug-in 152 for storing logging data artifact 150 including DCS and partner correlators 147 and 148 in log entries.
When a transport plug-in receives an inbound network communication including a correlator, whether from a client system 122 or server system 124, the correlator is removed and passed to the respective DCS service with which the transport plug-in is coupled in order that the DCS service may associate the inbound correlator as a partner correlator for a correlator generated by the DCS service. This partner correlator is linked to a correlator for an event generated by the DCS Service in response to an invocation by a provider plug-in on the system receiving the partner correlator. This basic mechanism provides a framework for arbitrary applications and systems to create and communicate correlators in a distributed computing environment.
The correlation information is therefore available to a provider such as a loggingltracing;
Reliability, Availability, Serviceability (RAS); Application Response Measurement (ARM);
application service provider (ASP) subscriber context; or performance management service tool or application for collection and correlation with other data.
In addition to providing a service for generating and transporting correlators in a distributed computing environment, the present invention provides a generic correlator for identifying events in such an environment. Fig. 3 illustrates an exemplary class data structure diagram for a correlator 10 including optional extensible context data, namely SOAP
Parameter 15 described further herein below and an optional partner correlator. In accordance with the invention, the generic correlator 10 comprises the following identifiers for characteristics of the event:
~ Hostname - identifying the host machine where a particular process (or Java Virtual Machine (JVM)) is running;
~ Process Identifier (processlD or jvmlD) - uniquely identifying the particular process (or JVM) on a particular machine;
~ Thread Identifier (threadlD) - identifying the current thread for a particular process;
~ Thread Sequence Counter (Thread_seq cntr) - identifying an event counter for a particular thread and for a particular service provider to assist in ordering the events, for example, when clock granularity is insufficient. Also it permits the identification of the reuse of a particular thread within a process, for example, when the counter is reset to zero;
~ Process Sequence Counter (Process seq cntr) - identifying an event counter for all threads on a particular process and for all service providers serving this process to assist in ordering the events, for example, when clocks on different machines in the distributed computing environment are out of synchronization or when clock granularity is insufficient;
~ Provider Identifier (providerlD) (not shown) - identifying the service provider associated with a particular correlator;
14.
~ Unique Identifier (UniquelD) - representing the UUID foran objectlevent instance that is unique within the process/JVM; and ~ Unique Identifier Format (UniquelD format) - identifying the format of the UUID (e.g.
product, version and XML data representation, etc.).
The hostname provides a geographic location identifier indicating where the event originated while the process identifier and thread identifiers provide a logical location reference for an event specifying which event occurred. The process sequence counter and, for processes executing in more than one thread, the thread sequence counter provide temporal references giving order to particular events as described further herein below.
Additional event characteristics are useful for identifying the event.
Preferably, the generic correlatordata structure provides fora providerlD fordistinguishing correlators in situations where more than one service provider is instrumented in an application.
Further the generic correlator data structure preferably includes the unique identifier and unique identifier format that provide additional instance identification capabilities to the generic correlator. The hostname and other event identifiers together with the temporal identifiers provide a generic and hierarchal convention for uniquely specifying an event.
Persons skilled in the art will understand that particular events may be identified sufficiently without configuring all of the event identifier fields of the data structure, selecting geographic and location identifiers as desired.
It is further preferred that the generic correlator data structure 10 is extensible to include optional data the need for which may be determined by the service provider, for transporting between processes. In accordance with the preference SOAP
Parameter class 15 defines:
~ Context Data (context data) - identifying the additional information required to be transported across processes for a particular service provider;
~i ~ Context Data Format (context data format) - identifying the format of the context data information. Exemplary context data formats include data formats defined in accordance with Simple Object Access Protocol (SOAP), an extensible markup language XML-based protocol for the exchange of information in a decentralized, distributed environment; Java Message Service (JMS) protocol or other suitable protocols.
This additional data is not required to establish a carrelator, per se, but may provide additional contextual information or aid with a particular feature of the provider.
It is further preferred that the generic correlator data structure includes correlator information from a partner process. The generic data structure may include such information as follows:
~ Partner Correlator (partner correlator) - identifying, in relation to a current correlator, the correlator for an event (i.e. a partner event) that triggered the particular event of the current correiator.
Correlator 10 also includes exemplary methods for setting and getting various correlator information as is understood to persons skilled in the art. Though not shown, additional methods may be included to convert or format the correlator information as desired. For example, a ToString method may be provided for converting all of the correlator information of a particular correlator to a single String data type for convenient handling. A method for incrementing the process and thread sequence counters enumerates events such that for a particular process, each event is assigned a unique count while for each thread of that particular process, and for each provider instrumented on the thread, each event is also assigned a unique count. Thus, one or more sequence counters that are responsive to characteristics of the event may be used to represent the unique temporal order of the event in a series of events requiring correlators.
With reference to Figs. 4A, 4B and 4C, there is illustrated the assignment of process and thread sequence counters to exemplary event occurrences for, respectively, a single provider instrumented on a multi-threaded process, multiple providers instrumented on a single threaded process and multiple providers instrumented on a multi-threaded process.
For the purposes of simplification, Figs. 4A, 4B and 4C illustrate at most two threads and two providers but it is understood that additional threads or providers are contemplated by the invention.
With reference to Fig. 4A there is illustrated an event line for each of two threads TH1 and TH2 of process ProcA instrumented by single provider, Prov1. The process sequence counter is represented by counter Proc# counting each of the nine sample events. The respective thread sequence counters TH1# and TH2# assign respective counts to the events that occur on the respective threads. Collectively, the nine events produce the following process sequence count and thread sequence count pairs (Proc#, THn#): (1,1 ) (2,1) (3,2) (4,2) (5,3) (6,3) (7,4) (8,4) and (9,5). As understood to persons skilled in the art, the assignment of a unique count to a process sequence counter, for example, of a correlator may be accomplished through well known steps to lock access to the counter supplying the count.
With reference to Fig. 4B there is illustrated an event line for each of two providers Prov1 and Prov2 instrumented on one thread TH1 of a process ProcB. It is noted that for the same nine sample events as depicted in Fig. 4A, the process sequence count and thread sequence count pairs are the same. With reference to Fig. 4C there is shown an event line for each of two providers Prov1 and Prov2 instrumented on two threads TH1 and TH2 of process ProcA to illustrate a further exari~ple of the assignment of a temporal identifier.
Thus the process sequence counter and thread sequence counter assign unique identifiers to event occurrences generally identified by geographic and logical identifiers within the generic correlator structure. The counters provide temporal granularity independent of a time stamp or other system clock reference.
p1 In accordance with an embodiment of the invention, there is provided an object-oriented programming model for managing correlators 10 of Fig. 3 in a distributed computing environment. Figs. 5A-5B illustrate simplified class diagrams indicating basic functional objects and characteristics of an exemplary embodiment of a DCS service in accordance with the present invention. With reference to Fig. 5A, there is illustrated a client class 300, provider class 310, middleware class 320, logging data (LoggingData) class 330 and parameter class (SOAP Parameter) 15. With reference to Fig. 5B, there is illustrated a DCS service class (Service) 350, thread table entry class (ThreadTabIeEntry) 360, middleware table entry class (MwareTabIeEntry) 370, Correlator Table Handler class CT Handler) 380, Correlator Table Entry class (CorrelatorTabieEntry) 390 and Correlator class 10.
Briefly, client class 300 from Fig. 5A defines an exemplary client object coupled via a middleware object defined by middleware class 320 to another object (not shown) in a distributed computing environment. Provider class 310 implements an exemplary service provider, namely a distributed logging service capable of tracking and recording to a log the various events of an application such as the exemplary client objects defined by client class 300. Provider 310 provides an application programming interface (API) configured for correlating client events with corresponding events of the other process (not shown) with which the client operates via the middleware object'as described. Each of the provider and middleware objects access a DCS Service defined by service class 350 of Fig. 5B for generating, storing, accessing and transporting correlators for the events of the client 300 of Fig. 5A.
As is understood to persons skilled in the art, one preferred manner of incorporating a service such as a logging provider into an application is to include invocations of the provider service at selected points in the application code that define an event of interest to be logged by the logging provider. In a distributed computing environment, particular events of interest are those involving communications, via middleware or other transport mechanisms, between the application (e.g. client) executing on one machine and another process (e.g. server) running on second machine located remotely from the first machine.
These events of interest often require correlation.
Provider 310 of Fig. 5A includes various methods such as event and record for use with a logging data object defined by logging data class 330 to provide a logging service API.
Logging data class 330 defines a data structure and methods for distributed logging where there is one instance of the logging data class per execution thread. Logging data class 330 provides methods for setting and getting various exemplary logging data for each event. In the example, the logging data of interest is defined in accordance with the data structures and methods of parameter class 15. In addition to setting data for local logging purposes, provider 310 configures optional data for inclusion in an event correlator 10 of Fig. 5B for transport with the generic correlation data. For example, provider 310 may configure an instance of parameter class 15 to represent a local time stamp for an event for inclusion as an element of context data of a correlator 10 of Fig. 5B by the set context data method.
In order to generate, store and access event correlators for client events, provider 310 of Fig. 5A may invoke various methods of DCS Service class 350 of Fig. 5B as described further herein below.
As noted, middleware objects defined by middleware class 320 of Fig. 5A
provide transport between client objects 300 and one or more other processes (e.g. server objects not shown) for the events of interest logged by the provider objects. Exemplary middleware class 320 is configured to provide objects for either client side or server side communication.
In addition to communicating the data normally required for client/server communications to complete an event, middleware class 320 is further configured in accordance with a preference of the invention to provide for transport of the correlators for the event. The correlators are preferably prepended as a header or otherwise formatted in accordance with a protocol for the middleware.
Middleware class 320 thus includes methods for typical clientlserver communication, including object initialization and termination and to receive and transmit in accordance with a protocol established for the midd(eware as is understood to persons skilled in the art. Middleware class 320 is further configured to include additional code for handling correlators and invoking methods for accessing DCS Service 350. Such additional code may remove a correlator from an inbound communication or include a correlator in an outbound communication. A correlator received on an inbound communication is configured as a partner correlator for partnering with a correlator for the thread of the process of the application receiving the communication. Middleware class 320 thus invokes methods of correlator class 10 and correlatorTabIeEntry class 390 to configure received data as a correlator object. Thereafter, the correlator object may be presented to DCS Service 350 for storing as a partner correlator and for linking with the appropriate correlator. Additionally, methods of the Service may be invoked to obtain the appropriate correiator for an outbound communication and for registering the middleware for the DCS
Service as explained further below.
Middleware class 320 includes the following exemplary methods. InitMiddleware initializes the middleware communications streams for the server application side.
Init_DCS Mware initializes the DCS Service for a particular middleware instance.
SendToMiddleware sends a data stream to a client application and send DCS Mware prepends a correlator data stream as a header to a data stream for transport. RcvFromMware receives the data stream sent by the client application into the server application. Rcv DCS
Mware extracts a correlator data stream header from that data stream to establish a correlator object for partnering with another correlator. TerminateMware terminates the middleware communication stream for the server application side. Exit DCS Mware de-registers a middleware instance from the DCS service. Correspondingly, initClientMware initializes the middleware communications streams for the client application side.
RcvFromMwareClient receives a data stream sent by the server application to the client CA9-2001-00$6 17 si application while sendToMwareClient sends a data stream to the server application, invoking send_DCS_Mware to prepend an appropriate correlator data stream header.
TerminateMwareClient terminates the middleware communication stream fior the client application side.
Referring to Fig. 5B, DCS service 350 illustrates a base class used to provide a distributed context service, managing the correlators 10 for each provider 310 into entries of a table as defined by correlator table entry class 390. Provider class 310 and middleware class 320 access Service 350.
Service 350 includes start and stop methods for respectively initiating and terminating the DCS service class. To facilitate the registration and de-registration with the DCS Service of middleware identified by an instancelD, there is provided a registerMiddleware method and an unregisterMiddleware method as well as a middleware table defined by MwareTabIeEntry 370.
Register and unregister methods facilitate registration and de-registration with the DCS
service of a provider identified by a providerlD. Preferably, the DCS service class is started before a register method is invoked. Otherwise, the DCS service may be started by the register method. The unregister method may stop the DCS service if there are no providers or middleware that remain registered with the DCS Service.
Other methods are provided for storing and accessing a correlator with the DCS
Service.
For example, pushGorrelator enters a correlator into the correlator table (via classes CT Handler 380 and CorrelatorTableEntry 390) to make the correlator available to middleware (via the DCS Service) for transporting on an outbound call from client 300.
PuIICorrelator retrieves a provider's correlator from the DCS service correlator table. By pulling a correlator from the service class, the thread sequence counter and process sequence counter are incremented by the DCS service class as discussed previously.
an The removeAIlCorrelator method removes all correlator entries (regardless of threadlD) from the correlator table for a particular provider. The suspendcorreletor method (assisted by ThreadTabIeEntry class 360) suspends a provider from updating a correlator for a particular thread until the resumeCorrelator method is invoked for the particular correlator.
Preferably, a correlator may be updated even if suspended, to include a partner correlator.
SetPartnerDataStream method, invoked by a middleware, sets the partner correlator for all providers identified in the correlator received by the middleware on an inbound call. The GetDataStream method provides to a middleware the correlator for a particular threadlD
in a byte stream, preferably in a format supported by the middleware, to transport on an outbound middleware call.
Figs. 6A, 6B and 6C illustrate a calling sequence for the classes of Figs 5A
and 5B, for generating and transporting correlators. With reference to the call flow of Fig. 6A, an instance of an application such as client class 300 of Fig. 5A performs a self initialization at call 1 (ClientStartQ) and at call 2 performs a first call to the transport mechanism (a middleware plug-in instance of class 320). Middleware plug-in 320 of Fig. 5A
starts an instance of service class 350 at call 3 and if such is successful, registers with the service instance at call 4, providing a middleware instancelD. An instance of provider service class 310, is instantiated by client 300 (not shown) and the provider calls start() of the DCS
service 350 of Fig. 5B at call 5 to ensure the service is started. If so, the provider instance registers with the service at call 6. Provider proceeds to configure a new logging data object including a correlator at calls 7 and 8. Provider desires a certain optional SOAP
parameter 15 (e.g. a time stamp) to be included in the new correlator 10 of Fig. 5A and invokes a method of the logging data 330 to add the parameter 15 of Fig. 5B
(call 9) which in turn calls correlator class object 10 to set the optional data into the correlator at call 10.
Once a correlator is populated with the parameter, the correlator is stored with the service 350 by provider 310 at call 11. The provider passes the threadlD and providerlD for the correlator to the DCS service to facilitate the completion of a new correlator. The service in turn invokes the CT EntryHandler class 390 to store the correlator instance 10. The provider 310 is now ready to handle particular events of client 300.
Fig. 6B shows a calling sequence for an exemplaly cross product/process calling sequence. Application 300 signals an event to provider 310 (call 1) which pulls a correlator from the service (call 2) for the process and thread instance of application 300. In turn, CT EntryHandler pulls the identified correlator from the table (call 3) and invokes a method of the correlator class 10 (call 4) to increment the thread sequence counter and process sequence counter, storing the values in the correlator before returning same back to the requesting provider plug-in. Provider plug-in updates particular desired optional parameters through a logging data class call 5 that in turn updates the correlator at call 6.
The updated correlator is stored with the service at calls 7 and 8. Provider plug-in records the logging data including the correlator at call 9 and requests service to suspend activity for the particular correlator at call 10.
At call 11 of Fig 6B, application 300 invokes the transport via middleware plug-in to perform a cross process/product function call or communication. At call 12, middleware requests all correlators for the particular threadlD from service 350 as a data stream to transport with the outgoing communication. At call 13, service requests all context for the threadlD
from the CT EntryHandler. At call 14, middleware sends the communication including the correlator. Upon return of a response to the communication at call 15, middleware removes the returning correlator and passes same to service at call 16 for setting as a partner correlator at call 17. Application receives the response at call 18 to the send of call 11 and invokes the provider plug-in to note a new event. Provider resumes the previously suspended correlator at call 20 and pulls the correlator from service at call 21. This provokes a pull from the CT_entryHandler at call 22 and a corresponding increment of the thread sequence counter and provider sequence counter to uniquely identify the event.
Calf 24 to logging data and corresponding call 25 to the correlator object sets context data into the correlator while calls 26 and 27 push the updated correlator back into the service and its table. Call 28 by provider plug-in records the logging data including the correlator.
Note that a retrieval of a correlator (i.e. pullcorrelatorQ) having an associated partner correlator provides an opportunity to flush the partner correlator from the correlator, once the association has been logged, so that subsequent uses of the correlator do not include references to a potentially misleading partner correlator.
Fig. 6C shows a calling sequence to bring down the service and the provider for a particular thread of an application. Calls 1 through 3 show a final pull of a correlator from the service and its table, triggering an increment of the counters. Provider plug-in calls to set context data into the correlator through logging data class at calls 4 and 5. The updated correlator is returned to the service and table at calls 6 and 7 and the logging data recorded at call 8. To bring down the service for the thread, provider plug-in requests that all correlators for the thread be removed by the service at call 9. Following removal of the correlators through the table entry handler 390 of Fig. 5C at call 10, the provider de-registers with the service at call 11 and exits from the transport at call 12.
Middleware also de-registers from service at call 13. Service stops at call 14, having nothing further to serve. Application may also invoke a self-stop method at call 15.
The embodiments) of the invention described above is(are) intended to be exemplary only.
The scope of the invention is therefore intended to be limited solely by the scope of the appended claims.
Claims (32)
1. A method for providing a correlator for an event of a series of events, said method comprising:
generating a correlator comprising an event identifier and a temporal identifier, said event identifier comprising one or more identifiers selected from the group comprising: a geographical identifier of said event; and a logical identifier of said event;
wherein said temporal identifier representative of the order of said event in said series of events.
generating a correlator comprising an event identifier and a temporal identifier, said event identifier comprising one or more identifiers selected from the group comprising: a geographical identifier of said event; and a logical identifier of said event;
wherein said temporal identifier representative of the order of said event in said series of events.
2. The method as claimed in claim 1 wherein the step of generating comprises counting each event using one or more sequential counters each responsive to a characteristic of the event and wherein the temporal identifier comprises a count from one or more of the one or more sequential counters.
3. The method as claimed in claim 2 wherein a first characteristic of the event is defined by a process generating the event and wherein one of the sequential counters defines a process sequential counter responsive to the first characteristic to count all of the events of the said process and wherein the temporal identifier comprises a count of the process sequential counter.
4. The method as claimed in claim 3 wherein a second characteristic of the event is defined by a thread of the process generating the event and wherein one of the sequential counters defines a thread sequential counter responsive to the second characteristic to count all of the events of the said thread of the process and wherein they temporal identifier comprises a count of the thread sequential counter.
5. A method for providing a correlator for an event of a series of events occurring on a computer and for which correlators are desired, the method comprising steps of:
determining an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event;
assigning a temporal identifier comprising data representative of the unique temporal order of the event in the series of events;
generating the correlator comprising the event identifier and the temporal identifier for the event.
determining an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event;
assigning a temporal identifier comprising data representative of the unique temporal order of the event in the series of events;
generating the correlator comprising the event identifier and the temporal identifier for the event.
6. The method as claimed in claim 5 wherein the step of assigning comprises counting each event using one or more sequential counters each responsive to a characteristic of the event and wherein the temporal identifier comprises a count from one or more of the one or more sequential counters:
7. The method as claimed in claim 6 wherein a first characteristic of the event is defined by a process generating the event and wherein one of the sequential counters defines a process sequential counter responsive to the first characteristic to count all of the events of the said process and wherein the temporal identifier comprises a count of the process sequential counter.
8. The method as claimed in claim 7 wherein a second characteristic of the event is defined by a thread of the process generating the event and wherein one of the sequential counters defines a thread sequential counter responsive to the second characteristic to count all of the events of the said thread of the process and wherein the temporal identifier comprises a count of the thread sequential counter.
9. The method as claimed in claim 8 wherein a third characteristic of the event is defined by a provider requiring the correlator and wherein the thread sequential counter is further responsive to the third characteristic to count all of the events of the said thread for the said provider.
10. The method as claimed in claim 5 including the step of providing a generic correlator data structure for defining the correlator, the data structure comprising means for defining the event identifier and the temporal identifier; and wherein the step of generating comprises configuring an instance of the data structure.
11. The method as claimed in claim 10 wherein the generic correlator data structure further comprises means for defining optional context information and wherein the method further comprises the steps of:
determining data representative of an instance of the optional context information;
and configuring the instance of the data structure with the data representative of the instance of the optional context information.
determining data representative of an instance of the optional context information;
and configuring the instance of the data structure with the data representative of the instance of the optional context information.
12. The method as claimed in claim 11 wherein the means for defining the optional context data is configured in accordance with a protocol for the exchange of information.
13. The method as claimed in claim 10 wherein the generic correlator data structure further comprises means for defining an association between the correlator for the event and a partner correlator comprising a correlator for a second event and wherein the method further comprises the steps of:
determining data representative of the association with the partner correlator; and configuring the instance of the data structure for the event with the association.
determining data representative of the association with the partner correlator; and configuring the instance of the data structure for the event with the association.
14. The method as claimed in claim 13 including the steps of:
receiving data for defining a partner correlator for the event; and generating an instance of the generic data structure for the partner correlator in accordance with the data received.
receiving data for defining a partner correlator for the event; and generating an instance of the generic data structure for the partner correlator in accordance with the data received.
15. The method as claimed in claim 5 wherein the computer is coupled to one or more other computers in a distributed computer system and wherein the method further includes the step of providing the correlator for transporting to a first one of the other computers for association with a correlator of a second one of the other computers.
16. The method as claimed in claim 5 including the step of providing the correlator for use to identify the event.
17. The method as claimed in claim 5 wherein the event identifier is selected in accordance with a hierarchical convention for identifying events.
18. A computer readable medium containing executable program instructions for providing a correlator for an event of a series of events occurring on a computer and for which correlators are desired, the computer program medium comprising programming instructions for:
determining an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event;
assigning a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive to a characteristic of the event;
generating the correlator comprising the event identifier and the temporal identifier for the event.
determining an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event;
assigning a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive to a characteristic of the event;
generating the correlator comprising the event identifier and the temporal identifier for the event.
19. The computer program product as claimed in claim 18 wherein a first characteristic of the event is defined by a process generating the event and wherein one of the sequential counters defines a process sequential counter responsive to the first characteristic to count all of the events of the said process and wherein the temporal identifier comprises a count of the process sequential counter.
20. The computer program product as claimed in claim 19 wherein a second characteristic of the event is defined by a thread of the process generating the event and wherein one of the sequential counters defines a thread sequential counter responsive to the second characteristic to count all of the events of the said thread of the process and wherein the temporal identifier comprises a count of the thread sequential counter.
21. The computer program product as claimed in claim 20 wherein a third characteristic of the event is defined by a provider requiring the correlator and wherein the thread sequential counter is further responsive to the third characteristic to count all of the events of the said thread for the said provider.
22. The computer program product as claimed in claim 18 further comprising program instructions for:
determining data representative of optional context information for the event;
and generating the correlator with the data representative of the optional context information.
determining data representative of optional context information for the event;
and generating the correlator with the data representative of the optional context information.
23. The computer program product as claimed in claim 22 including program instructions for configuring the data representative of optional context information for the event in accordance with a protocol for the exchange of information.
24. The computer program product as claimed in claim 18 further comprising program instructions for:
defining data representative of an association between the correlator for the event and a partner correlator comprising a correlator for a second event; and generating the correlator with the data representative of the association.
defining data representative of an association between the correlator for the event and a partner correlator comprising a correlator for a second event; and generating the correlator with the data representative of the association.
25. The computer program product as claimed in claim 24 including programming instructions for:
receiving data for defining a partner correlator for the event; and generating the partner correlator in accordance with the data received.
receiving data for defining a partner correlator for the event; and generating the partner correlator in accordance with the data received.
26. The computer program product as claimed in claim 18 wherein said computer is coupled to one or more other computers in a distributed computer system and wherein the computer program product further comprises programming instructions for transporting the correlator to a first one of the other computers for association with a correlator of a second one of the other computers.
27. The computer program product as claimed in claim 18 including the step of providing the correlator for use to identify the event.
28. A correlator for an event in a series of events, said correlator comprising:
an event identifier comprising one or more identifiers selected from the group comprising: a geographical identifier of said event; and a logical identifier of said event; and a temporal identifier representative of the order of said event in said series of events.
an event identifier comprising one or more identifiers selected from the group comprising: a geographical identifier of said event; and a logical identifier of said event; and a temporal identifier representative of the order of said event in said series of events.
29. The correlator as claimed in claim 28 further comprising an association to a second correlator defining a partner correlator.
30. A data structure stored on a computer readable medium representing a correlator, said data structure comprising:
a field for an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event; and a field for a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive a characteristic of the event.
a field for an event identifier comprising data representative of one or more identifiers selected from the group consisting of geographical identifiers and logical identifiers for the event; and a field for a temporal identifier comprising data representative of the unique temporal order of the event in the series of events from one or more sequential counters each responsive a characteristic of the event.
31. The data structure as claimed in claim 30 further comprising a field for optional context information configured in accordance with a protocol for the exchange of information.
32. The data structure as claimed in claim 31 further comprising a field for providing an association to a partner correlator.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA002381737A CA2381737A1 (en) | 2002-04-15 | 2002-04-15 | Framework for managing data that provides correlation information in a distributed computing system |
| US10/285,995 US20030195959A1 (en) | 2002-04-15 | 2002-10-31 | Framework for managing data that provides correlation information in a distributed computing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA002381737A CA2381737A1 (en) | 2002-04-15 | 2002-04-15 | Framework for managing data that provides correlation information in a distributed computing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2381737A1 true CA2381737A1 (en) | 2003-10-15 |
Family
ID=28679858
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002381737A Abandoned CA2381737A1 (en) | 2002-04-15 | 2002-04-15 | Framework for managing data that provides correlation information in a distributed computing system |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US20030195959A1 (en) |
| CA (1) | CA2381737A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7506314B2 (en) | 2003-06-27 | 2009-03-17 | International Business Machines Corporation | Method for automatically collecting trace detail and history data |
| CN108647193A (en) * | 2018-04-20 | 2018-10-12 | 河南中烟工业有限责任公司 | A kind of unique identifier generation method can be applied to distributed system and device |
Families Citing this family (55)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7882253B2 (en) * | 2001-04-05 | 2011-02-01 | Real-Time Innovations, Inc. | Real-time publish-subscribe system |
| US6862698B1 (en) * | 2002-01-22 | 2005-03-01 | Cisco Technology, Inc. | Method of labeling alarms to facilitate correlating alarms in a telecommunications network |
| US7962589B1 (en) | 2002-11-07 | 2011-06-14 | Cisco Technology, Inc. | Method and apparatus for providing notification of network alarms using a plurality of distributed layers |
| US7454761B1 (en) * | 2002-12-20 | 2008-11-18 | Cisco Technology, Inc. | Method and apparatus for correlating output of distributed processes |
| US7437734B2 (en) * | 2003-08-12 | 2008-10-14 | Hewlett-Packard Development Company, L.P. | Propagating web transaction context into common object model (COM) business logic components |
| US7496903B2 (en) * | 2003-08-12 | 2009-02-24 | Hewlett-Packard Development Company, L.P. | Synthesizing application response measurement (ARM) instrumentation |
| US7484209B2 (en) * | 2003-08-12 | 2009-01-27 | Hewlett-Packard Development Company, L.P. | Instrumenting java code by modifying bytecodes |
| US20050039171A1 (en) * | 2003-08-12 | 2005-02-17 | Avakian Arra E. | Using interceptors and out-of-band data to monitor the performance of Java 2 enterprise edition (J2EE) applications |
| US7493622B2 (en) * | 2003-08-12 | 2009-02-17 | Hewlett-Packard Development Company, L.P. | Use of thread-local storage to propagate application context in Java 2 enterprise edition (J2EE) applications |
| US7552433B2 (en) * | 2003-11-12 | 2009-06-23 | Hewlett-Packard Development Company, L.P. | Non-platform-specific unique indentifier generation |
| US7631222B2 (en) * | 2004-08-23 | 2009-12-08 | Cisco Technology, Inc. | Method and apparatus for correlating events in a network |
| US20060136932A1 (en) * | 2004-12-16 | 2006-06-22 | Bose Anuradha A | Monitoring messages in a distributed data processing system |
| US20060184339A1 (en) * | 2005-02-17 | 2006-08-17 | International Business Machines Corporation | Using arm correlators to link log file statements to transaction instances and dynamically adjusting log levels in response to threshold violations |
| US7613808B2 (en) * | 2005-06-22 | 2009-11-03 | International Business Machines Corporation | System and method for enhancing event correlation with exploitation of external data |
| US8122035B2 (en) * | 2005-06-28 | 2012-02-21 | International Business Machines Corporation | Method and system for transactional fingerprinting in a database system |
| US7509669B2 (en) * | 2005-08-31 | 2009-03-24 | Time Warner Cable, Inc. | VOD transaction error correlator |
| US7506354B2 (en) * | 2005-08-31 | 2009-03-17 | Time Warner Cable, Inc. | VOD transaction error correlator |
| US8489700B2 (en) * | 2005-11-30 | 2013-07-16 | International Business Machines Corporation | Analysis of nodal affinity behavior |
| US7774363B2 (en) * | 2005-12-29 | 2010-08-10 | Nextlabs, Inc. | Detecting behavioral patterns and anomalies using information usage data |
| US9081981B2 (en) * | 2005-12-29 | 2015-07-14 | Nextlabs, Inc. | Techniques and system to manage access of information using policies |
| US8671135B1 (en) * | 2006-04-24 | 2014-03-11 | Real-Time Innovations, Inc. | Flexible mechanism for implementing the middleware of a data distribution system over multiple transport networks |
| US7827559B1 (en) | 2006-04-24 | 2010-11-02 | Real-Time Innovations, Inc. | Framework for executing multiple threads and sharing resources in a multithreaded computer programming environment |
| US7783853B1 (en) | 2006-04-24 | 2010-08-24 | Real-Time Innovations, Inc. | Memory usage techniques in middleware of a real-time data distribution system |
| US7908160B2 (en) * | 2006-09-11 | 2011-03-15 | Decision-Zone Inc. | System and method for producing audit trails |
| US8484336B2 (en) * | 2006-11-15 | 2013-07-09 | Cisco Technology, Inc. | Root cause analysis in a communication network |
| US7770183B2 (en) * | 2007-01-30 | 2010-08-03 | Microsoft Corporation | Indirect event stream correlation |
| TWI351849B (en) * | 2007-12-31 | 2011-11-01 | Ind Tech Res Inst | Apparatus and method for transmitting streaming se |
| US8230357B2 (en) * | 2008-12-18 | 2012-07-24 | Microsoft Corporation | Visually processing instance data |
| US8091016B2 (en) * | 2008-12-18 | 2012-01-03 | Microsoft Corporation | Visually manipulating instance collections |
| US8060782B2 (en) * | 2010-03-01 | 2011-11-15 | Microsoft Corporation | Root cause problem identification through event correlation |
| EP2500856A1 (en) | 2011-03-15 | 2012-09-19 | Amadeus S.A.S. | Method and system for providing a session involving a plurality of software applications |
| EP2500848A1 (en) | 2011-03-15 | 2012-09-19 | Amadeus S.A.S. | Method and system for centralized reservation context management on multi-server reservation system |
| ES2454548T3 (en) | 2011-03-15 | 2014-04-10 | Amadeus S.A.S. | Procedure and system to provide a session in a heterogeneous environment |
| EP2541473A1 (en) | 2011-06-27 | 2013-01-02 | Amadeus S.A.S. | Method and system for a pre-shopping reservation system with increased search efficiency |
| US9235620B2 (en) | 2012-08-14 | 2016-01-12 | Amadeus S.A.S. | Updating cached database query results |
| JP5980037B2 (en) * | 2012-08-06 | 2016-08-31 | キヤノン株式会社 | Management system, server, client, and method thereof |
| US10481918B1 (en) * | 2012-09-28 | 2019-11-19 | Emc Corporation | Execution path determination in a distributed environment |
| US9246935B2 (en) | 2013-10-14 | 2016-01-26 | Intuit Inc. | Method and system for dynamic and comprehensive vulnerability management |
| US9313281B1 (en) | 2013-11-13 | 2016-04-12 | Intuit Inc. | Method and system for creating and dynamically deploying resource specific discovery agents for determining the state of a cloud computing environment |
| US9501345B1 (en) * | 2013-12-23 | 2016-11-22 | Intuit Inc. | Method and system for creating enriched log data |
| US9323926B2 (en) | 2013-12-30 | 2016-04-26 | Intuit Inc. | Method and system for intrusion and extrusion detection |
| US9325726B2 (en) | 2014-02-03 | 2016-04-26 | Intuit Inc. | Method and system for virtual asset assisted extrusion and intrusion detection in a cloud computing environment |
| US20150304343A1 (en) | 2014-04-18 | 2015-10-22 | Intuit Inc. | Method and system for providing self-monitoring, self-reporting, and self-repairing virtual assets in a cloud computing environment |
| US10757133B2 (en) | 2014-02-21 | 2020-08-25 | Intuit Inc. | Method and system for creating and deploying virtual assets |
| US9866581B2 (en) | 2014-06-30 | 2018-01-09 | Intuit Inc. | Method and system for secure delivery of information to computing environments |
| US9276945B2 (en) | 2014-04-07 | 2016-03-01 | Intuit Inc. | Method and system for providing security aware applications |
| US9245117B2 (en) | 2014-03-31 | 2016-01-26 | Intuit Inc. | Method and system for comparing different versions of a cloud based application in a production environment using segregated backend systems |
| US11294700B2 (en) | 2014-04-18 | 2022-04-05 | Intuit Inc. | Method and system for enabling self-monitoring virtual assets to correlate external events with characteristic patterns associated with the virtual assets |
| US9374389B2 (en) | 2014-04-25 | 2016-06-21 | Intuit Inc. | Method and system for ensuring an application conforms with security and regulatory controls prior to deployment |
| US9900322B2 (en) | 2014-04-30 | 2018-02-20 | Intuit Inc. | Method and system for providing permissions management |
| US9319415B2 (en) | 2014-04-30 | 2016-04-19 | Intuit Inc. | Method and system for providing reference architecture pattern-based permissions management |
| US9330263B2 (en) | 2014-05-27 | 2016-05-03 | Intuit Inc. | Method and apparatus for automating the building of threat models for the public cloud |
| US9473481B2 (en) | 2014-07-31 | 2016-10-18 | Intuit Inc. | Method and system for providing a virtual asset perimeter |
| US10102082B2 (en) | 2014-07-31 | 2018-10-16 | Intuit Inc. | Method and system for providing automated self-healing virtual assets |
| US10805144B1 (en) * | 2019-06-18 | 2020-10-13 | Cisco Technology, Inc. | Monitoring interactions between entities in a network by an agent for particular types of interactions and indexing and establishing relationships of the components of each interaction |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5253359A (en) * | 1990-06-11 | 1993-10-12 | Supercomputer Systems Limited Partnership | Control and maintenance subsystem network for use with a multiprocessor computer system |
| US5375070A (en) * | 1993-03-01 | 1994-12-20 | International Business Machines Corporation | Information collection architecture and method for a data communications network |
| US5790779A (en) * | 1995-03-10 | 1998-08-04 | Microsoft Corporation | Method and system for consolidating related error reports in a computer system |
| US5740354A (en) * | 1995-11-27 | 1998-04-14 | Microsoft Corporation | Method and system for associating related errors in a computer system |
| US6118936A (en) * | 1996-04-18 | 2000-09-12 | Mci Communications Corporation | Signaling network management system for converting network events into standard form and then correlating the standard form events with topology and maintenance information |
| US5941996A (en) * | 1997-07-25 | 1999-08-24 | Merrill Lynch & Company, Incorporated | Distributed network agents |
| US6336139B1 (en) * | 1998-06-03 | 2002-01-01 | International Business Machines Corporation | System, method and computer program product for event correlation in a distributed computing environment |
| US6185555B1 (en) * | 1998-10-31 | 2001-02-06 | M/A/R/C Inc. | Method and apparatus for data management using an event transition network |
-
2002
- 2002-04-15 CA CA002381737A patent/CA2381737A1/en not_active Abandoned
- 2002-10-31 US US10/285,995 patent/US20030195959A1/en not_active Abandoned
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7506314B2 (en) | 2003-06-27 | 2009-03-17 | International Business Machines Corporation | Method for automatically collecting trace detail and history data |
| US8181161B2 (en) | 2003-06-27 | 2012-05-15 | International Business Machines Corporation | System for automatically collecting trace detail and history data |
| CN108647193A (en) * | 2018-04-20 | 2018-10-12 | 河南中烟工业有限责任公司 | A kind of unique identifier generation method can be applied to distributed system and device |
| CN108647193B (en) * | 2018-04-20 | 2021-11-19 | 河南中烟工业有限责任公司 | Unique identifier generation method and device applicable to distributed system |
Also Published As
| Publication number | Publication date |
|---|---|
| US20030195959A1 (en) | 2003-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20030195959A1 (en) | Framework for managing data that provides correlation information in a distributed computing system | |
| US20040268314A1 (en) | System and method for automatically collecting trace detail and history data | |
| US9632817B2 (en) | Correlating business workflows with transaction tracking | |
| US9342431B2 (en) | Technique to generically manage extensible correlation data | |
| US7565443B2 (en) | Common persistence layer | |
| US10397325B2 (en) | System and method for data payload collection monitoring and analysis in a transaction processing environment | |
| KR101300360B1 (en) | Distributed capture and aggregation of danamic application usage information | |
| US6349333B1 (en) | Platform independent alarm service for manipulating managed objects in a distributed network management system | |
| US8832665B2 (en) | Method and system for tracing individual transactions at the granularity level of method calls throughout distributed heterogeneous applications without source code modifications including the detection of outgoing requests | |
| US8910187B2 (en) | Method and apparatus for non-intrusive web application integration to streamline enterprise business process | |
| US7890809B2 (en) | High level operational support system | |
| US7490331B2 (en) | Mapping to and from native type formats | |
| US20050172306A1 (en) | Systems, methods and computer programs for determining dependencies between logical components in a data processing system or network | |
| EP0998076A1 (en) | Method for controlling a network element from a remote workstation | |
| US20020046301A1 (en) | System and method for integrating disparate networks for use in electronic communication and commerce | |
| CA2350735A1 (en) | A method for providing open access to application profiling data | |
| CA2435666A1 (en) | A method and a bridge for coupling a server and a client of different object types | |
| US10402307B2 (en) | System and method for providing runtime tracing for a web-based client accessing a transactional middleware platform using an extension interface | |
| Mos et al. | Performance monitoring of Java component-oriented distributed applications | |
| JPH11272513A (en) | Trouble shooting device under network computing environment, trouble shooting method and recording medium for recording trouble shooting program | |
| Grundy et al. | An approach to developing web services with aspect-oriented component engineering | |
| Debusmann et al. | Generic performance instrumentation of EJB applications for service-level management | |
| JP2000066980A (en) | Different kind protocol correspondence communication network management system | |
| Perry et al. | MQSeries publish/subscribe applications | |
| Ashford et al. | Designing Management Solutions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued | ||
| FZDE | Discontinued |
Effective date: 20100415 |