US20020133587A1 - System for monitoring telecommunication network and training statistical estimator - Google Patents

System for monitoring telecommunication network and training statistical estimator Download PDF

Info

Publication number
US20020133587A1
US20020133587A1 US10/042,278 US4227802A US2002133587A1 US 20020133587 A1 US20020133587 A1 US 20020133587A1 US 4227802 A US4227802 A US 4227802A US 2002133587 A1 US2002133587 A1 US 2002133587A1
Authority
US
United States
Prior art keywords
devices
determining
activity
communication
services
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/042,278
Inventor
Christian Ensel
Volkmar Sterzing
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Assigned to SIEMENS AKTIENGESELLSCHAFT reassignment SIEMENS AKTIENGESELLSCHAFT ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: STERZING, VOLKMAR, ENSEL, CHRISTIAN
Publication of US20020133587A1 publication Critical patent/US20020133587A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/02Standardisation; Integration
    • H04L41/0213Standardised network management protocols, e.g. simple network management protocol [SNMP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14Network analysis or design
    • H04L41/142Network analysis or design using statistical or mathematical methods
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/16Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using machine learning or artificial intelligence

Definitions

  • the invention relates to a method and a device for the computer-aided monitoring of a telecommunication network and to a method for the computer-aided training of a statistical estimator for monitoring a telecommunication network.
  • a telecommunication network is understood to be a communication network by which different electronic devices can communicate with one another, for example
  • LAN Local Area Network
  • WAN Wide Area Network
  • a radio network for example according to the GSM standard or the UMTS standard.
  • terminals capable of communication such as
  • PDAs personal digital assistants
  • OSI reference model Open System Interconnection reference model of the International Organization for Standardization (ISO)
  • ISO International Organization for Standardization
  • OSI layer 6 the presentation layer (OSI layer 6 ) or the application layer (OSI layer 7 ) of the OSI reference model, at which usually the application programs are implemented, the individual interrelationships between the communication devices or, respectively, the services used are input manually in accordance with the prior art and formulated in accordance with the protocol format used in different languages and forms of representation.
  • OSI layer 6 the presentation layer
  • OSI layer 7 the application layer of the OSI reference model
  • the invention is thus based on the object of monitoring devices capable of communication, and/or services which communicate with one another via a telecommunication network, in an automated manner and in a simpler manner compared with the prior art.
  • the object is achieved by a method for computer-aided monitoring of a telecommunication network formed of devices capable of communication, including determining activity parameters, each describing activity of at least one of a corresponding device and a corresponding service; comparing the activity parameters by a statistical estimator trained with training data and having a normal range of dependence based on dependences determined between the devices; and determining from said comparing whether at least one of the devices and services in the telecommunication network has a communication performance different from the normal range of dependence in accordance with a predetermined criterion
  • activity of a device or of a service is understood to be, for example, the computer utilization of a processor exhibited by the device or which executes the service, or else the communication activity with other devices or services, respectively, via the communication network, that is to say the degree of sending and receiving of data, preferably of digital data which are grouped in data packets.
  • the communication parameters determined are compared by a statistical estimator, trained with training data, with a normal range of dependence determined from the dependences determined between the devices, and, from the comparison, a determination is made as to whether the communication performance of one or more devices or services, which are connected to the telecommunication network, differs from their normal performance, that is to say from their undisturbed performance in accordance with a predetermined criterion, for example by a predetermined range of tolerances.
  • activity parameters in the text which follows, that is to say the communication parameters or, respectively, the computer utilization of the devices or services, possible dependences between the devices or services with respect to their communication with one another are determined and, from the dependences determined, a normal range of dependence is determined by which dependences between the devices or services essential without disturbance of the devices or services and without attempted attacks of a device or by a device or, respectively, of a service or by a service, are described.
  • the statistical estimator is trained with the usual performance of the devices or services, that is to say with the normal range of dependence.
  • a device for the computer-aided monitoring of a telecommunication network formed of a multiplicity of devices capable of communication has a processor for performing both the method for monitoring and the method for training the statistical estimator for monitoring the devices capable of communication which are coupled to the telecommunication network.
  • the invention makes it possible for the first time to monitor a multiplicity of the most varied devices or services with regard to their failures or with respect to possible attempted attacks at the level of the application layer or of the presentation layer of the OSI reference model even though the individual devices or services coupled to the telecommunication network operate very inhomogeneously, that is to say by the most varied protocols in different layers of the OSI reference model.
  • the automated monitoring is considerably improved and made more efficient particularly by an analysis, based on statistical methods, of large volumes of data produced with regard to a possible cause of an error or, respectively, a possible attempted attack.
  • At least some of the devices can be constructed as terminals capable of communication.
  • the activity parameters can be determined within a predetermined time interval which can be the same or different for all or at least some of the devices in the communication network.
  • the activity parameters are determined by the respective device itself and the activity parameters determined are transmitted to a central administration unit in which the further method steps are carried out.
  • the activity parameters determined are stored by using a network management protocol, for example by the Simple Network Management Protocol (SNMP) in a Management Information Base (MIB) and, correspondingly, the activity parameters are interrogated from the MIB by the administration unit in accordance with the SNMP protocol and are transmitted to the administration unit.
  • SNMP Simple Network Management Protocol
  • MIB Management Information Base
  • the activity parameters are determined by an activity parameter determining unit outside the respective device, that is to say, for example, by a switching unit which determines different communication parameters at an external interface of the respective device.
  • the activity parameters are, for example, the number of data packets transmitted or received by the respective device
  • the number of data packets determined by the switching unit directly coupled to the respective device is used as communication parameter.
  • the dependences can be communication-related dependences between the devices or services which, according to one embodiment of the invention, can have a directional dependence with regard to the direction of communication between the individual devices or services, respectively.
  • a directional dependence is understood to mean, for example, that a distinction is made as to whether a device or a service is transmitting or receiving a message or a data packet.
  • the data determined directly from the communication data can be subjected to preprocessing of different types, for example filtering or a statistical preanalysis, and, from the preprocessed data, the communication parameters can be determined which are used directly for the monitoring.
  • the preprocessing achieves a further increase in efficiency of the monitoring.
  • paired dependences can be determined for in each case one pair of devices or one pair of services, that is to say the activity parameters can be determined in each case for all possible combinations of two devices or services coupled to one another in the telecommunication network, in particular for the communication-related dependence between the devices.
  • the activity parameters determined for the device pairs or service pairs are stored in the form of a matrix and that the normal range of dependence is determined from the structure of the matrix determined.
  • a structural dependence is determined between the individual rows or columns of a matrix in which the respective dependences are specified, that is to say, for example, the communication between the individual devices or services which in each case represent a row or a column, respectively, of the matrix.
  • the structure of the matrix formed is “learnt” by the statistical estimator and, during the application phase, an essentially graphical and thus very simple structural monitoring is effected by the statistical estimator during the monitoring of the respective devices.
  • the activity parameters can be, for example, one of the following parameters:
  • the number of predetermined system function calls for example of operating system functions of the operating system which uses the respective device capable of communication or which performs the respective service,
  • the statistical estimator used can be, for example, a basically arbitrary neural model, that is to say a neural network, or else a neuro-fuzzy model, which is trained by known training methods and possibly additionally by so-called pruning methods.
  • an alarm signal is generated and displayed to a user of the monitoring system, for example as an audio signal or else as a graphical alarm signal on a screen.
  • the administrator of a telecommunication network is provided in an automated manner with a warning that, with a correspondingly high probability, there is a device or service in the telecommunication network which is disturbed or even has failed or which is starting an attempted attack on another device or on another service or which itself is being attacked by an unauthorized access attempt.
  • the training of the statistical estimator can take place both off-line or also additionally or alternatively on-line, that is to say during the application phase, during which the telecommunication network is already being monitored.
  • the statistical estimator is also provided to construct the statistical estimator as one or more pulsed neurons which are coupled to one another.
  • the invention can be used both for determining a defect by a device or service in the telecommunication network and/or for determining an unauthorized attempt at accessing to or by a device/service in the telecommunication network.
  • the invention can be implemented by a special electronic circuit, i.e. in hardware, and by a computer program, i.e. in software.
  • FIG. 1 graphic schematic of a telecommunication network according to an exemplary embodiment of the invention
  • FIG. 2 is a block diagram of a neural model which represents the dependence of the activity parameters between two devices capable of communication according to an exemplary embodiment of the invention
  • FIG. 3 is a graphic representation of a comparison of two matrices indicating dependences of the activity parameters between respective devices in a telecommunication network
  • FIG. 4 is a flowchart of a method according to an exemplary embodiment of the invention.
  • FIG. 1 shows a telecommunication network 100 with a multiplicity of devices capable of communication such as personal computers 101 , 102 , 103 , 104 , terminals 105 , 106 , 107 , laptops 108 , 109 , a workstation 110 , a firewall computer 111 and a central computer 112 , which are coupled to one another and to a central administration computer 113 via the telecommunication network 100 .
  • devices capable of communication
  • the terminals 105 , 106 , 107 are coupled to the central computer 112 via lines 114 and to the central administration computer 113 via a local area network 115 .
  • the personal computers 101 , 102 , 103 , 104 , the laptops 108 , 109 and the workstation 110 are coupled to the central administration computer 113 by communication links 116 and using the Internet protocol via the firewall computer 111 .
  • the devices capable of communication and coupled to one another by the telecommunication network 113 are monitored in accordance with the method described in the text which follows, by the central administration computer 113 as the central administration unit.
  • step 401 the individual communication parameters for the respective devices capable of communication are determined in a first step (step 401 ) as shown in the flowchart 400 in FIG. 4.
  • the following quantities, describing the activity of the respective devices in the telecommunication network 100 are determined as activity parameters with regard to the data traffic between in each case one pair of devices, that is to say in each case two devices within the telecommunication network 100 .
  • the following communication parameters are in each case determined in the manner described above, on the basis of a number of data packets received from the respective device, that is to say arriving at the respective device, in each case within a 5-second interval by using different pretransformations, that is to say data packets subjected to a corresponding preprocessing of the communication parameters:
  • x is the respective number of received data packets of the first device at the time correspondingly taken into consideration
  • y is the respective number of received data packets of the second device at the time correspondingly taken into consideration
  • ⁇ overscore (x) ⁇ , ⁇ overscore (y) ⁇ in each case designates the sliding mean of the last n values (t ⁇ n+1) up to the time t of the first or, respectively, second device.
  • a training data item is determined in each case for one training interval and supplied to the neural network 200 , shown in FIG. 2, for training it.
  • the neural network 200 has an input layer 201 with ten input neurons which are coupled via in each case a one-to-one link as identity map to a preprocessing layer 202 which also has ten neurons.
  • one neuron of the preprocessing layer 202 is coupled to one neuron of the input layer 202 .
  • a local modeling layer 203 described, for example, in G. B. Orr, “Neural Networks: Tricks of the Trade”, Lecture Notes in Computer Science, Vol. 1524, K. R. Müller (ed.), published in 1998 in Berlin by Springer, is coupled to the neurons of the preprocessing layer 202 .
  • a hidden layer 204 with a basically arbitrary number of neurons is coupled both to the neurons of the preprocessing layer 202 and to the neurons of the local modeling layer 203 . Furthermore, the hidden layer 204 is coupled via the outputs of its neurons to neurons of an output layer 205 which generate output values 206 .
  • the neural arrangement 200 is trained in the usual manner, for example by a back-propagation training method, using a pruning method as described, for example, by Orr.
  • one neural network 200 of the structure shown in FIG. 2 is provided for each pair of devices of the devices contained in the telecommunication network 100 and the neural network 200 is correspondingly trained for this pair of devices in the manner described above.
  • the neural network 200 thus makes it possible to model both local relationships and global relationships of the communication performance of the respective pair of devices.
  • the neural network 200 trained in accordance with the method described above is copied and thus provides an output for each pair of devices when the input data are applied.
  • a number of different, specialized neural networks can also be used.
  • the method described above can thus be performed for each pair of devices of the devices in the telecommunication network as shown in step 402 of the flowchart 400 .
  • a separate neural network can be trained in each case for different combinations of device types in order to increase the accuracy.
  • step 402 is then a number of ( m - 1 ) 2 2
  • an output structure is determined and stored, for example, in the form of a matrix 300 as shown in FIG. 3.
  • FIG. 3 shows in a matrix 300 in each case in a column 301 or, respectively, a row 302 of the matrix 300 which in each case represents a device in the telecommunication network 100 , in each case one field, the degree of dependence of the network traffic, that is to say of the incoming data packets due to the trained neural networks 200 which in each case specify the dependence of the data traffic between the individual pairs of devices.
  • the fields can be described both via a graphical representation and via a predeterminable numerical value which represents the degree of dependence of the data traffic.
  • training map 303 This results in a graphical structure of dependence which will be called training map 303 in the further text.
  • a second neural model a neuro-fuzzy model according to the exemplary embodiment, is then used for learning, by known training methods, the training map 303 determined from the training data from the training phase, which describes the dependences from the training phase.
  • an application map 304 is determined in the same manner described above as the training map 303 has been determined during the training method.
  • step 404 The pattern resulting in the application phase as the application map 304 is compared with the training map 303 by the neuro-fuzzy model in a further step (step 404 ).
  • an alarm signal is generated (step 405 ) to indicate that a noticeable network activity has been determined at at least one device or service in the telecommunication network 100 on the basis of a difference in the map structure of the application map 304 compared with the training map 303 .
  • the monitoring method is carried out in a new application phase (step 403 ) in a repeated determination of an application map 304 .
  • the method is carried out until it is either terminated by the user of the network administration system, that is to say the user of the central administration unit 113 or until the alarm signal has been generated (step 405 ).

Abstract

Activity parameters which describe the activity of the respective device are determined of at least some of the devices and/or services. The communication parameters determined are compared with a normal range of dependence determined from dependences determined between the devices by a trained statistical estimator, and it is determined whether the communication performance of the devices meets a predetermined criterion.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is based on and hereby claims priority to German Patent Application No. 10101286.1 filed on Jan. 12, 2001, the contents of which are hereby incorporated by reference. [0001]
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • The invention relates to a method and a device for the computer-aided monitoring of a telecommunication network and to a method for the computer-aided training of a statistical estimator for monitoring a telecommunication network. [0003]
  • 2. Description of the Related Art [0004]
  • In a conventional telecommunication network, for example the Internet, a multiplicity of quite different devices capable of communication are networked, that is to say coupled to one another. [0005]
  • In this connection, a telecommunication network is understood to be a communication network by which different electronic devices can communicate with one another, for example [0006]
  • a communication network which provides for communication according to the Internet protocols, [0007]
  • a Local Area Network (LAN), [0008]
  • a public communication network, which is also called Wide Area Network (WAN), [0009]
  • a radio network, for example according to the GSM standard or the UMTS standard. [0010]
  • In such an inhomogeneous communication network, that is to say in a communication network having a great number of different electronic devices which are not based on the same operating system, communication mechanism, etc., there is frequently a requirement for administering and/or monitoring these devices jointly, for example with regard to a failure of one of the devices coupled to one another in the communication network or with regard to different penetration attempts or attempted attacks which represent an unauthorized penetration into the stored data of such a device. [0011]
  • Due to the multiplicity of different types of devices coupled to one another by the communication network, for example [0012]
  • switching units [0013]
  • terminals capable of communication such as [0014]
  • printers, [0015]
  • server computers, [0016]
  • workstations, [0017]
  • personal computers, [0018]
  • laptops, [0019]
  • personal digital assistants (PDAs), etc., [0020]
  • and due to the complexity of the different types of communication links between the individual devices which can be based on different communication standards, i.e. communication protocols, it is at present possible to administer and to monitor devices in a telecommunication network centrally and in an automated manner to only a very restricted extent. [0021]
  • Furthermore, there is frequently a requirement for administering and/or monitoring not only the devices themselves but also services, that is to say, in the sense of the further description, for example, application programs in a state of execution such as, for example, a web server, a file server, databases, various application servers or X11 terminals which also communicate with one another via the telecommunication network. [0022]
  • Due to an inadequate automated central monitoring capability at present, it is possible to detect a failure or an attempted attack on a device and/or a service, and to respond in time to such a failure or attempted attack, only with difficulty, if at all. [0023]
  • Furthermore, a failure or an attempted attack on a device or a service frequently generates a very large number of error messages which can be detected and analyzed with regard to the underlying cause of the error or cause of the attack only with difficulty. [0024]
  • In currently known management tools for eliminating disturbances in the communication network, there is no systematic monitoring of the telecommunication network with regard to noticeable or questionable activities with regard to security of components in the telecommunication network which is based on an overview of the communication network. [0025]
  • Furthermore, at the OSI layer [0026] 2 and OSI layer 3 level in the Open System Interconnection reference model (OSI reference model) of the International Organization for Standardization (ISO), there are capabilities for detecting the topology and the structure of interconnected communication devices in a telecommunication network, which capabilities are restricted to different communication protocols.
  • However, this detection, which is basically restricted to existing structures, does not allow any conclusions with regard to actual relations between the individual devices in the telecommunication network in the sense of the active performance of the individual devices and/or the services used and their utilization. [0027]
  • Neither is it possible to extract these relations automatically to a sufficiently large extent in accordance with the known communication protocols. [0028]
  • At the level of higher OSI layers, for example the presentation layer (OSI layer [0029] 6) or the application layer (OSI layer 7) of the OSI reference model, at which usually the application programs are implemented, the individual interrelationships between the communication devices or, respectively, the services used are input manually in accordance with the prior art and formulated in accordance with the protocol format used in different languages and forms of representation.
  • However, this procedure is not suitable for use in a real, relatively large telecommunication network due to the lack of a uniform general description of the structure of the telecommunication network. [0030]
  • It is particularly in the case of an increased number of devices and/or services which communicate with one another via the telecommunication network that manual monitoring of the individual devices or services in the telecommunication network is no longer practicable or, respectively, no longer possible at all. [0031]
  • SUMMARY OF THE INVENTION
  • The invention is thus based on the object of monitoring devices capable of communication, and/or services which communicate with one another via a telecommunication network, in an automated manner and in a simpler manner compared with the prior art. [0032]
  • The object is achieved by a method for computer-aided monitoring of a telecommunication network formed of devices capable of communication, including determining activity parameters, each describing activity of at least one of a corresponding device and a corresponding service; comparing the activity parameters by a statistical estimator trained with training data and having a normal range of dependence based on dependences determined between the devices; and determining from said comparing whether at least one of the devices and services in the telecommunication network has a communication performance different from the normal range of dependence in accordance with a predetermined criterion [0033]
  • In a method for the computer-aided monitoring of a telecommunication network which has a multiplicity of devices capable of communication and/or services, at least some of the devices or services, respectively, determine communication parameters which describe the activity of the respective device or service, respectively. [0034]
  • In this connection, activity of a device or of a service, respectively, is understood to be, for example, the computer utilization of a processor exhibited by the device or which executes the service, or else the communication activity with other devices or services, respectively, via the communication network, that is to say the degree of sending and receiving of data, preferably of digital data which are grouped in data packets. [0035]
  • The communication parameters determined are compared by a statistical estimator, trained with training data, with a normal range of dependence determined from the dependences determined between the devices, and, from the comparison, a determination is made as to whether the communication performance of one or more devices or services, which are connected to the telecommunication network, differs from their normal performance, that is to say from their undisturbed performance in accordance with a predetermined criterion, for example by a predetermined range of tolerances. [0036]
  • In other words, this means that a determination is made as to whether one or more devices or services differ in a predetermined manner in their performance with regard to a predetermined comparison criterion compared with the normal range of dependence previously determined. [0037]
  • In a method for the computer-aided training of a computer-aided estimator which is used for monitoring a telecommunication network formed of a multiplicity of devices capable of communication and/or services, communication parameters which describe the activity of the respective device or service are determined by at least some of the devices and/or services. [0038]
  • From the activity data, also called activity parameters in the text which follows, that is to say the communication parameters or, respectively, the computer utilization of the devices or services, possible dependences between the devices or services with respect to their communication with one another are determined and, from the dependences determined, a normal range of dependence is determined by which dependences between the devices or services essential without disturbance of the devices or services and without attempted attacks of a device or by a device or, respectively, of a service or by a service, are described. [0039]
  • The statistical estimator is trained with the usual performance of the devices or services, that is to say with the normal range of dependence. [0040]
  • A device for the computer-aided monitoring of a telecommunication network formed of a multiplicity of devices capable of communication has a processor for performing both the method for monitoring and the method for training the statistical estimator for monitoring the devices capable of communication which are coupled to the telecommunication network. [0041]
  • Furthermore, computer programs for the computer-aided monitoring of a telecommunication network and for training a statistical estimator for monitoring a telecommunication network which, when they are executed by a processor, have the method steps, described above, of the corresponding methods, are stored in computer-readable storage media. [0042]
  • Furthermore, computer program elements for the computer-aided monitoring of the telecommunication network and for the computer-aided training of a statistical estimator for monitoring a telecommunication network have the method steps, described above, of the corresponding methods when they are executed by a processor. [0043]
  • The invention makes it possible for the first time to monitor a multiplicity of the most varied devices or services with regard to their failures or with respect to possible attempted attacks at the level of the application layer or of the presentation layer of the OSI reference model even though the individual devices or services coupled to the telecommunication network operate very inhomogeneously, that is to say by the most varied protocols in different layers of the OSI reference model. [0044]
  • A further considerable advantage of the invention can be seen in the fact that the dependences of the individual devices on one another can also be taken into consideration in an automated manner, even in pairs according to one embodiment of the invention, and can thus be included in the automated monitoring. [0045]
  • This makes it possible to perform the monitoring of devices and services very efficiently automatically and thus inexpensively. [0046]
  • Furthermore, the automated monitoring is considerably improved and made more efficient particularly by an analysis, based on statistical methods, of large volumes of data produced with regard to a possible cause of an error or, respectively, a possible attempted attack. [0047]
  • At least some of the devices can be constructed as terminals capable of communication. [0048]
  • The activity parameters can be determined within a predetermined time interval which can be the same or different for all or at least some of the devices in the communication network. [0049]
  • This also makes it possible to change the performance of the individual devices or services in time, particularly with regard to the communication activity of the individual devices or services, which further improves the accuracy of the monitoring. [0050]
  • According to a further embodiment of the invention, it is provided that the activity parameters are determined by the respective device itself and the activity parameters determined are transmitted to a central administration unit in which the further method steps are carried out. [0051]
  • According to a further development of the invention, for example, it is provided that the activity parameters determined are stored by using a network management protocol, for example by the Simple Network Management Protocol (SNMP) in a Management Information Base (MIB) and, correspondingly, the activity parameters are interrogated from the MIB by the administration unit in accordance with the SNMP protocol and are transmitted to the administration unit. [0052]
  • According to an alternative embodiment of the invention, it is provided that the activity parameters are determined by an activity parameter determining unit outside the respective device, that is to say, for example, by a switching unit which determines different communication parameters at an external interface of the respective device. [0053]
  • In the case where the activity parameters are, for example, the number of data packets transmitted or received by the respective device, the number of data packets determined by the switching unit directly coupled to the respective device is used as communication parameter. [0054]
  • The dependences can be communication-related dependences between the devices or services which, according to one embodiment of the invention, can have a directional dependence with regard to the direction of communication between the individual devices or services, respectively. [0055]
  • A directional dependence is understood to mean, for example, that a distinction is made as to whether a device or a service is transmitting or receiving a message or a data packet. [0056]
  • This further development further improves the accuracy of the monitoring of the devices or services in the telecommunication network since an additional parameter, namely the directional dependence information, is taken into consideration. [0057]
  • The data determined directly from the communication data can be subjected to preprocessing of different types, for example filtering or a statistical preanalysis, and, from the preprocessed data, the communication parameters can be determined which are used directly for the monitoring. [0058]
  • The preprocessing achieves a further increase in efficiency of the monitoring. [0059]
  • In each case, paired dependences can be determined for in each case one pair of devices or one pair of services, that is to say the activity parameters can be determined in each case for all possible combinations of two devices or services coupled to one another in the telecommunication network, in particular for the communication-related dependence between the devices. [0060]
  • This makes it possible to consider the dependences in pairs and thus further simplifies the determination of possible causes of error. [0061]
  • According to a further embodiment of the invention, it is provided that the activity parameters determined for the device pairs or service pairs are stored in the form of a matrix and that the normal range of dependence is determined from the structure of the matrix determined. [0062]
  • Thus, a structural dependence is determined between the individual rows or columns of a matrix in which the respective dependences are specified, that is to say, for example, the communication between the individual devices or services which in each case represent a row or a column, respectively, of the matrix. [0063]
  • The structure of the matrix formed is “learnt” by the statistical estimator and, during the application phase, an essentially graphical and thus very simple structural monitoring is effected by the statistical estimator during the monitoring of the respective devices. [0064]
  • The activity parameters can be, for example, one of the following parameters: [0065]
  • a number of the data packets sent by the respective device or service or of the data packets received by the respective device or service, [0066]
  • the processor utilization of the respective device, [0067]
  • the number of predetermined system function calls, for example of operating system functions of the operating system which uses the respective device capable of communication or which performs the respective service, [0068]
  • the existence of predetermined processes or of predetermined computer programs during the period during which the communication parameters for the respective device or the respective service are determined. [0069]
  • The statistical estimator used can be, for example, a basically arbitrary neural model, that is to say a neural network, or else a neuro-fuzzy model, which is trained by known training methods and possibly additionally by so-called pruning methods. [0070]
  • In the case where the performance of at least one device or service in the telecommunication network differs to a predefined extent from the criterion with regard to the normal range of dependence, an alarm signal is generated and displayed to a user of the monitoring system, for example as an audio signal or else as a graphical alarm signal on a screen. [0071]
  • In this manner, the administrator of a telecommunication network is provided in an automated manner with a warning that, with a correspondingly high probability, there is a device or service in the telecommunication network which is disturbed or even has failed or which is starting an attempted attack on another device or on another service or which itself is being attacked by an unauthorized access attempt. [0072]
  • In this connection it should be noted that the training of the statistical estimator can take place both off-line or also additionally or alternatively on-line, that is to say during the application phase, during which the telecommunication network is already being monitored. [0073]
  • According to an alternative embodiment, it is also provided to construct the statistical estimator as one or more pulsed neurons which are coupled to one another. [0074]
  • Thus, the invention can be used both for determining a defect by a device or service in the telecommunication network and/or for determining an unauthorized attempt at accessing to or by a device/service in the telecommunication network. [0075]
  • The embodiments of the invention shown above relate both to the methods, the devices and the computer-readable storage media and the computer program elements. [0076]
  • The invention can be implemented by a special electronic circuit, i.e. in hardware, and by a computer program, i.e. in software.[0077]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Further significant and advantageous features of the invention emerge from the description of an exemplary embodiment, using the drawings, wherein: [0078]
  • FIG. 1 graphic schematic of a telecommunication network according to an exemplary embodiment of the invention; [0079]
  • FIG. 2 is a block diagram of a neural model which represents the dependence of the activity parameters between two devices capable of communication according to an exemplary embodiment of the invention; [0080]
  • FIG. 3 is a graphic representation of a comparison of two matrices indicating dependences of the activity parameters between respective devices in a telecommunication network; [0081]
  • FIG. 4 is a flowchart of a method according to an exemplary embodiment of the invention. [0082]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • FIG. 1 shows a [0083] telecommunication network 100 with a multiplicity of devices capable of communication such as personal computers 101, 102, 103, 104, terminals 105, 106, 107, laptops 108, 109, a workstation 110, a firewall computer 111 and a central computer 112, which are coupled to one another and to a central administration computer 113 via the telecommunication network 100.
  • The [0084] terminals 105, 106, 107 are coupled to the central computer 112 via lines 114 and to the central administration computer 113 via a local area network 115.
  • Furthermore, the [0085] personal computers 101, 102, 103, 104, the laptops 108, 109 and the workstation 110 are coupled to the central administration computer 113 by communication links 116 and using the Internet protocol via the firewall computer 111.
  • The devices capable of communication and coupled to one another by the [0086] telecommunication network 113 are monitored in accordance with the method described in the text which follows, by the central administration computer 113 as the central administration unit.
  • As explained in detail in the text which follows, the individual communication parameters for the respective devices capable of communication are determined in a first step (step [0087] 401) as shown in the flowchart 400 in FIG. 4.
  • According to the exemplary embodiment, the following quantities, describing the activity of the respective devices in the [0088] telecommunication network 100, are determined as activity parameters with regard to the data traffic between in each case one pair of devices, that is to say in each case two devices within the telecommunication network 100.
  • In a training phase, in each case only data for the traffic between two devices are selected and various predetermined application programs, for example typical application programs such as a web server program or an X application are started and executed, all remaining devices in the [0089] telecommunication network 100 being switched off or the data for the traffic between the two specific devices being able to be isolated, for example by the IP (Internet Protocol) addresses.
  • Thus, in a digital data exchange, only the communication generated directly due to the applications executed or the services performed, or, respectively, the utilization of the respective device, and possibly a data traffic, that is to say a communication between the two selected devices, is in each case described, by way of an illustration, by the number of data packets transmitted or received, respectively, in accordance with the UDP protocol within a predetermined time interval. [0090]
  • For each application and for each pair of devices, that is to say for all possible combinations of application/devices in the [0091] telecommunication network 100, the following communication parameters are in each case determined in the manner described above, on the basis of a number of data packets received from the respective device, that is to say arriving at the respective device, in each case within a 5-second interval by using different pretransformations, that is to say data packets subjected to a corresponding preprocessing of the communication parameters:
  • the number of data packets, but averaged over a number of 5-second intervals and optionally normalized by a normalization function; [0092]
  • a correlation value of the data packets exchanged between the devices over 30 seconds, that is to say over six 5-second intervals or, respectively, 100 seconds, that is to say over twenty 5-second intervals. [0093]
  • The correlation value Corr(x, y, n) determined is determined in accordance with the following rule: [0094] Corr ( x , y , n ) = i = 0 n - 1 ( x t - i - x _ ) · ( y t - i - y _ ) ( i = 0 n - 1 ( x t - i - x _ ) 2 ) · ( i = 0 n - 1 ( y t - i - y _ ) 2 ) , ( 1 )
    Figure US20020133587A1-20020919-M00001
  • where [0095]
  • n designates the number of values taken into consideration, thus n=6 in the case of 30 seconds and n=20 in the case of 100 seconds, [0096]
  • x is the respective number of received data packets of the first device at the time correspondingly taken into consideration, [0097]
  • y is the respective number of received data packets of the second device at the time correspondingly taken into consideration, [0098]
  • {overscore (x)}, {overscore (y)} in each case designates the sliding mean of the last n values (t−n+1) up to the time t of the first or, respectively, second device. [0099]
  • the absolute value of the difference of the in each case incoming packets of the first device of the pair of devices and of the second device of the pair of devices which is in each case being considered; [0100]
  • the minimum value of the number of data packets arriving at one of the two devices of the pair of devices during in each case one 5-second interval. [0101]
  • Using the communication parameters determined, which are determined for a multiplicity of training intervals, a training data item is determined in each case for one training interval and supplied to the [0102] neural network 200, shown in FIG. 2, for training it.
  • The [0103] neural network 200 has an input layer 201 with ten input neurons which are coupled via in each case a one-to-one link as identity map to a preprocessing layer 202 which also has ten neurons.
  • In each case, one neuron of the [0104] preprocessing layer 202 is coupled to one neuron of the input layer 202.
  • Furthermore, a [0105] local modeling layer 203, described, for example, in G. B. Orr, “Neural Networks: Tricks of the Trade”, Lecture Notes in Computer Science, Vol. 1524, K. R. Müller (ed.), published in 1998 in Berlin by Springer, is coupled to the neurons of the preprocessing layer 202.
  • A hidden [0106] layer 204 with a basically arbitrary number of neurons is coupled both to the neurons of the preprocessing layer 202 and to the neurons of the local modeling layer 203. Furthermore, the hidden layer 204 is coupled via the outputs of its neurons to neurons of an output layer 205 which generate output values 206.
  • The [0107] neural arrangement 200 is trained in the usual manner, for example by a back-propagation training method, using a pruning method as described, for example, by Orr.
  • In each case, one [0108] neural network 200 of the structure shown in FIG. 2 is provided for each pair of devices of the devices contained in the telecommunication network 100 and the neural network 200 is correspondingly trained for this pair of devices in the manner described above.
  • The [0109] neural network 200 thus makes it possible to model both local relationships and global relationships of the communication performance of the respective pair of devices.
  • If m devices are coupled to one another via the [0110] telecommunication network 100, ( m - 1 ) 2 2
    Figure US20020133587A1-20020919-M00002
  • combinations of data must be collected and supplied to the [0111] neural network 200 for training.
  • The [0112] neural network 200 trained in accordance with the method described above is copied and thus provides an output for each pair of devices when the input data are applied. Naturally, a number of different, specialized neural networks can also be used. The method described above can thus be performed for each pair of devices of the devices in the telecommunication network as shown in step 402 of the flowchart 400.
  • As an alternative, a separate neural network can be trained in each case for different combinations of device types in order to increase the accuracy. [0113]
  • The result of step [0114] 402 is then a number of ( m - 1 ) 2 2
    Figure US20020133587A1-20020919-M00003
  • of equal or different neural networks [0115] 200 (with m different types of devices) which have been trained in the manner described above.
  • On the basis of the output characteristics of these [0116] neural networks 200 for different training data, an output structure is determined and stored, for example, in the form of a matrix 300 as shown in FIG. 3.
  • FIG. 3 shows in a [0117] matrix 300 in each case in a column 301 or, respectively, a row 302 of the matrix 300 which in each case represents a device in the telecommunication network 100, in each case one field, the degree of dependence of the network traffic, that is to say of the incoming data packets due to the trained neural networks 200 which in each case specify the dependence of the data traffic between the individual pairs of devices.
  • The fields can be described both via a graphical representation and via a predeterminable numerical value which represents the degree of dependence of the data traffic. [0118]
  • In FIG. 3, for illustration purposes, a different degree of dependence of the different network activities of the respective pairs of devices is in each case entered by different shading or hatching. [0119]
  • This results in a graphical structure of dependence which will be called [0120] training map 303 in the further text.
  • A second neural model, a neuro-fuzzy model according to the exemplary embodiment, is then used for learning, by known training methods, the [0121] training map 303 determined from the training data from the training phase, which describes the dependences from the training phase.
  • During the application phase, the corresponding activity parameters are continuously determined and an [0122] application map 304 is determined in the same manner described above as the training map 303 has been determined during the training method.
  • Naturally, not every device is individually examined in each case with another device as a pair of devices in the application phase but in each case the incoming data packets are determined at the respective device for the corresponding time intervals. This is done in each case by using the respective address information in the data packets which can be determined by the transmitter or receiver of the data packet as a result of which the corresponding correlations between the individual pairs of devices are determined in the application phase. [0123]
  • The pattern resulting in the application phase as the [0124] application map 304 is compared with the training map 303 by the neuro-fuzzy model in a further step (step 404).
  • If the [0125] application map 304, according to a predetermined similarity criterion, differs more than a predetermined threshold value which can have a tolerance range, an alarm signal is generated (step 405) to indicate that a noticeable network activity has been determined at at least one device or service in the telecommunication network 100 on the basis of a difference in the map structure of the application map 304 compared with the training map 303.
  • Thus, on the basis of this result of the comparison which leads to the alarm signal, it is possible to deduce the failure of one or more devices in the [0126] telecommunication network 100 or that an attempted attack on another device in the telecommunication network 100 is started from one device or that an unauthorized attempt at accessing, that is to say an attempted attack, a device is being undertaken.
  • If no noticeable network activity is determined in the test step [0127] 404, the monitoring method is carried out in a new application phase (step 403) in a repeated determination of an application map 304.
  • The method is carried out until it is either terminated by the user of the network administration system, that is to say the user of the [0128] central administration unit 113 or until the alarm signal has been generated (step 405).

Claims (29)

What is claimed is:
1. A method for computer-aided monitoring of a telecommunication network formed of devices capable of communication, said method comprising:
determining activity parameters, each describing activity of at least one of a corresponding device and a corresponding service;
comparing the activity parameters by a statistical estimator trained with training data and having a normal range of dependence based on dependences determined between the devices; and
determining from said comparing whether at least one of the devices and services in the telecommunication network has a communication performance different from the normal range of dependence in accordance with a predetermined criterion.
2. The method as claimed in claim 1, wherein at least some of the devices are constructed as terminals capable of communication.
3. The method as claimed in claim 1, wherein the activity parameters are determined within a predetermined time interval.
4. The method as claimed in claim 1,
wherein said determining of each activity parameter is performed by the corresponding device, and
wherein said method further comprises transmitting the activity parameters to an administration unit which performs said comparing and determining based on said comparing.
5. The method as claimed in claim 1, wherein said determining of each activity parameter is performed by an activity parameter determining unit separate from the corresponding devices.
6. The method as claimed in claim 1, further comprising determining communication-dependent dependences between at least some of the devices and services.
7. The method as claimed in claim 1, further comprising determining possible directional dependences with regard to directions of communication between at least some of the devices and services.
8. The method as claimed in claim 1,
further comprising determining data of at least some of the devices and services, and
wherein said determining of the activity parameters is based on the data.
9. The method as claimed in claim 1, wherein said determining of the activity parameters uses all possible pairs of the devices and pairs of services.
10. The method as claimed in claim 9, further comprising:
storing the activity parameters determined from the pairs of devices in a matrix; and
determining the normal range of dependence from a structure of the matrix.
11. The method as claimed in claim 1, wherein at least one of the following parameters is determined as one of the activity parameters
data packets sent or received by the at least one of a corresponding device and a corresponding service,
processor utilization of the corresponding device,
a number of predetermined system function calls, and
existence of at least one of predetermined processes and predetermined computer programs.
12. The method as claimed in claim 1, wherein a neuro-fuzzy model is used as the statistical estimator.
13. The method as claimed in claim 1, further comprising generating an alarm signal when at least one device in the telecommunication network differs from the normal range of dependence in accordance with the predetermined criterion.
14. The method as claimed in claim 1, further comprising at least one of
determining a disturbance of one of the devices in the telecommunication network;
determining an unauthorized attempt to access one of the devices; and
determining an unauthorized access attempt by one of the devices.
15. A method for computer-aided training of a statistical estimator for administering a telecommunication network formed of devices capable of communication, said method comprising:
determining activity parameters, each describing activity of at least one of a corresponding device and a corresponding service;
determining possible dependences between the devices and services from the activity parameters; and
determining from the possible dependences a normal range of dependence for at least some of the devices and services in essentially undisturbed states to train the statistical estimator.
16. The method as claimed in claim 15, wherein at least some of the devices are constructed as terminals capable of communication.
17. The method as claimed in claim 15, wherein the activity parameters are determined within a predetermined time interval.
18. The method as claimed in claim 15,
wherein said determining of each activity parameter is performed by the corresponding device, and
wherein said method further comprises transmitting the activity parameters to an administration unit which performs said determining of the possible dependences and the normal range of dependence.
19. The method as claimed in claim 15, wherein said determining of each activity parameter is performed by an activity parameter determining unit separate from the corresponding devices.
20. The method as claimed in claim 15, further comprising determining communication-dependent dependences between at least some of the devices and services.
21. The method as claimed in claim 15, further comprising determining possible directional dependences with regard to directions of communication between at least some of the devices and services.
22. The method as claimed in claim 15,
further comprising determining data of at least some of the devices and services, and
wherein said determining of the activity parameters is based on the data.
23. The method as claimed in claim 15, wherein said determining of the activity parameters uses all possible pairs of the devices and pairs of services.
24. The method as claimed in claim 23,
further comprising storing the activity parameters determined from the pairs of devices in a matrix, and
wherein said determining of the normal range of dependence is based on a structure of the matrix.
25. The method as claimed in claim 15, wherein at least one of the following parameters is determined as one of the activity parameters
data packets sent or received by the at least one of a corresponding device and a corresponding service,
processor utilization of the corresponding device,
a number of predetermined system function calls, and
existence of at least one of predetermined processes and predetermined computer programs.
26. A method as claimed in claim 15, wherein a neuro-fuzzy model is used as the statistical estimator.
27. A device for computer-aided monitoring of a telecommunication network formed of devices capable of communication, comprising:
at least one processor to determine activity parameters, each describing activity of at least one of a corresponding device and a corresponding service, to compare the activity parameters by a statistical estimator trained with training data and having a normal range of dependence based on dependences determined between the devices, and to determine from said comparing whether at least one of the devices and services in the telecommunication network has a communication performance different from the normal range of dependence in accordance with a predetermined criterion.
28. At least one computer-readable storage medium storing at least one computer program for computer-aided monitoring of a telecommunication network formed of devices capable of communication, to control a processor to perform a method comprising:
determining activity parameters, each describing activity of at least one of a corresponding device and a corresponding service;
comparing the activity parameters by a statistical estimator trained with training data and having a normal range of dependence based on dependences determined between the devices; and
determining from said comparing whether at least one of the devices and services in the telecommunication network has a communication performance different from the normal range of dependence in accordance with a predetermined criterion.
28. At least one computer-readable storage medium storing at least one computer program for computer-aided training of a statistical estimator for administering a telecommunication network formed of devices capable of communication, to control a processor to perform a method comprising:
determining activity parameters, each describing activity of at least one of a corresponding device and a corresponding service;
determining possible dependences between the devices and services from the activity parameters; and
determining from the possible dependences a normal range of dependence for at least some of the devices and services in essentially undisturbed states to train the statistical estimator.
US10/042,278 2001-01-12 2002-01-11 System for monitoring telecommunication network and training statistical estimator Abandoned US20020133587A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE10101286 2001-01-12
DE10101286.1 2001-01-12

Publications (1)

Publication Number Publication Date
US20020133587A1 true US20020133587A1 (en) 2002-09-19

Family

ID=7670414

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/042,278 Abandoned US20020133587A1 (en) 2001-01-12 2002-01-11 System for monitoring telecommunication network and training statistical estimator

Country Status (3)

Country Link
US (1) US20020133587A1 (en)
EP (1) EP1223709B1 (en)
DE (1) DE50107821D1 (en)

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070198656A1 (en) * 2006-01-24 2007-08-23 Citrix Systems, Inc. Methods and servers for establishing a connection between a client system and a virtual machine executing in a terminal services session and hosting a requested computing environment
US20090004974A1 (en) * 2007-06-28 2009-01-01 Seppo Pyhalammi System, apparatus and method for associating an anticipated success indication with data delivery
US20100318633A1 (en) * 2009-06-16 2010-12-16 Microsoft Corporation Dynamic Time Weighted Network Identification and Fingerprinting for IP Based Networks Based on Collection
US20110130137A1 (en) * 2009-12-01 2011-06-02 Alcatel-Lucent Usa Inc. Outage Recovery In Wireless Networks
US20140013438A1 (en) * 2011-03-23 2014-01-09 Nec Corporation Permit issuance apparatus and permit issuance method
US9380040B1 (en) * 2013-07-11 2016-06-28 Parallels IP Holdings GmbH Method for downloading preauthorized applications to desktop computer using secure connection
US9477975B2 (en) * 2015-02-03 2016-10-25 Twilio, Inc. System and method for a media intelligence platform
US9491309B2 (en) 2009-10-07 2016-11-08 Twilio, Inc. System and method for running a multi-module telephony application
US9495227B2 (en) 2012-02-10 2016-11-15 Twilio, Inc. System and method for managing concurrent events
US9509782B2 (en) 2014-10-21 2016-11-29 Twilio, Inc. System and method for providing a micro-services communication platform
US9553900B2 (en) 2014-07-07 2017-01-24 Twilio, Inc. System and method for managing conferencing in a distributed communication network
US9553799B2 (en) 2013-11-12 2017-01-24 Twilio, Inc. System and method for client communication in a distributed telephony network
US9578362B1 (en) 2015-12-17 2017-02-21 At&T Intellectual Property I, L.P. Channel change server allocation
US9590849B2 (en) 2010-06-23 2017-03-07 Twilio, Inc. System and method for managing a computing cluster
US9588974B2 (en) 2014-07-07 2017-03-07 Twilio, Inc. Method and system for applying data retention policies in a computing platform
US9591033B2 (en) 2008-04-02 2017-03-07 Twilio, Inc. System and method for processing media requests during telephony sessions
US9596274B2 (en) 2008-04-02 2017-03-14 Twilio, Inc. System and method for processing telephony sessions
US9602586B2 (en) 2012-05-09 2017-03-21 Twilio, Inc. System and method for managing media in a distributed communication network
US9614972B2 (en) 2012-07-24 2017-04-04 Twilio, Inc. Method and system for preventing illicit use of a telephony platform
US9621733B2 (en) 2009-03-02 2017-04-11 Twilio, Inc. Method and system for a multitenancy telephone network
US9628624B2 (en) 2014-03-14 2017-04-18 Twilio, Inc. System and method for a work distribution service
US9648006B2 (en) 2011-05-23 2017-05-09 Twilio, Inc. System and method for communicating with a client application
US9654647B2 (en) 2012-10-15 2017-05-16 Twilio, Inc. System and method for routing communications
US20170236056A1 (en) * 2016-02-12 2017-08-17 Microsoft Technology Licensing, Llc Automated predictive modeling and framework
US9807244B2 (en) 2008-10-01 2017-10-31 Twilio, Inc. Telephony web event system and method
US9811398B2 (en) 2013-09-17 2017-11-07 Twilio, Inc. System and method for tagging and tracking events of an application platform
US9853872B2 (en) 2013-09-17 2017-12-26 Twilio, Inc. System and method for providing communication platform metadata
US9882942B2 (en) 2011-02-04 2018-01-30 Twilio, Inc. Method for processing telephony sessions of a network
US9907010B2 (en) 2014-04-17 2018-02-27 Twilio, Inc. System and method for enabling multi-modal communication
US9942394B2 (en) 2011-09-21 2018-04-10 Twilio, Inc. System and method for determining and communicating presence information
US9948703B2 (en) 2015-05-14 2018-04-17 Twilio, Inc. System and method for signaling through data storage
US9967224B2 (en) 2010-06-25 2018-05-08 Twilio, Inc. System and method for enabling real-time eventing
US9992608B2 (en) 2013-06-19 2018-06-05 Twilio, Inc. System and method for providing a communication endpoint information service
US10033617B2 (en) 2012-10-15 2018-07-24 Twilio, Inc. System and method for triggering on platform usage
US10051011B2 (en) 2013-03-14 2018-08-14 Twilio, Inc. System and method for integrating session initiation protocol communication in a telecommunications platform
US10057734B2 (en) 2013-06-19 2018-08-21 Twilio Inc. System and method for transmitting and receiving media messages
US10063713B2 (en) 2016-05-23 2018-08-28 Twilio Inc. System and method for programmatic device connectivity
US10069773B2 (en) 2013-11-12 2018-09-04 Twilio, Inc. System and method for enabling dynamic multi-modal communication
US10116733B2 (en) 2014-07-07 2018-10-30 Twilio, Inc. System and method for collecting feedback in a multi-tenant communication platform
US10122763B2 (en) 2011-05-23 2018-11-06 Twilio, Inc. System and method for connecting a communication to a client
US10153950B2 (en) 2013-12-19 2018-12-11 Bae Systems Plc Data communications performance monitoring
US10165015B2 (en) 2011-05-23 2018-12-25 Twilio Inc. System and method for real-time communication by using a client application communication protocol
US10212237B2 (en) 2014-07-07 2019-02-19 Twilio, Inc. System and method for managing media and signaling in a communication platform
US10320983B2 (en) 2012-06-19 2019-06-11 Twilio Inc. System and method for queuing a communication session
US10419891B2 (en) 2015-05-14 2019-09-17 Twilio, Inc. System and method for communicating through multiple endpoints
US10601688B2 (en) 2013-12-19 2020-03-24 Bae Systems Plc Method and apparatus for detecting fault conditions in a network
US10659349B2 (en) 2016-02-04 2020-05-19 Twilio Inc. Systems and methods for providing secure network exchanged for a multitenant virtual private cloud
US10686902B2 (en) 2016-05-23 2020-06-16 Twilio Inc. System and method for a multi-channel notification service
US11637934B2 (en) 2010-06-23 2023-04-25 Twilio Inc. System and method for monitoring account usage on a platform

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5974457A (en) * 1993-12-23 1999-10-26 International Business Machines Corporation Intelligent realtime monitoring of data traffic
US6073089A (en) * 1997-10-22 2000-06-06 Baker; Michelle Systems and methods for adaptive profiling, fault detection, and alert generation in a changing environment which is measurable by at least two different measures of state
US6078946A (en) * 1996-09-10 2000-06-20 First World Communications, Inc. System and method for management of connection oriented networks
US6125105A (en) * 1997-06-05 2000-09-26 Nortel Networks Corporation Method and apparatus for forecasting future values of a time series
US6266664B1 (en) * 1997-10-01 2001-07-24 Rulespace, Inc. Method for scanning, analyzing and rating digital information content
US6286047B1 (en) * 1998-09-10 2001-09-04 Hewlett-Packard Company Method and system for automatic discovery of network services
US6321338B1 (en) * 1998-11-09 2001-11-20 Sri International Network surveillance
US6327550B1 (en) * 1998-05-26 2001-12-04 Computer Associates Think, Inc. Method and apparatus for system state monitoring using pattern recognition and neural networks
US6453345B2 (en) * 1996-11-06 2002-09-17 Datadirect Networks, Inc. Network security and surveillance system
US6691067B1 (en) * 1999-04-07 2004-02-10 Bmc Software, Inc. Enterprise management system and method which includes statistical recreation of system resource usage for more accurate monitoring, prediction, and performance workload characterization
US6725263B1 (en) * 2000-03-21 2004-04-20 Level 3 Communications, Inc. Systems and methods for analyzing network traffic
US6839850B1 (en) * 1999-03-04 2005-01-04 Prc, Inc. Method and system for detecting intrusion into and misuse of a data processing system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6483805B1 (en) * 1998-12-28 2002-11-19 Nortel Networks Limited Internet differentiated services service for transaction applications
US6741569B1 (en) * 2000-04-18 2004-05-25 Telchemy, Incorporated Quality of service monitor for multimedia communications system

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5974457A (en) * 1993-12-23 1999-10-26 International Business Machines Corporation Intelligent realtime monitoring of data traffic
US6078946A (en) * 1996-09-10 2000-06-20 First World Communications, Inc. System and method for management of connection oriented networks
US6453345B2 (en) * 1996-11-06 2002-09-17 Datadirect Networks, Inc. Network security and surveillance system
US6125105A (en) * 1997-06-05 2000-09-26 Nortel Networks Corporation Method and apparatus for forecasting future values of a time series
US6266664B1 (en) * 1997-10-01 2001-07-24 Rulespace, Inc. Method for scanning, analyzing and rating digital information content
US6073089A (en) * 1997-10-22 2000-06-06 Baker; Michelle Systems and methods for adaptive profiling, fault detection, and alert generation in a changing environment which is measurable by at least two different measures of state
US6327550B1 (en) * 1998-05-26 2001-12-04 Computer Associates Think, Inc. Method and apparatus for system state monitoring using pattern recognition and neural networks
US6286047B1 (en) * 1998-09-10 2001-09-04 Hewlett-Packard Company Method and system for automatic discovery of network services
US6321338B1 (en) * 1998-11-09 2001-11-20 Sri International Network surveillance
US6839850B1 (en) * 1999-03-04 2005-01-04 Prc, Inc. Method and system for detecting intrusion into and misuse of a data processing system
US6691067B1 (en) * 1999-04-07 2004-02-10 Bmc Software, Inc. Enterprise management system and method which includes statistical recreation of system resource usage for more accurate monitoring, prediction, and performance workload characterization
US6725263B1 (en) * 2000-03-21 2004-04-20 Level 3 Communications, Inc. Systems and methods for analyzing network traffic

Cited By (170)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8341732B2 (en) 2006-01-24 2012-12-25 Citrix Systems, Inc. Methods and systems for selecting a method for execution, by a virtual machine, of an application program
US20070198656A1 (en) * 2006-01-24 2007-08-23 Citrix Systems, Inc. Methods and servers for establishing a connection between a client system and a virtual machine executing in a terminal services session and hosting a requested computing environment
US7949677B2 (en) 2006-01-24 2011-05-24 Citrix Systems, Inc. Methods and systems for providing authorized remote access to a computing environment provided by a virtual machine
US7954150B2 (en) 2006-01-24 2011-05-31 Citrix Systems, Inc. Methods and systems for assigning access control levels in providing access to resources via virtual machines
US8355407B2 (en) 2006-01-24 2013-01-15 Citrix Systems, Inc. Methods and systems for interacting, via a hypermedium page, with a virtual machine executing in a terminal services session
US8010679B2 (en) 2006-01-24 2011-08-30 Citrix Systems, Inc. Methods and systems for providing access to a computing environment provided by a virtual machine executing in a hypervisor executing in a terminal services session
US8051180B2 (en) * 2006-01-24 2011-11-01 Citrix Systems, Inc. Methods and servers for establishing a connection between a client system and a virtual machine executing in a terminal services session and hosting a requested computing environment
US8117314B2 (en) 2006-01-24 2012-02-14 Citrix Systems, Inc. Methods and systems for providing remote access to a computing environment provided by a virtual machine
US8341270B2 (en) 2006-01-24 2012-12-25 Citrix Systems, Inc. Methods and systems for providing access to a computing environment
US20090004974A1 (en) * 2007-06-28 2009-01-01 Seppo Pyhalammi System, apparatus and method for associating an anticipated success indication with data delivery
US8065429B2 (en) * 2007-06-28 2011-11-22 Nokia Corporation System, apparatus and method for associating an anticipated success indication with data delivery
US8285846B2 (en) 2007-06-28 2012-10-09 Nokia Corporation System, apparatus and method for associating an anticipated success indication with data delivery
US10893079B2 (en) 2008-04-02 2021-01-12 Twilio Inc. System and method for processing telephony sessions
US11283843B2 (en) 2008-04-02 2022-03-22 Twilio Inc. System and method for processing telephony sessions
US10560495B2 (en) 2008-04-02 2020-02-11 Twilio Inc. System and method for processing telephony sessions
US10694042B2 (en) 2008-04-02 2020-06-23 Twilio Inc. System and method for processing media requests during telephony sessions
US11611663B2 (en) 2008-04-02 2023-03-21 Twilio Inc. System and method for processing telephony sessions
US11856150B2 (en) 2008-04-02 2023-12-26 Twilio Inc. System and method for processing telephony sessions
US11575795B2 (en) 2008-04-02 2023-02-07 Twilio Inc. System and method for processing telephony sessions
US10893078B2 (en) 2008-04-02 2021-01-12 Twilio Inc. System and method for processing telephony sessions
US10986142B2 (en) 2008-04-02 2021-04-20 Twilio Inc. System and method for processing telephony sessions
US11843722B2 (en) 2008-04-02 2023-12-12 Twilio Inc. System and method for processing telephony sessions
US11831810B2 (en) 2008-04-02 2023-11-28 Twilio Inc. System and method for processing telephony sessions
US9906651B2 (en) 2008-04-02 2018-02-27 Twilio, Inc. System and method for processing media requests during telephony sessions
US11765275B2 (en) 2008-04-02 2023-09-19 Twilio Inc. System and method for processing telephony sessions
US11444985B2 (en) 2008-04-02 2022-09-13 Twilio Inc. System and method for processing telephony sessions
US11722602B2 (en) 2008-04-02 2023-08-08 Twilio Inc. System and method for processing media requests during telephony sessions
US9591033B2 (en) 2008-04-02 2017-03-07 Twilio, Inc. System and method for processing media requests during telephony sessions
US9596274B2 (en) 2008-04-02 2017-03-14 Twilio, Inc. System and method for processing telephony sessions
US9906571B2 (en) 2008-04-02 2018-02-27 Twilio, Inc. System and method for processing telephony sessions
US11706349B2 (en) 2008-04-02 2023-07-18 Twilio Inc. System and method for processing telephony sessions
US9807244B2 (en) 2008-10-01 2017-10-31 Twilio, Inc. Telephony web event system and method
US11665285B2 (en) 2008-10-01 2023-05-30 Twilio Inc. Telephony web event system and method
US11005998B2 (en) 2008-10-01 2021-05-11 Twilio Inc. Telephony web event system and method
US11641427B2 (en) 2008-10-01 2023-05-02 Twilio Inc. Telephony web event system and method
US10455094B2 (en) 2008-10-01 2019-10-22 Twilio Inc. Telephony web event system and method
US10187530B2 (en) 2008-10-01 2019-01-22 Twilio, Inc. Telephony web event system and method
US11632471B2 (en) 2008-10-01 2023-04-18 Twilio Inc. Telephony web event system and method
US9621733B2 (en) 2009-03-02 2017-04-11 Twilio, Inc. Method and system for a multitenancy telephone network
US11240381B2 (en) 2009-03-02 2022-02-01 Twilio Inc. Method and system for a multitenancy telephone network
US10708437B2 (en) 2009-03-02 2020-07-07 Twilio Inc. Method and system for a multitenancy telephone network
US11785145B2 (en) 2009-03-02 2023-10-10 Twilio Inc. Method and system for a multitenancy telephone network
US9894212B2 (en) 2009-03-02 2018-02-13 Twilio, Inc. Method and system for a multitenancy telephone network
US10348908B2 (en) 2009-03-02 2019-07-09 Twilio, Inc. Method and system for a multitenancy telephone network
US20100318633A1 (en) * 2009-06-16 2010-12-16 Microsoft Corporation Dynamic Time Weighted Network Identification and Fingerprinting for IP Based Networks Based on Collection
US10554825B2 (en) 2009-10-07 2020-02-04 Twilio Inc. System and method for running a multi-module telephony application
US11637933B2 (en) 2009-10-07 2023-04-25 Twilio Inc. System and method for running a multi-module telephony application
US9491309B2 (en) 2009-10-07 2016-11-08 Twilio, Inc. System and method for running a multi-module telephony application
US20110130137A1 (en) * 2009-12-01 2011-06-02 Alcatel-Lucent Usa Inc. Outage Recovery In Wireless Networks
US9590849B2 (en) 2010-06-23 2017-03-07 Twilio, Inc. System and method for managing a computing cluster
US11637934B2 (en) 2010-06-23 2023-04-25 Twilio Inc. System and method for monitoring account usage on a platform
US11088984B2 (en) 2010-06-25 2021-08-10 Twilio Ine. System and method for enabling real-time eventing
US11936609B2 (en) 2010-06-25 2024-03-19 Twilio Inc. System and method for enabling real-time eventing
US9967224B2 (en) 2010-06-25 2018-05-08 Twilio, Inc. System and method for enabling real-time eventing
US11848967B2 (en) 2011-02-04 2023-12-19 Twilio Inc. Method for processing telephony sessions of a network
US10230772B2 (en) 2011-02-04 2019-03-12 Twilio, Inc. Method for processing telephony sessions of a network
US11032330B2 (en) 2011-02-04 2021-06-08 Twilio Inc. Method for processing telephony sessions of a network
US9882942B2 (en) 2011-02-04 2018-01-30 Twilio, Inc. Method for processing telephony sessions of a network
US10708317B2 (en) 2011-02-04 2020-07-07 Twilio Inc. Method for processing telephony sessions of a network
CN103534702A (en) * 2011-03-23 2014-01-22 日本电气株式会社 Permit issuance apparatus and permit issuance method
US20140013438A1 (en) * 2011-03-23 2014-01-09 Nec Corporation Permit issuance apparatus and permit issuance method
US9648006B2 (en) 2011-05-23 2017-05-09 Twilio, Inc. System and method for communicating with a client application
US11399044B2 (en) 2011-05-23 2022-07-26 Twilio Inc. System and method for connecting a communication to a client
US10819757B2 (en) 2011-05-23 2020-10-27 Twilio Inc. System and method for real-time communication by using a client application communication protocol
US10560485B2 (en) 2011-05-23 2020-02-11 Twilio Inc. System and method for connecting a communication to a client
US10122763B2 (en) 2011-05-23 2018-11-06 Twilio, Inc. System and method for connecting a communication to a client
US10165015B2 (en) 2011-05-23 2018-12-25 Twilio Inc. System and method for real-time communication by using a client application communication protocol
US9942394B2 (en) 2011-09-21 2018-04-10 Twilio, Inc. System and method for determining and communicating presence information
US10182147B2 (en) 2011-09-21 2019-01-15 Twilio Inc. System and method for determining and communicating presence information
US10841421B2 (en) 2011-09-21 2020-11-17 Twilio Inc. System and method for determining and communicating presence information
US11489961B2 (en) 2011-09-21 2022-11-01 Twilio Inc. System and method for determining and communicating presence information
US10686936B2 (en) 2011-09-21 2020-06-16 Twilio Inc. System and method for determining and communicating presence information
US10212275B2 (en) 2011-09-21 2019-02-19 Twilio, Inc. System and method for determining and communicating presence information
US9495227B2 (en) 2012-02-10 2016-11-15 Twilio, Inc. System and method for managing concurrent events
US11093305B2 (en) 2012-02-10 2021-08-17 Twilio Inc. System and method for managing concurrent events
US10467064B2 (en) 2012-02-10 2019-11-05 Twilio Inc. System and method for managing concurrent events
US10637912B2 (en) 2012-05-09 2020-04-28 Twilio Inc. System and method for managing media in a distributed communication network
US10200458B2 (en) 2012-05-09 2019-02-05 Twilio, Inc. System and method for managing media in a distributed communication network
US11165853B2 (en) 2012-05-09 2021-11-02 Twilio Inc. System and method for managing media in a distributed communication network
US9602586B2 (en) 2012-05-09 2017-03-21 Twilio, Inc. System and method for managing media in a distributed communication network
US10320983B2 (en) 2012-06-19 2019-06-11 Twilio Inc. System and method for queuing a communication session
US11546471B2 (en) 2012-06-19 2023-01-03 Twilio Inc. System and method for queuing a communication session
US10469670B2 (en) 2012-07-24 2019-11-05 Twilio Inc. Method and system for preventing illicit use of a telephony platform
US9614972B2 (en) 2012-07-24 2017-04-04 Twilio, Inc. Method and system for preventing illicit use of a telephony platform
US11063972B2 (en) 2012-07-24 2021-07-13 Twilio Inc. Method and system for preventing illicit use of a telephony platform
US9948788B2 (en) 2012-07-24 2018-04-17 Twilio, Inc. Method and system for preventing illicit use of a telephony platform
US11882139B2 (en) 2012-07-24 2024-01-23 Twilio Inc. Method and system for preventing illicit use of a telephony platform
US11689899B2 (en) 2012-10-15 2023-06-27 Twilio Inc. System and method for triggering on platform usage
US10757546B2 (en) 2012-10-15 2020-08-25 Twilio Inc. System and method for triggering on platform usage
US11246013B2 (en) 2012-10-15 2022-02-08 Twilio Inc. System and method for triggering on platform usage
US10257674B2 (en) 2012-10-15 2019-04-09 Twilio, Inc. System and method for triggering on platform usage
US9654647B2 (en) 2012-10-15 2017-05-16 Twilio, Inc. System and method for routing communications
US10033617B2 (en) 2012-10-15 2018-07-24 Twilio, Inc. System and method for triggering on platform usage
US11595792B2 (en) 2012-10-15 2023-02-28 Twilio Inc. System and method for triggering on platform usage
US10560490B2 (en) 2013-03-14 2020-02-11 Twilio Inc. System and method for integrating session initiation protocol communication in a telecommunications platform
US11032325B2 (en) 2013-03-14 2021-06-08 Twilio Inc. System and method for integrating session initiation protocol communication in a telecommunications platform
US11637876B2 (en) 2013-03-14 2023-04-25 Twilio Inc. System and method for integrating session initiation protocol communication in a telecommunications platform
US10051011B2 (en) 2013-03-14 2018-08-14 Twilio, Inc. System and method for integrating session initiation protocol communication in a telecommunications platform
US9992608B2 (en) 2013-06-19 2018-06-05 Twilio, Inc. System and method for providing a communication endpoint information service
US10057734B2 (en) 2013-06-19 2018-08-21 Twilio Inc. System and method for transmitting and receiving media messages
US9380040B1 (en) * 2013-07-11 2016-06-28 Parallels IP Holdings GmbH Method for downloading preauthorized applications to desktop computer using secure connection
US10211991B1 (en) * 2013-07-11 2019-02-19 Parallels International Gmbh Method for downloading preauthorized applications to desktop computer using secure connection
US11379275B2 (en) 2013-09-17 2022-07-05 Twilio Inc. System and method for tagging and tracking events of an application
US9853872B2 (en) 2013-09-17 2017-12-26 Twilio, Inc. System and method for providing communication platform metadata
US10439907B2 (en) 2013-09-17 2019-10-08 Twilio Inc. System and method for providing communication platform metadata
US11539601B2 (en) 2013-09-17 2022-12-27 Twilio Inc. System and method for providing communication platform metadata
US10671452B2 (en) 2013-09-17 2020-06-02 Twilio Inc. System and method for tagging and tracking events of an application
US9811398B2 (en) 2013-09-17 2017-11-07 Twilio, Inc. System and method for tagging and tracking events of an application platform
US9959151B2 (en) 2013-09-17 2018-05-01 Twilio, Inc. System and method for tagging and tracking events of an application platform
US9553799B2 (en) 2013-11-12 2017-01-24 Twilio, Inc. System and method for client communication in a distributed telephony network
US11394673B2 (en) 2013-11-12 2022-07-19 Twilio Inc. System and method for enabling dynamic multi-modal communication
US10069773B2 (en) 2013-11-12 2018-09-04 Twilio, Inc. System and method for enabling dynamic multi-modal communication
US11621911B2 (en) 2013-11-12 2023-04-04 Twillo Inc. System and method for client communication in a distributed telephony network
US10063461B2 (en) 2013-11-12 2018-08-28 Twilio, Inc. System and method for client communication in a distributed telephony network
US11831415B2 (en) 2013-11-12 2023-11-28 Twilio Inc. System and method for enabling dynamic multi-modal communication
US10686694B2 (en) 2013-11-12 2020-06-16 Twilio Inc. System and method for client communication in a distributed telephony network
US10601688B2 (en) 2013-12-19 2020-03-24 Bae Systems Plc Method and apparatus for detecting fault conditions in a network
US10153950B2 (en) 2013-12-19 2018-12-11 Bae Systems Plc Data communications performance monitoring
US9628624B2 (en) 2014-03-14 2017-04-18 Twilio, Inc. System and method for a work distribution service
US10904389B2 (en) 2014-03-14 2021-01-26 Twilio Inc. System and method for a work distribution service
US10003693B2 (en) 2014-03-14 2018-06-19 Twilio, Inc. System and method for a work distribution service
US10291782B2 (en) 2014-03-14 2019-05-14 Twilio, Inc. System and method for a work distribution service
US11330108B2 (en) 2014-03-14 2022-05-10 Twilio Inc. System and method for a work distribution service
US11882242B2 (en) 2014-03-14 2024-01-23 Twilio Inc. System and method for a work distribution service
US9907010B2 (en) 2014-04-17 2018-02-27 Twilio, Inc. System and method for enabling multi-modal communication
US11653282B2 (en) 2014-04-17 2023-05-16 Twilio Inc. System and method for enabling multi-modal communication
US10873892B2 (en) 2014-04-17 2020-12-22 Twilio Inc. System and method for enabling multi-modal communication
US10440627B2 (en) 2014-04-17 2019-10-08 Twilio Inc. System and method for enabling multi-modal communication
US10747717B2 (en) 2014-07-07 2020-08-18 Twilio Inc. Method and system for applying data retention policies in a computing platform
US9588974B2 (en) 2014-07-07 2017-03-07 Twilio, Inc. Method and system for applying data retention policies in a computing platform
US11755530B2 (en) 2014-07-07 2023-09-12 Twilio Inc. Method and system for applying data retention policies in a computing platform
US10212237B2 (en) 2014-07-07 2019-02-19 Twilio, Inc. System and method for managing media and signaling in a communication platform
US10116733B2 (en) 2014-07-07 2018-10-30 Twilio, Inc. System and method for collecting feedback in a multi-tenant communication platform
US11341092B2 (en) 2014-07-07 2022-05-24 Twilio Inc. Method and system for applying data retention policies in a computing platform
US11768802B2 (en) 2014-07-07 2023-09-26 Twilio Inc. Method and system for applying data retention policies in a computing platform
US10757200B2 (en) 2014-07-07 2020-08-25 Twilio Inc. System and method for managing conferencing in a distributed communication network
US9553900B2 (en) 2014-07-07 2017-01-24 Twilio, Inc. System and method for managing conferencing in a distributed communication network
US10229126B2 (en) 2014-07-07 2019-03-12 Twilio, Inc. Method and system for applying data retention policies in a computing platform
US9858279B2 (en) 2014-07-07 2018-01-02 Twilio, Inc. Method and system for applying data retention policies in a computing platform
US9509782B2 (en) 2014-10-21 2016-11-29 Twilio, Inc. System and method for providing a micro-services communication platform
US10637938B2 (en) 2014-10-21 2020-04-28 Twilio Inc. System and method for providing a micro-services communication platform
US11019159B2 (en) 2014-10-21 2021-05-25 Twilio Inc. System and method for providing a micro-services communication platform
US9906607B2 (en) 2014-10-21 2018-02-27 Twilio, Inc. System and method for providing a micro-services communication platform
US9749428B2 (en) 2014-10-21 2017-08-29 Twilio, Inc. System and method for providing a network discovery service platform
US9477975B2 (en) * 2015-02-03 2016-10-25 Twilio, Inc. System and method for a media intelligence platform
US10853854B2 (en) * 2015-02-03 2020-12-01 Twilio Inc. System and method for a media intelligence platform
US11544752B2 (en) * 2015-02-03 2023-01-03 Twilio Inc. System and method for a media intelligence platform
US20170032433A1 (en) * 2015-02-03 2017-02-02 Twilio, Inc. System and method for a media intelligence platform
US9805399B2 (en) * 2015-02-03 2017-10-31 Twilio, Inc. System and method for a media intelligence platform
US10467665B2 (en) * 2015-02-03 2019-11-05 Twilio Inc. System and method for a media intelligence platform
US9948703B2 (en) 2015-05-14 2018-04-17 Twilio, Inc. System and method for signaling through data storage
US10560516B2 (en) 2015-05-14 2020-02-11 Twilio Inc. System and method for signaling through data storage
US11265367B2 (en) 2015-05-14 2022-03-01 Twilio Inc. System and method for signaling through data storage
US10419891B2 (en) 2015-05-14 2019-09-17 Twilio, Inc. System and method for communicating through multiple endpoints
US11272325B2 (en) 2015-05-14 2022-03-08 Twilio Inc. System and method for communicating through multiple endpoints
US9578362B1 (en) 2015-12-17 2017-02-21 At&T Intellectual Property I, L.P. Channel change server allocation
US10728600B2 (en) 2015-12-17 2020-07-28 At&T Intellectual Property I, L.P. Channel change server allocation
US10045059B2 (en) 2015-12-17 2018-08-07 At&T Intellectual Property I, L.P. Channel change server allocation
US11171865B2 (en) 2016-02-04 2021-11-09 Twilio Inc. Systems and methods for providing secure network exchanged for a multitenant virtual private cloud
US10659349B2 (en) 2016-02-04 2020-05-19 Twilio Inc. Systems and methods for providing secure network exchanged for a multitenant virtual private cloud
CN108604313A (en) * 2016-02-12 2018-09-28 微软技术许可有限责任公司 The predictive modeling of automation and frame
US10685281B2 (en) * 2016-02-12 2020-06-16 Microsoft Technology Licensing, Llc Automated predictive modeling and framework
US20170236056A1 (en) * 2016-02-12 2017-08-17 Microsoft Technology Licensing, Llc Automated predictive modeling and framework
US11622022B2 (en) 2016-05-23 2023-04-04 Twilio Inc. System and method for a multi-channel notification service
US10440192B2 (en) 2016-05-23 2019-10-08 Twilio Inc. System and method for programmatic device connectivity
US10063713B2 (en) 2016-05-23 2018-08-28 Twilio Inc. System and method for programmatic device connectivity
US11627225B2 (en) 2016-05-23 2023-04-11 Twilio Inc. System and method for programmatic device connectivity
US11076054B2 (en) 2016-05-23 2021-07-27 Twilio Inc. System and method for programmatic device connectivity
US10686902B2 (en) 2016-05-23 2020-06-16 Twilio Inc. System and method for a multi-channel notification service
US11265392B2 (en) 2016-05-23 2022-03-01 Twilio Inc. System and method for a multi-channel notification service

Also Published As

Publication number Publication date
DE50107821D1 (en) 2005-12-01
EP1223709A2 (en) 2002-07-17
EP1223709A3 (en) 2004-04-21
EP1223709B1 (en) 2005-10-26

Similar Documents

Publication Publication Date Title
US20020133587A1 (en) System for monitoring telecommunication network and training statistical estimator
US11902322B2 (en) Method, apparatus, and system to map network reachability
Estevez-Tapiador et al. Anomaly detection methods in wired networks: a survey and taxonomy
US10091218B2 (en) System and method to detect attacks on mobile wireless networks based on network controllability analysis
Dickerson et al. Fuzzy intrusion detection
US7143442B2 (en) System and method of detecting events
US6199172B1 (en) Method and apparatus for testing the responsiveness of a network device
CA2531410A1 (en) Behavioural-based network anomaly detection based on user and group profiling
CN108924102B (en) Efficient industrial control protocol fuzzy test method
Årnes et al. Using Hidden Markov Models to evaluate the risks of intrusions: system architecture and model validation
KR20010085057A (en) Apparatus for detecting invasion with network stream analysis
US20210185086A1 (en) Method and system for intrusion detection
US20040054505A1 (en) Hierarchial neural network intrusion detector
US20210360021A1 (en) Identifying network vulnerabilities
US6639900B1 (en) Use of generic classifiers to determine physical topology in heterogeneous networking environments
EP3278501B1 (en) Network operation
US20040059947A1 (en) Method for training a hierarchical neural-network intrusion detector
Perona et al. Service-independent payload analysis to improve intrusion detection in network traffic
CN112822223B (en) DNS hidden tunnel event automatic detection method and device and electronic equipment
CN101404614A (en) Routing oscillation detection method
Glass et al. Automatically identifying the sources of large Internet events
US20200186550A1 (en) Method and a system for detecting an intrusion on a network
Cisco Polling-The Event Generation Process
Bhuyan et al. Network Traa c Anomaly Detection and Prevention
Katata et al. Distributed agent architecture for intrusion detection based on new metrics

Legal Events

Date Code Title Description
AS Assignment

Owner name: SIEMENS AKTIENGESELLSCHAFT, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ENSEL, CHRISTIAN;STERZING, VOLKMAR;REEL/FRAME:012580/0846;SIGNING DATES FROM 20020118 TO 20020125

STCB Information on status: application discontinuation

Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION