WO2003009140A3 - System and method for adaptive threshold determination for performance metrics - Google Patents

System and method for adaptive threshold determination for performance metrics Download PDF

Info

Publication number
WO2003009140A3
WO2003009140A3 PCT/US2002/022876 US0222876W WO03009140A3 WO 2003009140 A3 WO2003009140 A3 WO 2003009140A3 US 0222876 W US0222876 W US 0222876W WO 03009140 A3 WO03009140 A3 WO 03009140A3
Authority
WO
WIPO (PCT)
Prior art keywords
thresholds
performance metrics
methods
metrics
generate
Prior art date
Application number
PCT/US2002/022876
Other languages
French (fr)
Other versions
WO2003009140A2 (en
Inventor
John J Mcgee
John Michael Earley
James W Matthews
Original Assignee
Altaworks Corp
John J Mcgee
John Michael Earley
James W Matthews
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Altaworks Corp, John J Mcgee, John Michael Earley, James W Matthews filed Critical Altaworks Corp
Priority to AU2002329611A priority Critical patent/AU2002329611A1/en
Publication of WO2003009140A2 publication Critical patent/WO2003009140A2/en
Publication of WO2003009140A3 publication Critical patent/WO2003009140A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766—Error or fault reporting or storing
    • G06F11/0772—Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0709—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3452—Performance evaluation by statistical analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/15—Correlation function computation including computation of convolution operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/079—Root cause analysis, i.e. error or fault diagnosis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324—Display of status information
    • G06F11/327—Alarm or error message display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466—Performance evaluation by tracing or monitoring
    • G06F11/3495—Performance evaluation by tracing or monitoring for systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/81—Threshold
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/86—Event-based monitoring
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/875—Monitoring of systems including the internet

Abstract

A system and method for dynamically generating alarm thresholds for performance metrics, and for applying those thresholds to generate alarms is described. Statistical methods are used to generate one or more thresholds for metrics that may not fit a Gaussian or normal distribution, or that may exhibit cyclic behavior or persistent shifts in the values of the metrics. The statistical methods used to generate the thresholds may include statistical process control (SPC) methods, normalization methods, and heuristics.
PCT/US2002/022876 2001-07-20 2002-07-18 System and method for adaptive threshold determination for performance metrics WO2003009140A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2002329611A AU2002329611A1 (en) 2001-07-20 2002-07-18 System and method for adaptive threshold determination for performance metrics

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US30705501P 2001-07-20 2001-07-20
US60/307,055 2001-07-20
US32202101P 2001-09-13 2001-09-13
US60/322,021 2001-09-13

Publications (2)

Publication Number Publication Date
WO2003009140A2 WO2003009140A2 (en) 2003-01-30
WO2003009140A3 true WO2003009140A3 (en) 2003-12-24

Family

ID=26975515

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/022876 WO2003009140A2 (en) 2001-07-20 2002-07-18 System and method for adaptive threshold determination for performance metrics

Country Status (3)

Country Link
US (1) US7076695B2 (en)
AU (1) AU2002329611A1 (en)
WO (1) WO2003009140A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109213654B (en) * 2018-07-05 2023-01-03 北京奇艺世纪科技有限公司 Anomaly detection method and device

Families Citing this family (241)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10144459A1 (en) * 2001-09-10 2003-04-03 Werner Kluft Monitoring machine tool components with a monitoring system
US8260907B2 (en) * 2002-04-04 2012-09-04 Ca, Inc. Methods, systems and computer program products for triggered data collection and correlation of status and/or state in distributed data processing systems
US7444263B2 (en) * 2002-07-01 2008-10-28 Opnet Technologies, Inc. Performance metric collection and automated analysis
US7434109B1 (en) * 2002-09-26 2008-10-07 Computer Associates Think, Inc. Network fault manager for maintaining alarm conditions
US7281041B2 (en) * 2002-10-31 2007-10-09 Hewlett-Packard Development Company, L.P. Method and apparatus for providing a baselining and auto-thresholding framework
US7457864B2 (en) * 2002-11-27 2008-11-25 International Business Machines Corporation System and method for managing the performance of a computer system based on operational characteristics of the system components
JP2004248083A (en) * 2003-02-14 2004-09-02 Ricoh Co Ltd Network communication terminal device
US7930158B2 (en) * 2003-03-31 2011-04-19 Emc Corporation Method and apparatus for multi-realm system modeling
US7930159B1 (en) * 2003-03-31 2011-04-19 Emc Corporation Method and apparatus for multi-realm system modeling
US7624174B2 (en) 2003-05-22 2009-11-24 Microsoft Corporation Self-learning method and system for detecting abnormalities
CA2429375A1 (en) * 2003-05-22 2004-11-22 Cognos Incorporated Model action logging
US7324986B2 (en) * 2003-06-30 2008-01-29 At&T Delaware Intellectual Property, Inc. Automatically facilitated support for complex electronic services
US7409593B2 (en) * 2003-06-30 2008-08-05 At&T Delaware Intellectual Property, Inc. Automated diagnosis for computer networks
US7237266B2 (en) * 2003-06-30 2007-06-26 At&T Intellectual Property, Inc. Electronic vulnerability and reliability assessment
US20050038697A1 (en) * 2003-06-30 2005-02-17 Aaron Jeffrey A. Automatically facilitated marketing and provision of electronic services
US7900092B2 (en) * 2003-07-11 2011-03-01 Computer Associates Think, Inc. Kernel-level method of flagging problems in applications
US7933814B2 (en) * 2003-09-26 2011-04-26 Hewlett-Packard Development Company, L.P. Method and system to determine if a composite service level agreement (SLA) can be met
US20050086659A1 (en) * 2003-10-19 2005-04-21 Ibm Corporation System and method for regulating rate of execution of software execution units
US7107187B1 (en) * 2003-11-12 2006-09-12 Sprint Communications Company L.P. Method for modeling system performance
US7412513B2 (en) 2003-11-14 2008-08-12 Microsoft Corporation Systems and methods for using metrics to control throttling and swapping in a message processing system
EP1542108A1 (en) * 2003-12-12 2005-06-15 Siemens Aktiengesellschaft Method for monitoring of a technical installation
US7353431B2 (en) * 2004-02-11 2008-04-01 Sun Microsystems, Inc. Method and apparatus for proactive fault monitoring in interconnects
US7181651B2 (en) * 2004-02-11 2007-02-20 Sun Microsystems, Inc. Detecting and correcting a failure sequence in a computer system before a failure occurs
US7584382B2 (en) 2004-02-19 2009-09-01 Microsoft Corporation Method and system for troubleshooting a misconfiguration of a computer system based on configurations of other computer systems
US7392295B2 (en) 2004-02-19 2008-06-24 Microsoft Corporation Method and system for collecting information from computer systems based on a trusted relationship
US8423634B2 (en) * 2004-05-24 2013-04-16 Neustar, Inc. System and method for determining cost of website performance
US7552447B2 (en) * 2004-05-26 2009-06-23 International Business Machines Corporation System and method for using root cause analysis to generate a representation of resource dependencies
US20050283635A1 (en) * 2004-06-08 2005-12-22 International Business Machines Corporation System and method for promoting effective service to computer users
US20050283683A1 (en) * 2004-06-08 2005-12-22 International Business Machines Corporation System and method for promoting effective operation in user computers
US7580837B2 (en) 2004-08-12 2009-08-25 At&T Intellectual Property I, L.P. System and method for targeted tuning module of a speech recognition system
JP4125274B2 (en) * 2004-08-26 2008-07-30 キヤノン株式会社 Image input / output device, information processing method, computer-readable storage medium storing program, and program
DE102004052302B4 (en) * 2004-09-30 2013-05-23 Immobiliengesellschaft Helmut Fischer Gmbh & Co. Kg Method for outputting measured values and display device
US7667582B1 (en) * 2004-10-14 2010-02-23 Sun Microsystems, Inc. Tool for creating charts
US7437611B2 (en) * 2004-10-21 2008-10-14 International Business Machines Corporation System and method for problem determination using dependency graphs and run-time behavior models
US7242751B2 (en) 2004-12-06 2007-07-10 Sbc Knowledge Ventures, L.P. System and method for speech recognition-enabled automatic call routing
US7996814B1 (en) 2004-12-21 2011-08-09 Zenprise, Inc. Application model for automated management of software application deployments
CN101088072B (en) 2004-12-24 2011-04-20 国际商业机器公司 A method and system for monitoring transaction based systems
US7751551B2 (en) 2005-01-10 2010-07-06 At&T Intellectual Property I, L.P. System and method for speech-enabled call routing
US8909807B2 (en) * 2005-04-07 2014-12-09 Opanga Networks, Inc. System and method for progressive download using surplus network capacity
US9065595B2 (en) 2005-04-07 2015-06-23 Opanga Networks, Inc. System and method for peak flow detection in a communication network
US8589508B2 (en) * 2005-04-07 2013-11-19 Opanga Networks, Inc. System and method for flow control in an adaptive file delivery system
US11258531B2 (en) 2005-04-07 2022-02-22 Opanga Networks, Inc. System and method for peak flow detection in a communication network
US8719399B2 (en) * 2005-04-07 2014-05-06 Opanga Networks, Inc. Adaptive file delivery with link profiling system and method
US7500010B2 (en) * 2005-04-07 2009-03-03 Jeffrey Paul Harrang Adaptive file delivery system and method
US20060245365A1 (en) * 2005-04-28 2006-11-02 Monk John M Apparatus and method for correlation and display of signaling and network events
US7493234B2 (en) 2005-05-10 2009-02-17 International Business Machines Corporation Monitoring and reporting normalized device system performance
US7657020B2 (en) 2005-06-03 2010-02-02 At&T Intellectual Property I, Lp Call routing system and method of using the same
US8086708B2 (en) * 2005-06-07 2011-12-27 International Business Machines Corporation Automated and adaptive threshold setting
US20060282530A1 (en) * 2005-06-14 2006-12-14 Klein Stephen D Methods and apparatus for end-user based service monitoring
US8175253B2 (en) * 2005-07-07 2012-05-08 At&T Intellectual Property I, L.P. System and method for automated performance monitoring for a call servicing system
JP4626852B2 (en) * 2005-07-11 2011-02-09 日本電気株式会社 Communication network failure detection system, communication network failure detection method, and failure detection program
US20070016687A1 (en) * 2005-07-14 2007-01-18 International Business Machines Corporation System and method for detecting imbalances in dynamic workload scheduling in clustered environments
US20070156479A1 (en) * 2005-11-02 2007-07-05 Long Erik T Multivariate statistical forecasting system, method and software
US7856100B2 (en) 2005-12-19 2010-12-21 Microsoft Corporation Privacy-preserving data aggregation using homomorphic encryption
US7584182B2 (en) 2005-12-19 2009-09-01 Microsoft Corporation Determining cardinality of a parameter using hash values
US7743123B2 (en) 2005-12-19 2010-06-22 Microsoft Corporation Aggregating information from a cluster of peers
US7500142B1 (en) * 2005-12-20 2009-03-03 International Business Machines Corporation Preliminary classification of events to facilitate cause-based analysis
JP2007179477A (en) * 2005-12-28 2007-07-12 Internatl Business Mach Corp <Ibm> Method, system and computer program for supporting service evaluation
US7752488B2 (en) * 2006-01-06 2010-07-06 International Business Machines Corporation Method to adjust error thresholds in a data storage and retrieval system
DE102006003611A1 (en) * 2006-01-25 2007-08-02 Siemens Ag Locating faulty data record in number of data records involves forming cells in input data space, characterizing as faulty any data record of selected cell whose target data item value fails check criterion derived from target data values
TW200745802A (en) * 2006-04-14 2007-12-16 Dow Global Technologies Inc Process monitoring technique and related actions
US7788544B2 (en) * 2006-05-03 2010-08-31 Computer Associates Think, Inc. Autonomous system state tolerance adjustment for autonomous management systems
US8769019B2 (en) * 2006-05-04 2014-07-01 Citrix Systems, Inc. Methods and systems for managing shared state within a distributed system with varying consistency and consensus semantics
US20070262994A1 (en) * 2006-05-10 2007-11-15 Sun Microsystems, Inc. Mechanism for animated load graph analysis of system metrics
US7805510B2 (en) 2006-05-11 2010-09-28 Computer Associates Think, Inc. Hierarchy for characterizing interactions with an application
US8656006B2 (en) 2006-05-11 2014-02-18 Ca, Inc. Integrating traffic monitoring data and application runtime data
US7937690B2 (en) * 2006-05-23 2011-05-03 Hewlett-Packard Development Company, L.P. Evaluating performance of software application
US7502713B2 (en) * 2006-06-23 2009-03-10 Cirba Inc. Method and system for determining parameter distribution, variance, outliers and trends in computer systems
US7289935B1 (en) 2006-08-02 2007-10-30 Hugo Alan J Statistical quality control of alarm occurrences
US20080056144A1 (en) * 2006-09-06 2008-03-06 Cypheredge Technologies System and method for analyzing and tracking communications network operations
US7551072B2 (en) * 2006-09-29 2009-06-23 Rockwell Automation Technologies, Inc. Run-time configuration of alarms and events
US20080086515A1 (en) * 2006-10-06 2008-04-10 International Business Machines Corporation Method and System for a Soft Error Collection of Trace Files
US7673191B2 (en) * 2006-11-03 2010-03-02 Computer Associates Think, Inc. Baselining backend component error rate to determine application performance
US7676706B2 (en) * 2006-11-03 2010-03-09 Computer Associates Think, Inc. Baselining backend component response time to determine application performance
US20080148242A1 (en) * 2006-12-18 2008-06-19 Computer Associates Think, Inc. Optimizing an interaction model for an application
US9009680B2 (en) 2006-11-30 2015-04-14 Ca, Inc. Selecting instrumentation points for an application
US7917911B2 (en) * 2006-12-01 2011-03-29 Computer Associates Think, Inc. Automated grouping of messages provided to an application using execution path similarity analysis
US7689610B2 (en) 2006-12-01 2010-03-30 Computer Associates Think, Inc. Automated grouping of messages provided to an application using string similarity analysis
US8271981B2 (en) * 2006-12-12 2012-09-18 International Business Machines Corporation Detecting an extraordinary behavior
US20080147361A1 (en) * 2006-12-15 2008-06-19 Miller Daniel H Methods and apparatus to monitor system health
US20080176554A1 (en) * 2007-01-16 2008-07-24 Mediacast, Llc Wireless data delivery management system and method
WO2008107020A1 (en) * 2007-03-08 2008-09-12 Telefonaktiebolaget L M Ericsson (Publ) An arrangement and a method relating to performance monitoring
JP4931220B2 (en) * 2007-03-12 2012-05-16 インターナショナル・ビジネス・マシーンズ・コーポレーション Detection apparatus, system, program, and detection method
US7818418B2 (en) * 2007-03-20 2010-10-19 Computer Associates Think, Inc. Automatic root cause analysis of performance problems using auto-baselining on aggregated performance metrics
WO2008127581A2 (en) * 2007-04-12 2008-10-23 Thomson Licensing Message mechanism for workflow interfacing
US20090037155A1 (en) * 2007-04-13 2009-02-05 Bernhard Glomann Machine condition monitoring using a flexible monitoring framework
US7877644B2 (en) * 2007-04-19 2011-01-25 International Business Machines Corporation Computer application performance optimization system
US8234240B2 (en) * 2007-04-26 2012-07-31 Microsoft Corporation Framework for providing metrics from any datasource
US20080270469A1 (en) * 2007-04-26 2008-10-30 Microsoft Corporation Business metrics aggregated by custom hierarchy
US8427670B2 (en) * 2007-05-18 2013-04-23 Xerox Corporation System and method for improving throughput in a print production environment
US8032867B2 (en) * 2007-06-05 2011-10-04 Computer Associates Think, Inc. Programmatic root cause analysis for application performance management
US20090077156A1 (en) * 2007-09-14 2009-03-19 Srinivas Raghav Kashyap Efficient constraint monitoring using adaptive thresholds
US8204943B2 (en) * 2007-07-09 2012-06-19 Sap Ag Large distribution message handling
US20090025002A1 (en) * 2007-07-18 2009-01-22 Xerox Corporation Methods and systems for routing large, high-volume, high-variability print jobs in a document production environment
US8134743B2 (en) * 2007-07-18 2012-03-13 Xerox Corporation Methods and systems for routing and processing jobs in a production environment
US8725546B2 (en) 2007-07-18 2014-05-13 Xerox Corporation Workflow scheduling method and system
US8145517B2 (en) * 2007-07-18 2012-03-27 Xerox Corporation Methods and systems for scheduling job sets in a production environment
US8127012B2 (en) * 2007-07-18 2012-02-28 Xerox Corporation System and methods for efficient and adequate data collection in document production environments
US8144364B2 (en) 2007-07-18 2012-03-27 Xerox Corporation Methods and systems for processing heavy-tailed job distributions in a document production environment
US20090037869A1 (en) * 2007-07-30 2009-02-05 Darin Edward Hamilton System and method for evaluating a product development process
US8756307B1 (en) * 2007-07-30 2014-06-17 Hewlett-Packard Development Company, L.P. Translating service level objectives to system metrics
US7957948B2 (en) * 2007-08-22 2011-06-07 Hyperformit, Inc. System and method for capacity planning for systems with multithreaded multicore multiprocessor resources
US20090055805A1 (en) * 2007-08-24 2009-02-26 International Business Machines Corporation Method and System for Testing Software
CA2697965C (en) 2007-08-31 2018-06-12 Cirba Inc. Method and system for evaluating virtualized environments
US20090070756A1 (en) * 2007-09-06 2009-03-12 Hongfeng Wei System and method for resource utilization-based throttling of software updates
US20090099907A1 (en) * 2007-10-15 2009-04-16 Oculus Technologies Corporation Performance management
US8000929B2 (en) * 2007-11-28 2011-08-16 At&T Intellectual Property I, L.P. Sequential fixed-point quantile estimation
US7925460B2 (en) * 2007-12-12 2011-04-12 Xerox Corporation System and method for improving print shop operability
US7688730B2 (en) * 2007-12-20 2010-03-30 Harris Corporation System and method for multi-channel data-adaptive thresholding for shared channels with time-varying rate constraints
US9977721B2 (en) 2007-12-20 2018-05-22 Netapp, Inc. Evaluating and predicting computer system performance using kneepoint analysis
WO2009086326A1 (en) * 2007-12-20 2009-07-09 Akorri Networks, Inc. Evaluating and predicting computer system performance using kneepoint analysis
US8990720B2 (en) * 2008-01-09 2015-03-24 International Business Machines Corporation Setting alert thresholds in the context of a real-time dashboard chart
US20090281845A1 (en) * 2008-05-06 2009-11-12 International Business Machines Corporation Method and apparatus of constructing and exploring kpi networks
US8015454B1 (en) 2008-06-02 2011-09-06 Quest Software, Inc. Computer systems and methods for predictive performance management of data transactions
US20090327033A1 (en) * 2008-06-26 2009-12-31 Xerox Corporation Methods and systems for forecasting inventory levels in a production environment
US20100027966A1 (en) * 2008-08-04 2010-02-04 Opanga Networks, Llc Systems and methods for video bookmarking
US7877636B2 (en) * 2008-08-28 2011-01-25 Honeywell International Inc. System and method for detecting temporal relationships uniquely associated with an underlying root cause
EP2350962A4 (en) * 2008-09-18 2013-08-21 Opanga Networks Inc Systems and methods for automatic detection and coordinated delivery of burdensome media content
US8032797B1 (en) * 2008-10-20 2011-10-04 Amazon Technologies, Inc. Storage of mass data for monitoring
JP5538810B2 (en) * 2008-10-20 2014-07-02 アマゾン テクノロジーズ インク Mass data storage system for monitoring
US8381039B1 (en) 2008-10-20 2013-02-19 Amazon Technologies, Inc. Storage of mass data for monitoring
US8744806B2 (en) * 2008-10-29 2014-06-03 Sevone, Inc. Scalable performance management system
US9143341B2 (en) * 2008-11-07 2015-09-22 Opanga Networks, Inc. Systems and methods for portable data storage devices that automatically initiate data transfers utilizing host devices
US20100131385A1 (en) * 2008-11-25 2010-05-27 Opanga Networks, Llc Systems and methods for distribution of digital media content utilizing viral marketing over social networks
US9288333B2 (en) * 2008-12-01 2016-03-15 At&T Intellectual Property I, L.P. Voice port utilization monitor
US8214693B2 (en) * 2009-01-08 2012-07-03 International Business Machines Corporation Damaged software system detection
US8381043B2 (en) * 2009-02-27 2013-02-19 Kabushiki Kaisha Toshiba System for testing a hinge and a cable connecting the main body and the display of a device
US20100292995A1 (en) * 2009-05-18 2010-11-18 Tian Bu Method and apparatus for incremental quantile estimation
US8666946B2 (en) * 2009-07-10 2014-03-04 Alcatel Lucent Incremental quantile tracking of multiple record types
US8275882B2 (en) * 2009-08-04 2012-09-25 International Business Machines Corporation System and method for goal driven threshold setting in distributed system management
US9038073B2 (en) * 2009-08-13 2015-05-19 Qualcomm Incorporated Data mover moving data to accelerator for processing and returning result data based on instruction received from a processor utilizing software and hardware interrupts
US8788782B2 (en) * 2009-08-13 2014-07-22 Qualcomm Incorporated Apparatus and method for memory management and efficient data processing
US20110041128A1 (en) * 2009-08-13 2011-02-17 Mathias Kohlenz Apparatus and Method for Distributed Data Processing
US8762532B2 (en) * 2009-08-13 2014-06-24 Qualcomm Incorporated Apparatus and method for efficient memory allocation
US8886790B2 (en) * 2009-08-19 2014-11-11 Opanga Networks, Inc. Systems and methods for optimizing channel resources by coordinating data transfers based on data type and traffic
WO2011022095A1 (en) 2009-08-19 2011-02-24 Opanga Networks, Inc Enhanced data delivery based on real time analysis of network communications quality and traffic
US7978711B2 (en) * 2009-08-20 2011-07-12 Opanga Networks, Inc. Systems and methods for broadcasting content using surplus network capacity
WO2011045736A1 (en) * 2009-10-16 2011-04-21 Telefonaktiebolaget L M Ericsson (Publ) Network management system and method for identifying and accessing quality of service issues within a communications network
US20110098973A1 (en) * 2009-10-23 2011-04-28 Computer Associates Think, Inc. Automatic Baselining Of Metrics For Application Performance Management
US20110153381A1 (en) * 2009-12-18 2011-06-23 Saryu Shah Method and System for Smart Queuing of Test Requests
US8578020B2 (en) * 2009-12-24 2013-11-05 Empire Technology Development Llc Dynamic mobile application quality-of-service monitoring and reporting
US8386849B2 (en) * 2010-01-29 2013-02-26 Honeywell International Inc. Noisy monitor detection and intermittent fault isolation
US8495196B2 (en) 2010-03-22 2013-07-23 Opanga Networks, Inc. Systems and methods for aligning media content delivery sessions with historical network usage
JP5222876B2 (en) * 2010-03-23 2013-06-26 株式会社日立製作所 System management method and management system in computer system
US8407520B2 (en) * 2010-04-23 2013-03-26 Ebay Inc. System and method for definition, creation, management, transmission, and monitoring of errors in SOA environment
US9459942B2 (en) 2010-08-27 2016-10-04 Hewlett Packard Enterprise Development Lp Correlation of metrics monitored from a virtual environment
US8667334B2 (en) 2010-08-27 2014-03-04 Hewlett-Packard Development Company, L.P. Problem isolation in a virtual environment
US20120053995A1 (en) * 2010-08-31 2012-03-01 D Albis John Analyzing performance and setting strategic targets
US9582392B2 (en) * 2010-09-14 2017-02-28 Microsoft Technology Licensing, Llc Add-on performance advisor
US8732534B2 (en) * 2010-09-17 2014-05-20 Oracle International Corporation Predictive incident management
TWI537845B (en) * 2010-10-20 2016-06-11 華亞科技股份有限公司 Specification establish method for semiconductor process control
US8712560B2 (en) * 2010-12-08 2014-04-29 L'air Liquide Societe Anonyme Pour L'etude Et L'exploration Des Procedes Georges Claude Performance monitoring of advanced process control systems
US8543868B2 (en) 2010-12-21 2013-09-24 Guest Tek Interactive Entertainment Ltd. Distributed computing system that monitors client device request time and server servicing time in order to detect performance problems and automatically issue alerts
US9009185B2 (en) * 2010-12-28 2015-04-14 Sevone, Inc. Scalable performance management system
WO2012101933A1 (en) * 2011-01-24 2012-08-02 日本電気株式会社 Operation management unit, operation management method, and program
US10558544B2 (en) * 2011-02-14 2020-02-11 International Business Machines Corporation Multiple modeling paradigm for predictive analytics
US9331897B2 (en) * 2011-04-21 2016-05-03 Telefonaktiebolaget Lm Ericsson (Publ) Recovery from multiple faults in a communications network
DE102011078143A1 (en) * 2011-06-27 2012-12-27 Siemens Aktiengesellschaft Method for interpretation of technical process e.g. product manufacturing process, in process control application, involves determining correlation value, and using correlation value for determining threshold value for detection points
US8752432B2 (en) 2011-06-30 2014-06-17 The United States Of America As Represented By The Secretary Of The Army Self diagnostic composite armor
US9021308B2 (en) 2011-08-09 2015-04-28 International Business Machines Corporation Analyzing a process of software defects handling using percentile-based metrics
EP2742662A2 (en) * 2011-08-10 2014-06-18 Riverbed Technology, Inc. Application performance analysis that is adaptive to business activity patterns
US9015536B1 (en) 2011-08-31 2015-04-21 Amazon Technologies, Inc. Integration based anomaly detection service
US8217945B1 (en) 2011-09-02 2012-07-10 Metric Insights, Inc. Social annotation of a single evolving visual representation of a changing dataset
US20130132108A1 (en) * 2011-11-23 2013-05-23 Nikita Victorovich Solilov Real-time contextual kpi-based autonomous alerting agent
US8600915B2 (en) 2011-12-19 2013-12-03 Go Daddy Operating Company, LLC Systems for monitoring computer resources
US8719196B2 (en) 2011-12-19 2014-05-06 Go Daddy Operating Company, LLC Methods for monitoring computer resources using a first and second matrix, and a feature relationship tree
US9130825B2 (en) * 2011-12-27 2015-09-08 Tektronix, Inc. Confidence intervals for key performance indicators in communication networks
EP2827251B1 (en) * 2012-03-14 2020-02-12 NEC Corporation Operation administration device, operation administration method, and program
US8924797B2 (en) * 2012-04-16 2014-12-30 Hewlett-Packard Developmet Company, L.P. Identifying a dimension associated with an abnormal condition
US10599545B2 (en) 2012-04-24 2020-03-24 International Business Machines Corporation Correlation based adaptive system monitoring
US20130317870A1 (en) * 2012-05-25 2013-11-28 Bank Of America Apparatus and methods for process change control
US9501920B2 (en) * 2012-06-22 2016-11-22 K.L. Harring Transportation LLC Cargo tracking and monitoring system
US9378112B2 (en) * 2012-06-25 2016-06-28 International Business Machines Corporation Predictive alert threshold determination tool
US9628499B1 (en) 2012-08-08 2017-04-18 Google Inc. Statistics-based anomaly detection
US9246747B2 (en) 2012-11-15 2016-01-26 Hong Kong Applied Science and Technology Research Co., Ltd. Adaptive unified performance management (AUPM) with root cause and/or severity analysis for broadband wireless access networks
US20140164995A1 (en) * 2012-12-12 2014-06-12 Nishant Ghadge Graphical representation of threshold operations
US9860140B2 (en) * 2013-02-05 2018-01-02 Cisco Technology, Inc. Dynamically adjusting a set of monitored network properties using distributed learning machine feedback
US9195943B2 (en) 2013-03-12 2015-11-24 Bmc Software, Inc. Behavioral rules discovery for intelligent computing environment administration
US9614742B1 (en) 2013-03-14 2017-04-04 Google Inc. Anomaly detection in time series data
US9767668B2 (en) 2013-03-14 2017-09-19 International Business Machines Corporation Automatic adjustment of metric alert trigger thresholds
US10241887B2 (en) * 2013-03-29 2019-03-26 Vmware, Inc. Data-agnostic anomaly detection
US20220084057A1 (en) * 2013-06-07 2022-03-17 Groupon, Inc. Method, apparatus, and computer program product for facilitating dynamic change of an adjustable size component of a displayed icon
US10949894B1 (en) 2013-06-07 2021-03-16 Groupon, Inc. Method, apparatus, and computer program product for facilitating dynamic pricing
US10387902B1 (en) 2013-06-28 2019-08-20 Groupon, Inc. Method and apparatus for generating an electronic communication
US10423977B1 (en) 2013-06-28 2019-09-24 Groupon, Inc. Method and apparatus for generating an electronic communication
US10373210B1 (en) 2013-06-28 2019-08-06 Groupon, Inc. Method and apparatus for generating an electronic communication
US10984455B1 (en) 2013-06-28 2021-04-20 Groupon, Inc. Method and apparatus for generating an electronic communication
US9414244B2 (en) 2013-07-22 2016-08-09 Motorola Solutions, Inc. Apparatus and method for determining context-aware and adaptive thresholds in a communications system
US9942103B2 (en) 2013-08-30 2018-04-10 International Business Machines Corporation Predicting service delivery metrics using system performance data
US20150149235A1 (en) * 2013-11-27 2015-05-28 General Electric Company Methods and systems to improve a quality of data employed by a healthcare analytics system
US9692674B1 (en) * 2013-12-30 2017-06-27 Google Inc. Non-parametric change point detection
US9753795B2 (en) * 2014-01-06 2017-09-05 International Business Machines Corporation Efficient data system error recovery
EP2894813A1 (en) * 2014-01-08 2015-07-15 Telefonaktiebolaget L M Ericsson (publ) Technique for creating a knowledge base for alarm management in a communications network
CN104901823B (en) * 2014-03-04 2018-09-25 中国移动通信集团北京有限公司 A kind of alarm threshold generation method, service feature index monitoring method and device
US9996446B2 (en) * 2014-04-28 2018-06-12 Microsoft Technology Licensing, Llc User experience diagnostics with actionable insights
US11232649B2 (en) 2014-05-19 2022-01-25 Pas, Inc. Method and system for automation, safety and reliable operation performance assessment
WO2016085443A1 (en) * 2014-11-24 2016-06-02 Hewlett Packard Enterprise Development Lp Application management based on data correlations
US10089589B2 (en) * 2015-01-30 2018-10-02 Sap Se Intelligent threshold editor
EP3059676B1 (en) * 2015-02-20 2019-09-11 Siemens Aktiengesellschaft A method and apparatus for analyzing the availability of a system, in particular of a safety critical system
US10747188B2 (en) * 2015-03-16 2020-08-18 Nec Corporation Information processing apparatus, information processing method, and, recording medium
US11283697B1 (en) * 2015-03-24 2022-03-22 Vmware, Inc. Scalable real time metrics management
US10540225B2 (en) * 2015-05-27 2020-01-21 Hewlett Packard Enterprise Development Lp Data validation
US10437697B2 (en) * 2015-06-17 2019-10-08 Capital One Services, Llc Systems and methods for modeling computer resource metrics
EP3128425A1 (en) * 2015-08-07 2017-02-08 Tata Consultancy Services Limited System and method for smart alerts
US10594562B1 (en) 2015-08-25 2020-03-17 Vmware, Inc. Intelligent autoscale of services
US10673730B2 (en) 2015-08-31 2020-06-02 Hitachi, Ltd. Method and apparatus to manage it infrastructure based on application characteristics
IN2015CH05361A (en) * 2015-10-07 2015-10-16 Wipro Ltd
US9772895B2 (en) * 2015-10-20 2017-09-26 International Business Machines Corporation Identifying intervals of unusual activity in information technology systems
US10756955B2 (en) 2015-11-24 2020-08-25 International Business Machines Corporation Dynamic thresholds for computer system alerts
US10419310B1 (en) * 2015-12-17 2019-09-17 8×8, Inc. Monitor device for use with endpoint devices
US10073753B2 (en) * 2016-02-14 2018-09-11 Dell Products, Lp System and method to assess information handling system health and resource utilization
US10931548B1 (en) 2016-03-28 2021-02-23 Vmware, Inc. Collecting health monitoring data pertaining to an application from a selected set of service engines
US10089165B2 (en) * 2016-04-06 2018-10-02 International Business Machines Corporation Monitoring data events using calendars
US10203997B2 (en) 2016-05-14 2019-02-12 Microsoft Technology Licensing, Llc Presenting a synthesized alert using a digital personal assistant
CN106405280B (en) * 2016-08-29 2018-11-09 许继集团有限公司 A kind of intelligent substation on-line monitoring parameter trend method for early warning
US10257312B2 (en) 2016-10-27 2019-04-09 Entit Software Llc Performance monitor based on user engagement
CN106709666A (en) * 2017-01-06 2017-05-24 国网北京市电力公司 Method and system for determining threshold value of index
US10771369B2 (en) * 2017-03-20 2020-09-08 International Business Machines Corporation Analyzing performance and capacity of a complex storage environment for predicting expected incident of resource exhaustion on a data path of interest by analyzing maximum values of resource usage over time
US10467087B2 (en) * 2017-10-04 2019-11-05 Airmagnet, Inc. Plato anomaly detection
US20190213067A1 (en) * 2018-01-08 2019-07-11 Hewlett Packard Enterprise Development Lp Graph-based issue detection and remediation
US10769009B2 (en) * 2018-03-21 2020-09-08 International Business Machines Corporation Root cause analysis for correlated development and operations data
US11310125B2 (en) * 2018-05-25 2022-04-19 At&T Intellectual Property I, L.P. AI-enabled adaptive TCA thresholding for SLA assurance
US10999168B1 (en) 2018-05-30 2021-05-04 Vmware, Inc. User defined custom metrics
US20200004619A1 (en) * 2018-06-28 2020-01-02 Honeywell International Inc. System and method for detecting a shift in real data trend using the configurable adaptive threshold
US10936401B2 (en) * 2018-08-02 2021-03-02 Dell Products L.P. Device operation anomaly identification and reporting system
US11449748B2 (en) 2018-10-26 2022-09-20 Cisco Technology, Inc. Multi-domain service assurance using real-time adaptive thresholds
EP3857381B1 (en) 2018-10-26 2023-07-12 VMware, Inc. Collecting samples hierarchically in a datacenter
US11582120B2 (en) 2019-05-30 2023-02-14 Vmware, Inc. Partitioning health monitoring in a global server load balancing system
US20210019397A1 (en) * 2019-07-16 2021-01-21 Microsoft Technology Licensing, Llc Smoothed seasonality-based dynamic thresholds for anomalous computing resource usage detection
US11334410B1 (en) * 2019-07-22 2022-05-17 Intuit Inc. Determining aberrant members of a homogenous cluster of systems using external monitors
CN110928929A (en) * 2019-12-10 2020-03-27 国家电网有限公司信息通信分公司 Method and device for determining normal data interval of index data
CN111400141B (en) * 2020-03-19 2021-11-09 深圳前海微众银行股份有限公司 Abnormity detection method and device
US11675759B2 (en) * 2020-07-30 2023-06-13 Dell Products L.P. Datacenter inventory management
US20220083816A1 (en) * 2020-09-16 2022-03-17 International Business Machines Corporation Regression detection and correction in relationships between performance indicators and ai metrics
CN112433919B (en) * 2020-11-25 2023-01-24 深圳前海微众银行股份有限公司 Information warning method, equipment and storage medium
WO2022155376A1 (en) * 2021-01-14 2022-07-21 California Institute Of Technology Root cause analysis tool for alarms
US11811861B2 (en) 2021-05-17 2023-11-07 Vmware, Inc. Dynamically updating load balancing criteria
US11799824B2 (en) 2021-06-14 2023-10-24 Vmware, Inc. Method and apparatus for enhanced client persistence in multi-site GSLB deployments
US11599442B1 (en) * 2021-11-29 2023-03-07 International Business Machines Corporation Detecting abnormal database activity
CN116909851A (en) * 2023-04-24 2023-10-20 山东溯源安全科技有限公司 Monitoring method, monitoring device, electronic equipment and storage medium
CN116185783B (en) * 2023-04-24 2023-07-14 山东溯源安全科技有限公司 Monitoring method and device of electronic equipment, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0508386A2 (en) * 1991-04-08 1992-10-14 Praxair Technology, Inc. Statistical process control for air separation process
WO1999013427A2 (en) * 1997-09-12 1999-03-18 Mci Worldcom, Inc. System and method for detecting and managing fraud
FR2783620A1 (en) * 1998-09-22 2000-03-24 De Micheaux Daniel Lafaye Multi dimensional statistics industrial process control technique takes control parameter outputs and uses multi statistical matrix techniques deriving parameters within/outside statistical functions and outputting changes
US6182022B1 (en) * 1998-01-26 2001-01-30 Hewlett-Packard Company Automated adaptive baselining and thresholding method and system

Family Cites Families (111)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821220A (en) * 1986-07-25 1989-04-11 Tektronix, Inc. System for animating program operation and displaying time-based relationships
US5062055A (en) * 1986-09-02 1991-10-29 Digital Equipment Corporation Data processor performance advisor
US5101348A (en) * 1988-06-23 1992-03-31 International Business Machines Corporation Method of reducing the amount of information included in topology database update messages in a data communications network
US5161116A (en) * 1989-02-27 1992-11-03 Dynix System for evaluating the performance of a large scale programmable machine capable of having a plurality of terminals attached thereto
US5367473A (en) * 1990-06-18 1994-11-22 Bell Communications Research, Inc. Expert system for computer system resource management
GB9019017D0 (en) * 1990-08-31 1990-10-17 Hewlett Packard Co Network fault analysis
WO1992005485A2 (en) * 1990-09-17 1992-04-02 Cabletron Systems, Inc. Network management system using model-based intelligence
US5307499A (en) * 1990-11-30 1994-04-26 Singapore Computer Systems Limited Interpretive object-oriented facility which can access pre-compiled classes
US5459868A (en) * 1990-11-30 1995-10-17 St Computer Systems & Services Interpretive object-oriented facility which can access pre-compiled classes
US5475625A (en) * 1991-01-16 1995-12-12 Siemens Nixdorf Informationssysteme Aktiengesellschaft Method and arrangement for monitoring computer manipulations
US5235166A (en) * 1991-02-14 1993-08-10 Xtec Incorporated Data verification method and magnetic media therefor
US6115393A (en) * 1991-04-12 2000-09-05 Concord Communications, Inc. Network monitoring
JPH0774984B2 (en) * 1991-06-10 1995-08-09 インターナショナル・ビジネス・マシーンズ・コーポレイション System resource utilization measurement method and data processing system
SE470031B (en) * 1991-06-20 1993-10-25 Icl Systems Ab System and method for monitoring and changing the operation of a computer system
US5586254A (en) * 1992-02-13 1996-12-17 Hitachi Software Engineering Co., Ltd. System for managing and operating a network by physically imaging the network
US5819028A (en) * 1992-06-10 1998-10-06 Bay Networks, Inc. Method and apparatus for determining the health of a network
US5432932A (en) * 1992-10-23 1995-07-11 International Business Machines Corporation System and method for dynamically controlling remote processes from a performance monitor
US5506955A (en) * 1992-10-23 1996-04-09 International Business Machines Corporation System and method for monitoring and optimizing performance in a data processing system
US5553235A (en) * 1992-10-23 1996-09-03 International Business Machines Corporation System and method for maintaining performance data in a data processing system
US5483468A (en) * 1992-10-23 1996-01-09 International Business Machines Corporation System and method for concurrent recording and displaying of system performance data
US5432940A (en) * 1992-11-02 1995-07-11 Borland International, Inc. System and methods for improved computer-based training
DK0686336T3 (en) 1993-02-23 1999-01-18 British Telecomm event Correlation
US5375070A (en) * 1993-03-01 1994-12-20 International Business Machines Corporation Information collection architecture and method for a data communications network
US5450406A (en) * 1993-04-20 1995-09-12 Kabushiki Kaisha Toshiba ATM communication system with high speed connection-less service function
US5459837A (en) * 1993-04-21 1995-10-17 Digital Equipment Corporation System to facilitate efficient utilization of network resources in a computer network
US6151701A (en) * 1997-09-30 2000-11-21 Ahpah Software, Inc. Method for reconstructing debugging information for a decompiled executable file
US5845125A (en) * 1993-06-21 1998-12-01 Kabushiki Kaisha Toshiba Debugger using class information and dynamic instance inter-relationships
US5634009A (en) * 1993-10-01 1997-05-27 3Com Corporation Network data collection method and apparatus
US5513126A (en) * 1993-10-04 1996-04-30 Xerox Corporation Network having selectively accessible recipient prioritized communication channel profiles
US5974457A (en) * 1993-12-23 1999-10-26 International Business Machines Corporation Intelligent realtime monitoring of data traffic
US5732273A (en) * 1995-08-11 1998-03-24 Digital Equipment Corporation System for monitoring compute system performance
US5581482A (en) * 1994-04-26 1996-12-03 Unisys Corporation Performance monitor for digital computer system
US5619656A (en) * 1994-05-05 1997-04-08 Openservice, Inc. System for uninterruptively displaying only relevant and non-redundant alert message of the highest severity for specific condition associated with group of computers being managed
US5704018A (en) 1994-05-09 1997-12-30 Microsoft Corporation Generating improved belief networks
US5528516A (en) 1994-05-25 1996-06-18 System Management Arts, Inc. Apparatus and method for event correlation and problem reporting
US5598429A (en) 1994-07-15 1997-01-28 Marshall; Kenneth E. Multi-level correlation system for synchronization detection in high noise and multi-path environments
US5668944A (en) * 1994-09-06 1997-09-16 International Business Machines Corporation Method and system for providing performance diagnosis of a computer system
US5978594A (en) 1994-09-30 1999-11-02 Bmc Software, Inc. System for managing computer resources across a distributed computing environment by first reading discovery information about how to determine system resources presence
US6139198A (en) * 1994-10-04 2000-10-31 International Business Machines Corporation System and method for enabling tracing of program execution in an object-oriented system
US5555191A (en) * 1994-10-12 1996-09-10 Trustees Of Columbia University In The City Of New York Automated statistical tracker
US5615323A (en) 1994-11-04 1997-03-25 Concord Communications, Inc. Displaying resource performance and utilization information
US5748964A (en) * 1994-12-20 1998-05-05 Sun Microsystems, Inc. Bytecode program interpreter apparatus and method with pre-verification of data type restrictions
US5491791A (en) * 1995-01-13 1996-02-13 International Business Machines Corporation System and method for remote workstation monitoring within a distributed computing environment
US5819093A (en) * 1995-03-03 1998-10-06 Sun Microsystems, Inc. System and method for a distributed debugger for debugging distributed application programs
US5655081A (en) 1995-03-08 1997-08-05 Bmc Software, Inc. System for monitoring and managing computer resources and applications across a distributed computing environment using an intelligent autonomous agent architecture
DE19511252C1 (en) * 1995-03-27 1996-04-18 Siemens Nixdorf Inf Syst Processing load measuring system for computer network design
US5696486A (en) * 1995-03-29 1997-12-09 Cabletron Systems, Inc. Method and apparatus for policy-based alarm notification in a distributed network management environment
US5699403A (en) * 1995-04-12 1997-12-16 Lucent Technologies Inc. Network vulnerability management apparatus and method
US5581696A (en) * 1995-05-09 1996-12-03 Parasoft Corporation Method using a computer for automatically instrumenting a computer program for dynamic debugging
US5615135A (en) * 1995-06-01 1997-03-25 International Business Machines Corporation Event driven interface having a dynamically reconfigurable counter for monitoring a high speed data network according to changing traffic events
US5675510A (en) * 1995-06-07 1997-10-07 Pc Meter L.P. Computer use meter and analyzer
US6067412A (en) 1995-08-17 2000-05-23 Microsoft Corporation Automatic bottleneck detection by means of workload reconstruction from performance measurements
US6076083A (en) 1995-08-20 2000-06-13 Baker; Michelle Diagnostic system utilizing a Bayesian network model having link weights updated experimentally
US5748878A (en) * 1995-09-11 1998-05-05 Applied Microsystems, Inc. Method and apparatus for analyzing software executed in embedded systems
US5752062A (en) * 1995-10-02 1998-05-12 International Business Machines Corporation Method and system for performance monitoring through monitoring an order of processor events during execution in a processing system
US5778230A (en) * 1995-11-13 1998-07-07 Object Technology Licensing Corp. Goal directed object-oriented debugging system
US5870540A (en) 1995-11-20 1999-02-09 Ncr Corporation Low overhead method for detecting communication failures on a network
KR0179773B1 (en) * 1995-12-12 1999-04-15 문정환 Address signal memory circuit of data repair control circuit
US6058393A (en) * 1996-02-23 2000-05-02 International Business Machines Corporation Dynamic connection to a remote tool in a distributed processing system environment used for debugging
US6118936A (en) 1996-04-18 2000-09-12 Mci Communications Corporation Signaling network management system for converting network events into standard form and then correlating the standard form events with topology and maintenance information
US5896536A (en) * 1996-05-01 1999-04-20 International Business Machines Corp. Data triggered trace support for debugging object oriented programs
US5815718A (en) * 1996-05-30 1998-09-29 Sun Microsystems, Inc. Method and system for loading classes in read-only memory
US5923834A (en) * 1996-06-17 1999-07-13 Xerox Corporation Machine dedicated monitor, predictor, and diagnostic server
US5799154A (en) * 1996-06-27 1998-08-25 Mci Communications Corporation System and method for the remote monitoring of wireless packet data networks
US6072777A (en) 1996-06-28 2000-06-06 Mci Communications Corporation System and method for unreported root cause analysis
US5758071A (en) * 1996-07-12 1998-05-26 Electronic Data Systems Corporation Method and system for tracking the configuration of a computer coupled to a computer network
US5696701A (en) * 1996-07-12 1997-12-09 Electronic Data Systems Corporation Method and system for monitoring the performance of computers in computer networks using modular extensions
FR2751448B1 (en) 1996-07-17 1999-01-15 Bull Sa METHOD FOR REAL-TIME MONITORING OF A COMPUTER SYSTEM FOR ITS ADMINISTRATION AND ASSISTANCE IN MAINTAINING IT IN OPERATION
US5850388A (en) * 1996-08-02 1998-12-15 Wandel & Goltermann Technologies, Inc. Protocol analyzer for monitoring digital transmission networks
US5987249A (en) * 1996-08-27 1999-11-16 Numega Technologies IR code instrumentation
US6182157B1 (en) 1996-09-19 2001-01-30 Compaq Computer Corporation Flexible SNMP trap mechanism
US5991881A (en) * 1996-11-08 1999-11-23 Harris Corporation Network surveillance system
US5974237A (en) * 1996-12-18 1999-10-26 Northern Telecom Limited Communications network monitoring
US6028842A (en) 1996-12-23 2000-02-22 Nortel Networks Corporation Dynamic traffic conditioning
GB9701866D0 (en) 1997-01-30 1997-03-19 British Telecomm Information retrieval
US6026234A (en) * 1997-03-19 2000-02-15 International Business Machines Corporation Method and apparatus for profiling indirect procedure calls in a computer program
US6149318A (en) * 1997-04-15 2000-11-21 Samuel C. Kendall Link-time and run-time error detection, and program instrumentation
US6145121A (en) * 1997-04-17 2000-11-07 University Of Washington Trace based method for the analysis, benchmarking and tuning of object oriented databases and applications
US5948113A (en) * 1997-04-18 1999-09-07 Microsoft Corporation System and method for centrally handling runtime errors
US5901315A (en) * 1997-06-13 1999-05-04 International Business Machines Corporation Method for debugging a Java application having native method dynamic load libraries
US6222652B1 (en) 1997-06-20 2001-04-24 Nortel Networks Limited Method of and apparatus for detecting transients in an optical transmission system
US6081797A (en) 1997-07-09 2000-06-27 American Heuristics Corporation Adaptive temporal correlation network
US6154736A (en) 1997-07-30 2000-11-28 Microsoft Corporation Belief networks with decision graphs
US6073089A (en) * 1997-10-22 2000-06-06 Baker; Michelle Systems and methods for adaptive profiling, fault detection, and alert generation in a changing environment which is measurable by at least two different measures of state
US6026237A (en) * 1997-11-03 2000-02-15 International Business Machines Corporation System and method for dynamic modification of class files
WO1999025085A1 (en) * 1997-11-07 1999-05-20 Visual Networks Technologies, Inc. Method and apparatus for performing service level analysis of communications network performance metrics
US6216119B1 (en) * 1997-11-19 2001-04-10 Netuitive, Inc. Multi-kernel neural network concurrent learning, monitoring, and forecasting system
US6118940A (en) * 1997-11-25 2000-09-12 International Business Machines Corp. Method and apparatus for benchmarking byte code sequences
US6061518A (en) * 1997-11-25 2000-05-09 International Business Machines Corporation Data processing system and method for debugging a JavaScript program
US6044335A (en) * 1997-12-23 2000-03-28 At&T Corp. Productivity metrics for application software systems
US6108800A (en) * 1998-02-10 2000-08-22 Hewlett-Packard Company Method and apparatus for analyzing the performance of an information system
US6138122A (en) 1998-03-02 2000-10-24 Agilent Technologies Modeling of internet services
US6106572A (en) * 1998-03-25 2000-08-22 Origins Software Company Forward and reverse hierarchical page level debugger
US20010052087A1 (en) * 1998-04-27 2001-12-13 Atul R. Garg Method and apparatus for monitoring a network environment
US6119074A (en) * 1998-05-20 2000-09-12 Caterpillar Inc. Method and apparatus of predicting a fault condition
US6327550B1 (en) * 1998-05-26 2001-12-04 Computer Associates Think, Inc. Method and apparatus for system state monitoring using pattern recognition and neural networks
US6381306B1 (en) * 1998-06-08 2002-04-30 Inet Technologies, Inc. System and method for monitoring service quality in a communications network
US6359976B1 (en) * 1998-06-08 2002-03-19 Inet Technologies, Inc. System and method for monitoring service quality in a communications network
US6119247A (en) * 1998-06-22 2000-09-12 International Business Machines Corporation Remote debugging of internet applications
US6263298B1 (en) * 1998-08-13 2001-07-17 Precise Software Solutions Ltd. Method for analyzing system performance
US6269401B1 (en) * 1998-08-28 2001-07-31 3Com Corporation Integrated computer system and network performance monitoring
US6836800B1 (en) * 1998-09-30 2004-12-28 Netscout Systems, Inc. Managing computer resources
US6405250B1 (en) * 1999-01-25 2002-06-11 Lucent Technologies Inc. Network management system based on passive monitoring and proactive management for formulation behavior state transition models
US6557035B1 (en) * 1999-03-30 2003-04-29 International Business Machines Corporation Rules-based method of and system for optimizing server hardware capacity and performance
US6615259B1 (en) * 1999-05-20 2003-09-02 International Business Machines Corporation Method and apparatus for scanning a web site in a distributed data processing system for problem determination
US6377907B1 (en) * 1999-11-17 2002-04-23 Mci Worldcom, Inc. System and method for collating UNIX performance metrics
US6792456B1 (en) * 2000-05-08 2004-09-14 International Business Machines Corporation Systems and methods for authoring and executing operational policies that use event rates
US7379994B2 (en) * 2000-10-26 2008-05-27 Metilinx Aggregate system resource analysis including correlation matrix and metric-based analysis
US6714897B2 (en) * 2001-01-02 2004-03-30 Battelle Memorial Institute Method for generating analyses of categorical data
US6658367B2 (en) * 2001-03-28 2003-12-02 Hewlett-Packard Development Company, L.P. System for time-bucketing of baselined data collector data
US6810356B1 (en) * 2002-08-30 2004-10-26 Advertising.Com Traffic estimation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0508386A2 (en) * 1991-04-08 1992-10-14 Praxair Technology, Inc. Statistical process control for air separation process
WO1999013427A2 (en) * 1997-09-12 1999-03-18 Mci Worldcom, Inc. System and method for detecting and managing fraud
US6182022B1 (en) * 1998-01-26 2001-01-30 Hewlett-Packard Company Automated adaptive baselining and thresholding method and system
FR2783620A1 (en) * 1998-09-22 2000-03-24 De Micheaux Daniel Lafaye Multi dimensional statistics industrial process control technique takes control parameter outputs and uses multi statistical matrix techniques deriving parameters within/outside statistical functions and outputting changes

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
"Anderson-Darling test", ENGINEERING STATISTICAL HANDBOOK, 17 April 2001 (2001-04-17), pages 1 - 5, XP002256385, Retrieved from the Internet <URL:http://web.archive.org/web/20010417042002/http://www.itl.nist.gov/div898/handbook/eda/section3/eda35e.htm> [retrieved on 20031001] *
"Chi Square goodness of fit test", ENGINEERING STATISTICAL HANDBOOK, 25 June 2001 (2001-06-25), pages 1 - 5, XP002256384, Retrieved from the Internet <URL:http://web.archive.org/web/20010625035024/http://www.itl.nist.gov/div898/handbook/eda/section3/eda35f.htm> [retrieved on 20031003] *
"What are moving average or smoothing techniques ?", ENGINEERING STATISTICAL HANDBOOK, 13 July 2001 (2001-07-13), pages 1 - 4, XP002256386, Retrieved from the Internet <URL:http://web.archive.org/web/20010713210131/http://www.itl.nist.gov/div898/handbook/pmc/section4/pmc42.htm> [retrieved on 20031002] *
CUELLAR J: "Statistical process control for nonnormally distributed variables through the use of transformations", ADVANCED SEMICONDUCTOR MANUFACTURING CONFERENCE AND WORKSHOP, 1991. ASMC 91 PROCEEDINGS. IEEE/SEMI 1991 BOSTON, MA, USA 21-23 OCT. 1991, NEW YORK, NY, USA,IEEE, US, 21 October 1991 (1991-10-21), pages 143 - 148, XP010051390, ISBN: 0-7803-0152-8 *
DONALD J. WHEELER, DAVID S. CHAMBERS: "Understanding statistical process control, Chapters 3,4", 1986, STATISTICAL PROCESS CONTROLS, INC, KNOXVILLE, TENNESSEE, USA, XP002256522 *
LEE J L: "APPLICATION OF STATISTICAL PROCESS CONTROL METHODS TO THE ESTABLISHMENT OF PROCESS ALARMS IN A DISTRIBUTED PROCESS CONTROL SYSTEM", ISA TRANSACTIONS, INSTRUMENT SOCIETY OF AMERICA. PITTSBURGH, US, vol. 30, no. 1, 1991, pages 59 - 64, XP000227466, ISSN: 0019-0578 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109213654B (en) * 2018-07-05 2023-01-03 北京奇艺世纪科技有限公司 Anomaly detection method and device

Also Published As

Publication number Publication date
AU2002329611A1 (en) 2003-03-03
WO2003009140A2 (en) 2003-01-30
US7076695B2 (en) 2006-07-11
US20030079160A1 (en) 2003-04-24

Similar Documents

Publication Publication Date Title
WO2003009140A3 (en) System and method for adaptive threshold determination for performance metrics
WO2000038179A3 (en) Variable rate speech coding
EP1088205A4 (en) Improved lost frame recovery techniques for parametric, lpc-based speech coding systems
CA2428888A1 (en) Method and system for comfort noise generation in speech communication
WO2004061819A3 (en) Method and apparatus for selective distributed speech recognition
WO2001027759A3 (en) Rules-based notification system
AU5896999A (en) Adaptive countermeasure selection method and apparatus
WO2002093801A3 (en) Silence detection
WO2004079501A3 (en) Adaptive junk message filtering system
AU2001270763A1 (en) Method of and system for, processing email
KR930703778A (en) Spread spectrum noise cancellation method and apparatus
WO2001082007A3 (en) Adaptive control system having hedge unit and related apparatus and methods
ATE355606T1 (en) MODIFIABLE GASION CLUSTER JET FOR SMOOTHING SURFACES
WO2003054854A3 (en) Method of operating a speech recognition system
WO2002076063A8 (en) Method, apparatus, article and system for network communications
WO2004019184A3 (en) Method of authentificating an object or entity using a random binary id code subject to bit drift
NO20052605L (en) Channel gain estimation in a rake receiver using complex weight generation algorithms (CWG)
CA2300495A1 (en) Technique for multi-rate coding of a signal containing information
WO2003029915A3 (en) A method and apparatus for implementing projections in signal processing applications
WO2003098438A8 (en) Data usage management electronic apparatus, method, program, and storage medium
EP1571755A3 (en) Method and apparatus for arithmetic coding and decoding with initialisation of a probability model
AU2936999A (en) A method and a system for processing directed sound in an acoustic virtual environment
WO2004010263A3 (en) Method and system for automating business processes
WO2003090085A3 (en) System and method for monitoring a computer application
ATE415745T1 (en) METHOD AND DEVICE FOR REDUCING TRANSMIT POWER IN A HIGH DATA RATE SYSTEM

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP