US20140004790A1 - Peer group diagnosis detection method and system - Google Patents

Peer group diagnosis detection method and system Download PDF

Info

Publication number
US20140004790A1
US20140004790A1 US13/536,604 US201213536604A US2014004790A1 US 20140004790 A1 US20140004790 A1 US 20140004790A1 US 201213536604 A US201213536604 A US 201213536604A US 2014004790 A1 US2014004790 A1 US 2014004790A1
Authority
US
United States
Prior art keywords
normalized
satellite
terminal
peer group
deviation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/536,604
Other versions
US9197315B2 (en
Inventor
Jack Rozmaryn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hughes Network Systems LLC
Original Assignee
Hughes Network Systems LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hughes Network Systems LLC filed Critical Hughes Network Systems LLC
Priority to US13/536,604 priority Critical patent/US9197315B2/en
Assigned to HUGHES NETWORK SYSTEMS, LLC reassignment HUGHES NETWORK SYSTEMS, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ROZMARYN, JACK
Publication of US20140004790A1 publication Critical patent/US20140004790A1/en
Assigned to WELLS FARGO BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT reassignment WELLS FARGO BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HUGHES NETWORK SYSTEMS LLC
Priority to US14/949,397 priority patent/US9525478B2/en
Application granted granted Critical
Publication of US9197315B2 publication Critical patent/US9197315B2/en
Assigned to U.S. BANK NATIONAL ASSOCIATION reassignment U.S. BANK NATIONAL ASSOCIATION ASSIGNMENT OF PATENT SECURITY AGREEMENTS Assignors: WELLS FARGO BANK, NATIONAL ASSOCIATION
Assigned to U.S. BANK NATIONAL ASSOCIATION reassignment U.S. BANK NATIONAL ASSOCIATION CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION NUMBER 15649418 PREVIOUSLY RECORDED ON REEL 005600 FRAME 0314. ASSIGNOR(S) HEREBY CONFIRMS THE APPLICATION NUMBER 15649418. Assignors: WELLS FARGO, NATIONAL BANK ASSOCIATION
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B7/00Radio transmission systems, i.e. using radiation field
    • H04B7/14Relay systems
    • H04B7/15Active relay systems
    • H04B7/185Space-based or airborne stations; Stations for satellite systems
    • H04B7/1851Systems using a satellite or space-based relay
    • H04B7/18515Transmission equipment in satellites or space-based relays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B17/00Monitoring; Testing
    • H04B17/20Monitoring; Testing of receivers
    • H04B17/23Indication means, e.g. displays, alarms, audible means

Definitions

  • Wireless communication systems typically include a plurality of user terminals that are used by customers or end users which transmit and receive data from satellites and/or other antennas.
  • a satellite terminal is typically set up at the user location by a service technician or installer.
  • a user's home may have a satellite dish installed for receiving internet, telephone, and television service, or the like.
  • the satellite dish is installed with associated hardware, such as a transmitter, receiver, modem, router, set-top box, and the like.
  • the service technician configures the terminal for optimal use, for example, by correctly orienting the satellite dish, configuring all settings appropriately, and testing the terminal to ensure it is working properly before leaving the installation.
  • a customer of a satellite communication system has a problem with the service (e.g., service interruption, pixilation, slow internet)
  • the customer calls a customer service hotline and speaks with a customer service representative.
  • the customer service representative may attempt to diagnose the problem and determine if any repair is needed, or determine that the service interruption is caused by weather conditions or a regional service interruption.
  • Statistical measurement data from the satellite terminal may be obtained for analysis to determine if there is a problem.
  • this measured data may provide some insight that may confirm that a problem exists based on the customer inquiry.
  • this data is generally not as useful for detecting that a problem exists before the customer notices the problem and places an inquiry call.
  • a beam profile including a plurality of satellite beam characteristics is determined.
  • a peer group of satellite terminals is determined.
  • Terminal profiles with terminal characteristics for the satellite terminals in the peer group are determined.
  • a normalized baseline profile including normalized terminal characteristics for the peer group is determined.
  • Measured operational statistics of the satellite terminals in the peer group are received and converted into normalized operation statistics using the terminal profiles and the normalized baseline profile.
  • Normalized peer group operational statistics including a mean and a standard deviation of normalized operational statistics are determined.
  • a normalized deviation of the normalized operational statistics is determined for each satellite terminal. The normalized deviations for each satellite terminal are compared to a threshold deviation. Satellite terminals are diagnosed as good, degraded, or bad.
  • FIG. 1 is a high level block diagram of an example satellite communication system, according to an example embodiment of the present disclosure.
  • FIG. 2 is a high level block diagram of an example communication system, according to an example embodiment of the present disclosure.
  • FIG. 3 is a detailed block diagram of an example a computing device, according to an example embodiment of the present disclosure.
  • FIG. 4 is a block diagram of an example peer group diagnosis detection system, according to an example embodiment of the present disclosure.
  • FIG. 5 includes a flowchart illustrating an example process for peer group diagnosis detection, according to an example embodiment of the present disclosure.
  • FIG. 6 includes a scatter diagram illustrating an example data set for peer group diagnosis detection, according to an example embodiment of the present disclosure.
  • FIG. 1 A high level block diagram of an example satellite communication system 10 is illustrated in FIG. 1 .
  • the illustrated system 10 includes a satellite 20 and satellite terminals 30 , each including an antenna and associated hardware (e.g., receiver, transmitter, modem, router, computing device).
  • the satellite terminals 30 may transmit and receive data to and from the satellite 20 .
  • a satellite 20 receives data from a hub terminal 40 which is distributed to many satellite terminals 30 .
  • a satellite terminal 30 may communicate with one or more satellites 20 .
  • a satellite 20 may communicate with one or more hub terminals 40
  • a hub terminal 40 may communicate with one or more satellites 20 .
  • a satellite 20 communicates with each satellite terminal 30 using an uplink channel 51 and a downlink channel 52 , and also communicates with a satellite hub 40 using a downlink channel 53 and an uplink channel 54 .
  • the uplink channel 54 and downlink channel 52 may be referred to as a forward channel while the uplink channel 51 and downlink channel 53 may be referred to as a return channel.
  • the uplink channels 51 , 54 and downlink channels 52 , 53 typically each operate in different frequency bands and with totally independent circuitry. Accordingly, for example, a satellite terminal 30 typically may transmit data on the uplink channel 51 at a first frequency and receive data on the downlink channel 52 at a second frequency.
  • the performance of the uplink channel 51 and the downlink channel 52 are typically both separately evaluated in determining a site diagnosis, as uplink data and downlink data each provide insight into any problems which may exist for the satellite terminal 30 .
  • the satellite communication system 10 may be operating in any broadband network, for example, the K a band, the K u band, the C band, or the like.
  • satellite communication system 10 may be implemented on the SPACEWAY® and/or JUPITERTM platform. Accordingly, the system 10 may provide satellite coverage over a smaller area or larger area, for example, regional coverage may be dozens or hundreds of miles wide. Also, for example, the system 10 may provide continental coverage.
  • a satellite terminal 30 may have reception or transmission problems due to environmental issues such as inclement weather conditions. For example, rain fade is a common problem for certain frequency ranges (e.g., the K a band). Also, other interference sources, such as structures which may block a satellite terminal's 30 line of sight, may impede communication. Further, problems with terminal components and/or settings may cause signal degradation or failure. Components may fail or degrade for a variety of reasons (e.g., physical structural damage, short circuit). In some cases, a particular satellite terminal 30 may be experiencing multiple different problems simultaneously.
  • satellite terminals 30 which may also be known as user terminals, earth terminals, ground stations, antenna sites, or the like, may be referred to in the present application simply as terminals or sites.
  • customer service representative, customer service agent, and service agent may be used interchangeably in the present disclosure.
  • installer, service technician, repair technician, onsite technician and technician may be used interchangeably in the present disclosure.
  • customer, end user, and user may be used interchangeably in the present disclosure.
  • the present application may provide example embodiments relating to a satellite based communication system 10 as illustrated in FIG. 1 , however, the present disclosure may be similarly applicable to other wireless communication systems.
  • FIG. 2 A high level block diagram of an example network communications system 100 is illustrated in FIG. 2 .
  • the illustrated system 100 includes one or more client devices 102 , one or more host devices 104 , and one or more communication channels 106 (e.g., satellite communication).
  • the communication channels 106 include communication via the air interface between a hub terminal 40 and a satellite 20 , and the satellite 20 and a satellite terminal 30 .
  • the hub terminal 40 may communicate with a host device 104 (e.g., content provider) and the satellite terminal 30 may communicate with a client device 102 (e.g., personal computer).
  • a hub terminal 40 and/or satellite terminal 30 may communicate with devices and/or networks that are not satellite based systems or not wireless (e.g., a local area network).
  • the system 100 may include a variety of client devices 102 , such as desktop computers, televisions, and the like, which typically include a display 112 , which is a user display for providing information to users 114 , and various interface elements as will be discussed in further detail below.
  • a client device 102 may be a mobile device 103 , which may be a laptop computer, a tablet computer, a cellular phone, a personal digital assistant, etc.
  • the client devices 102 may communicate with the host device 104 via a connection to one or more communications channels 106 such as the Internet or some other data network, including, but not limited to, any suitable wide area network or local area network. It should be appreciated that any of the devices described herein may be directly connected to each other instead of over a network.
  • one or more servers 108 may be part of the network communications system 100 , and may communicate with host servers 104 and client devices 102 .
  • One host device 104 may interact with a large number of users 114 at a plurality of different client devices 102 . Accordingly, each host device 104 is typically a high end computer with a large storage capacity, one or more fast microprocessors, and one or more high speed network connections. Conversely, relative to a typical host device 104 , each typical client device 102 may often include less storage capacity, a single microprocessor, and a single network connection. It should be appreciated that a user 114 as described herein may include any customer, person, or entity which uses the presently disclosed system and may include a wide variety of parties for both business use and personal use.
  • host devices 104 and servers 108 store one or more of a plurality of files, programs, databases, and/or web pages in one or more memories for use by the client devices 102 , and/or other host devices 104 or servers 108 .
  • a host device 104 or server 108 may be configured according to its particular operating system, applications, memory, hardware, etc., and may provide various options for managing the execution of the programs and applications, as well as various administrative tasks.
  • a host device 104 or server may interact via one or more networks with one or more other host devices 104 or servers 108 , which may be operated independently. For example, host devices 104 and servers 108 operated by a separate and distinct entities may interact together according to some agreed upon protocol.
  • FIG. 3 A detailed block diagram of the electrical systems of an example computing device (e.g., a client device 102 , a host device 104 ) is illustrated in FIG. 3 .
  • the computing device 102 , 104 includes a main unit 202 which preferably includes one or more processors 204 electrically coupled by an address/data bus 206 to one or more memory devices 208 , other computer circuitry 210 , and one or more interface circuits 212 .
  • the processor 204 may be any suitable processor, such as a microprocessor from the INTEL PENTIUM® family of microprocessors.
  • the memory 208 preferably includes volatile memory and non-volatile memory.
  • the memory 208 stores a software program that interacts with the other devices in the system 100 as described below. This program may be executed by the processor 204 in any suitable manner.
  • memory 208 may be part of a “cloud” such that cloud computing may be utilized by a computing devices 102 , 104 .
  • the memory 208 may also store digital data indicative of documents, files, programs, web pages, etc. retrieved from a computing device 102 , 104 and/or loaded via an input device 214 .
  • the interface circuit 212 may be implemented using any suitable interface standard, such as an Ethernet interface and/or a Universal Serial Bus (USB) interface.
  • One or more input devices 214 may be connected to the interface circuit 212 for entering data and commands into the main unit 202 .
  • the input device 214 may be a keyboard, mouse, touch screen, remote control, track pad, track ball, isopoint, image sensor, character recognition, barcode scanner, microphone, and/or a speech or voice recognition system.
  • One or more displays 112 , printers, speakers, and/or other output devices 216 may also be connected to the main unit 202 via the interface circuit 212 .
  • the display 112 may be a cathode ray tube (CRTs), a liquid crystal display (LCD), or any other type of display.
  • the display 112 generates visual displays generated during operation of the computing device 102 , 104 .
  • the display 112 may provide a user interface that may display one or more web pages received from a computing device 102 , 104 .
  • a user interface may typically include prompts for human input from a user 114 including links, buttons, tabs, checkboxes, thumbnails, text fields, drop down boxes, etc., and may provide various outputs in response to the user inputs, such as text, still images, videos, audio, and animations.
  • One or more storage devices 218 may also be connected to the main unit 202 via the interface circuit 212 .
  • a hard drive, CD drive, DVD drive, and/or other storage devices may be connected to the main unit 202 .
  • the storage devices 218 may store any type of data, such as image data, video data, audio data, tag data, historical access or usage data, statistical data, security data, etc., which may be used by the computing device 102 , 104 .
  • Network devices 220 may include one or more servers 226 , which may be used to store certain types of data, and particularly large volumes of data which may be stored in one or more data repository 222 .
  • a server 226 may include any kind of data 224 including databases, programs, files, libraries, configuration data, index or tag data, historical access or usage data, statistical data, security data, etc.
  • a server 226 may store and operate various applications relating to receiving, transmitting, processing, and storing the large volumes of data. It should be appreciated that various configurations of one or more servers 226 may be used to support and maintain the system 100 . For example, servers 226 may be operated by various different entities.
  • the network connection may be any type of network connection, for example, wireless connection, satellite connection, Bluetooth connection, Ethernet connection, digital subscriber line (DSL), telephone line, coaxial cable, etc.
  • DSL digital subscriber line
  • FIG. 4 is a block diagram of an example peer group diagnosis detection system 400 .
  • the peer group diagnosis detection system 400 may include a peer group diagnostic information processing system 402 , a satellite 406 , a plurality of terminals 406 , and a peer group 408 .
  • the terminal diagnostic information processing system 402 include satellite system profile information 410 , a profile normalizing tool 412 , an operational statistics normalizing tool 414 , and a peer group diagnosis tool 416 . It should be appreciated that the respective diagram blocks of FIG. 4 may represent one or more physical devices for ease of understanding.
  • a peer group diagnosis detection information processing system 402 may be used, for example, by a company that provides satellite services, such as television, internet, telephone, etc., to customers, including home use customers, commercial businesses, and the like.
  • the peer group diagnosis detection information processing system 402 is used to detect problem terminals 406 by diagnosing terminals 406 within a peer group 408 , for example, as good, degraded, or bad.
  • the peer group diagnosis detection information processing system 402 may be implemented at a diagnostic center.
  • the satellite 404 may communicate with the peer group diagnosis detection information processing system 402 to provide data from terminals 406 in the peer group 408 .
  • the satellite 404 may communicate with the peer group diagnosis detection information processing system 402 and terminals 406 , for example, as discussed above. It should be appreciated that many terminals 406 (e.g., hundreds or thousands) may be part of a peer group 408 , and likewise, many satellites 406 and/or peer groups 408 may be included in a peer group diagnosis detection system 400 .
  • the peer group diagnosis detection information processing system 402 may include a database, files, or the like with satellite system profile information 410 .
  • the satellite system profile information typically includes satellite beam profiles, satellite terminal profiles, and various other information regarding satellites 404 and terminals 406 .
  • the satellite system profile information may be used to determine peer groups 408 .
  • a profile normalizing tool 412 may be used to normalize a baseline profile for a peer group 408 .
  • An operational statistics normalizing tool 414 may be used to normalize operational statistics (e.g., signal to noise ratio, symbol rate) which may be measured at terminals 406 of the peer group 408 .
  • a peer group diagnosis tool 416 is used to diagnose terminals 406 of the peer group 408 based on the normalized operational statistics.
  • FIG. 5 includes a flowchart of an example process 500 for peer group diagnosis detection.
  • the process 500 is described with reference to the flowchart illustrated in FIG. 5 , it will be appreciated that many other methods of performing the acts associated with the process 500 may be used. For example, the order of many of the blocks may be changed, many blocks may be intermittently repeated or continually performed, certain blocks may be combined with other blocks, and many of the blocks described are optional or may only be contingently performed.
  • a beam profile for a satellite beam may include characteristics such as carrier frequency, beam transmission power (e.g., Effective Isotropic Radiated Power or EIRP), the geolocation information on the beam including the center point or common point, the size and attenuation pattern of the beam, antenna gain, signal to noise ratio, modulation type, bit rate, tolerances, etc.
  • EIRP Effective Isotropic Radiated Power
  • a satellite beam is not uniform as measured from the ground, and that a common point generally located at the center of the beam may have the maximum downlink gain and maximum uplink sensitivity.
  • satellite beam may be part of a communication system operating in any broadband network, for example, using the K a band on the SPACEWAY® platform.
  • a peer group of satellite terminals is determined (block 504 ).
  • a peer group may include all the terminals using a particular beam and transponder.
  • a peer group may include all of the terminals located within a block defined by a certain upper and lower latitude and longitude. It should be appreciated that a peer group may be determined based on a variety of other factors, for example, geological structures, weather patterns, other boundaries, or the like.
  • a peer group may typically include hundreds or thousands of terminals.
  • Terminal profiles with terminal characteristics for the satellite terminals in the peer group are determined (block 506 ).
  • the terminal characteristics may include all relevant hardware specifications and the geolocation coordinates (e.g., latitude and longitude) and/or the location from the beam center (e.g., in radial ground distance or radial angle from the beam center).
  • Hardware specifications may include antenna type and size, a transmission power, an antenna gain, a signal to noise ratio, a symbol rate, and any other specifications relevant to the configuration of a terminal.
  • a normalized baseline profile including normalized terminal characteristics for the peer group is determined (block 508 ).
  • a normalized baseline profile may be determined as a specific hardware configuration at a specific location, such as at the beam center.
  • the hardware configuration may be a 1 watt transmitter, a 0.74 meter dish, a symbol rate of 256, etc.
  • the normalized baseline profile may typically represent a common hardware configuration at the beam center.
  • a terminal may have an expected uplink signal to noise ratio (Es/No) of approximately 15 dB and an expected downlink Es/No of approximately 22 dB. These expected Es/No values may represent an optimally configured terminal in optimal conditions.
  • terminals located away from the beam center may have attenuated Es/No values under optimal conditions even when optimally configured.
  • an installing technician may set up a terminal with all the proper equipment, proper align the antenna, etc., and if the terminal is near the edge of the satellite beam, the expected Es/No values may be lower, and thus, more susceptible to service interruptions from weather conditions or the like.
  • the optimal operational values e.g., downlink Es/No
  • a comparison of operational statistics between the different terminals is often of limited value.
  • Operational statistics of the satellite terminals in the peer group are measured and received (block 510 ). For example, any or all uplink and downlink statistics may be measured at the terminal, including any raw RF statistics or such as Es/No, G/T, transmission power, reception power or other data statistics such as symbol rate, CRC error rates, latency values, packet loss ratio, throughput speeds, or response times.
  • the operational statistics may be continuously measured or intermittently measured, for example, on a daily or hourly basis, or any other time interval.
  • the measured operational statistics may then be transmitted on a regular basis to a remote location for peer group diagnosis detection, for example, hourly, daily, weekly, or on a continuous basis.
  • the measured operational statistics are converted into normalized operation statistics using the terminal profiles and the normalized baseline profile (block 512 ). For example, each of the measured operational statistics is adjusted to normalize each terminal to the normalized baseline profile expected or measured operational statistics.
  • converting the measured uplink and downlink signal to noise ratios includes adjusting the measured values by adding an uplink normalization value and a downlink normalization value specific to each satellite terminal based on an antenna size, a transmission power, an antenna gain, and a distance from a satellite beam center point. Accordingly, once the measured operational statistics are converted into normalized operation statistics, the data represents a group of peer terminals that have the same equipment configuration and same location.
  • Normalized peer group operational statistics are determined including a mean and standard deviation of at least two of the normalized operational statistics (block 514 ).
  • the normalized peer group operational statistics may have an uplink mean Es/No of 12 dB, a downlink mean of Es/No of 17.5 dB, with an uplink Es/No standard deviation of 2, and a downlink Es/No standard deviation of 2.5.
  • a site count associated with the peer group is included with the normalized peer group operational statistics. It should be appreciated that the normalized peer group operational statistics may vary based on the particular communication system, the satellite and terminals, the frequency band, the antenna types, and various other variables.
  • determining peer group operational statistics from the terminal normalized operational statistics may include outlier removal, or other manipulation for statistical purposes. For example, any uplink or downlink signal to noise ratio that has a deviation greater than 1.3 standard deviations from the peer group mean may be removed from the data set to obtain a revised mean and standard deviation of the remaining terminals. Accordingly, any outliers may be removed to ensure that the normalized peer group operational statistics are representative of a normally functioning terminal. Also, other operational statistics besides the uplink and downlink signal to noise ratio may be normalized for the peer group in a similar fashion. For example, symbol rate, latency values, error rates, throughput speeds, signal strength, or any signal or performance quality metric, may advantageously be used as normalized peer group operational statistics, alone, or in conjunction with other statistics.
  • a normalized deviation of at least two operational statistics is determined for each satellite terminal (block 516 ).
  • a normalized uplink Es/No deviation and a normalized downlink Es/No deviation may be determined for each terminal in the peer group.
  • the normalized uplink and downlink Es/No deviations of a given terminal may be UL ⁇ 0.6 ⁇ and DL ⁇ 0.8 ⁇ .
  • the normalized deviation may be expressed in units other than standard deviations (a), for example, in decibels (dB).
  • the normalized deviations may be expressed, for example, as UL ⁇ 1.2 dB and DL ⁇ 20 dB instead of UL ⁇ 0.6 ⁇ and DL ⁇ 0.8 ⁇ .
  • each normalized uplink and downlink deviation may be compared to a threshold of ⁇ 2.5 ⁇ . In an example embodiment, each normalized uplink and downlink deviation may be compared to a threshold of ⁇ 4.0 ⁇ . It should be appreciated that a value of a threshold deviation may depend largely on the communication system. Also, multiple threshold deviations may used for comparison for each normalized deviation of each terminal, or each normalized deviation may only be compared to a single threshold deviation.
  • Each satellite terminal is diagnosed as good, degraded, or bad (block 520 ). For example, when a terminal's normalized uplink and downlink deviations are above the threshold of ⁇ 2.5 ⁇ , the terminal may be diagnosed as good or OK. When either of a terminal's normalized uplink and downlink deviations is below the threshold of ⁇ 4.0 ⁇ , the terminal may be diagnosed as bad, and likely in need of service. When either of a terminal's normalized uplink and downlink deviations is below the threshold of ⁇ 2.5 ⁇ , and both of a terminal's normalized uplink and downlink deviations are above the threshold of ⁇ 4.0 ⁇ , the terminal is diagnosed as degraded. As discussed below, FIG. 6 illustrates an example scatter diagram illustrating such an exemplary diagnosis of terminals.
  • the thresholds may be used to differentiate varying degrees of problem severity, such as by differentiating between merely degraded terminals and bad terminals.
  • a bad terminal may provide significant service interruptions while a degraded terminal may provide limited service interruptions which may not even be noticeable to the customer or a reduction in internet throughput speed and response times for both the uplink and downlink.
  • the threshold(s) may be adjusted for each communication system to provide a diagnosis as needed. For example, if a terminal is merely degraded, no action may be required, however, if the customer calls to complain about poor service, there is already data confirming that the service is not optimal and may be improved with a service call to optimize the terminal. Also, for example, if a terminal is bad, the service provider may contact the customer and schedule an appointment to repair and optimize the terminal, which may improve customer relations. In an example embodiment, newly installed terminals may have their performance validated to ensure that installation technicians are properly installing terminals.
  • FIG. 6 includes a scatter diagram 600 illustrating an example data set of terminal deviations for peer group diagnosis detection.
  • the scatter diagram 600 plots the normalized deviations for the satellite terminals of a peer group, with the x-axis representing the normalized uplink deviation and the y-axis representing the normalized downlink deviation, such that each data point illustrates the normalized uplink and downlink deviations for a satellite terminal.
  • the threshold deviations may be used to diagnose the terminals in the peer group as good, degraded, or bad.
  • FIG. 6 illustrates diagnosis zones 602 , 604 , 606 , which are presented on the two dimensional scatter diagram for ease of understanding.
  • the deviation thresholds of ⁇ 2.5 ⁇ and ⁇ 4.0 ⁇ separate the good zone 602 , the degraded zone 604 , and the bad zone 606 . Accordingly, terminals which have normalized deviations falling in the good zone 602 are diagnosed as good, terminals which have normalized deviations falling in the degraded zone 604 are diagnosed as degraded, and terminals which have normalized deviations falling in the bad zone 602 are diagnosed as bad. It should be appreciated that using a scatter diagram is not necessary to make a diagnosis, but FIG. 6 is informative in that it illustrates that the normalized deviations for the terminals in the peer group may be advantageously compared regardless of hardware configuration and location differences. Also, for example, using the normalized deviations provides for improved performance when a rain fade occurs within the peer group. Generally, the entire peer group will experience a signal degradation, so a properly working terminal will not show any degradation relative to the peer group because the peer group is being subjected to rain fade collectively, so there will typically not be any change in the normalized deviation.
  • the presently disclosed methods and systems may advantageously detect a problem before a customer notices any decline in service, thus improving customer service relations. For example, a customer may never need to call a customer service line to request that a problem be diagnosed because, before any decline in internet speed or television reception quality occurs, the problem is detected and diagnosed by the peer group diagnosis detection method and system. Further, the presently disclosed methods and systems may validate good installations of satellite terminals and minimize repair visits. It should be appreciated that, for example, the rate of unnecessary repair visits may be reduced to less than 0.01% of all repair visits. Accordingly, a great reduction in costs and improvement in customer service may be achieved using the presently disclosed peer group diagnosis detection method and system.
  • the present disclosure discusses a various examples relating to a satellite communication system.
  • the disclosed system, methods, and apparatus may be advantageously used in various different types of communication systems including, for example, systems that do not use satellites (e.g., a terrestrial point to point communication system).

Abstract

Systems and methods for peer group diagnosis detection are disclosed. In an example embodiment, a beam profile including a plurality of satellite beam characteristics is determined. A peer group of satellite terminals is determined. Terminal profiles with terminal characteristics for the satellite terminals in the peer group are determined. A normalized baseline profile including normalized terminal characteristics for the peer group is determined. Measured operational statistics of the satellite terminals in the peer group are received and converted into normalized operation statistics using the terminal profiles and the normalized baseline profile. Normalized peer group operational statistics including a mean and a standard deviation of normalized operational statistics are determined. A normalized deviation of the normalized operational statistics is determined for each satellite terminal. The normalized deviations for each satellite terminal are compared to a threshold deviation. Satellite terminals are diagnosed as good, degraded, or bad.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • The present application relates to the following co-pending patent applications: “Problem Signature Terminal Diagnosis Method and System,” filed on Jun. 28, 2012, Attorney Docket No. 0361913.01274, and “Terminal Diagnosis Self Correction Method and System,” filed on Jun. 28, 2012, Attorney Docket No. 0361913.01275, the entire contents of each of which are incorporated by reference herein.
  • BACKGROUND
  • Wireless communication systems typically include a plurality of user terminals that are used by customers or end users which transmit and receive data from satellites and/or other antennas. For a satellite based communication system, a satellite terminal is typically set up at the user location by a service technician or installer. For example, a user's home may have a satellite dish installed for receiving internet, telephone, and television service, or the like. The satellite dish is installed with associated hardware, such as a transmitter, receiver, modem, router, set-top box, and the like. The service technician configures the terminal for optimal use, for example, by correctly orienting the satellite dish, configuring all settings appropriately, and testing the terminal to ensure it is working properly before leaving the installation.
  • Typically, when a customer of a satellite communication system has a problem with the service (e.g., service interruption, pixilation, slow internet), the customer calls a customer service hotline and speaks with a customer service representative. The customer service representative may attempt to diagnose the problem and determine if any repair is needed, or determine that the service interruption is caused by weather conditions or a regional service interruption. Statistical measurement data from the satellite terminal may be obtained for analysis to determine if there is a problem. Typically, this measured data may provide some insight that may confirm that a problem exists based on the customer inquiry. However, this data is generally not as useful for detecting that a problem exists before the customer notices the problem and places an inquiry call.
  • SUMMARY
  • The present disclosure provides a new and innovative method and system for peer group diagnosis detection. In an example embodiment, a beam profile including a plurality of satellite beam characteristics is determined. A peer group of satellite terminals is determined. Terminal profiles with terminal characteristics for the satellite terminals in the peer group are determined. A normalized baseline profile including normalized terminal characteristics for the peer group is determined. Measured operational statistics of the satellite terminals in the peer group are received and converted into normalized operation statistics using the terminal profiles and the normalized baseline profile. Normalized peer group operational statistics including a mean and a standard deviation of normalized operational statistics are determined. A normalized deviation of the normalized operational statistics is determined for each satellite terminal. The normalized deviations for each satellite terminal are compared to a threshold deviation. Satellite terminals are diagnosed as good, degraded, or bad.
  • Additional features and advantages of the disclosed system, methods, and apparatus are described in, and will be apparent from, the following Detailed Description and the Figures.
  • BRIEF DESCRIPTION OF THE FIGURES
  • FIG. 1 is a high level block diagram of an example satellite communication system, according to an example embodiment of the present disclosure.
  • FIG. 2 is a high level block diagram of an example communication system, according to an example embodiment of the present disclosure.
  • FIG. 3 is a detailed block diagram of an example a computing device, according to an example embodiment of the present disclosure.
  • FIG. 4 is a block diagram of an example peer group diagnosis detection system, according to an example embodiment of the present disclosure.
  • FIG. 5 includes a flowchart illustrating an example process for peer group diagnosis detection, according to an example embodiment of the present disclosure.
  • FIG. 6 includes a scatter diagram illustrating an example data set for peer group diagnosis detection, according to an example embodiment of the present disclosure.
  • DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
  • A high level block diagram of an example satellite communication system 10 is illustrated in FIG. 1. The illustrated system 10 includes a satellite 20 and satellite terminals 30, each including an antenna and associated hardware (e.g., receiver, transmitter, modem, router, computing device). The satellite terminals 30 may transmit and receive data to and from the satellite 20. Typically, a satellite 20 receives data from a hub terminal 40 which is distributed to many satellite terminals 30. It should be appreciated that a satellite terminal 30 may communicate with one or more satellites 20. Similarly, a satellite 20 may communicate with one or more hub terminals 40, and a hub terminal 40 may communicate with one or more satellites 20. Typically, a satellite 20 communicates with each satellite terminal 30 using an uplink channel 51 and a downlink channel 52, and also communicates with a satellite hub 40 using a downlink channel 53 and an uplink channel 54. The uplink channel 54 and downlink channel 52 may be referred to as a forward channel while the uplink channel 51 and downlink channel 53 may be referred to as a return channel. It should be appreciated that the uplink channels 51, 54 and downlink channels 52, 53 typically each operate in different frequency bands and with totally independent circuitry. Accordingly, for example, a satellite terminal 30 typically may transmit data on the uplink channel 51 at a first frequency and receive data on the downlink channel 52 at a second frequency. For a satellite terminal 30, the performance of the uplink channel 51 and the downlink channel 52 are typically both separately evaluated in determining a site diagnosis, as uplink data and downlink data each provide insight into any problems which may exist for the satellite terminal 30.
  • It should be appreciated that in order for a satellite 20 to communicate with a satellite terminal 30, the satellite terminal 30 must be configured correctly with a proper line of sight to the satellite 20. The satellite communication system 10 may be operating in any broadband network, for example, the Ka band, the Ku band, the C band, or the like. For example, satellite communication system 10 may be implemented on the SPACEWAY® and/or JUPITER™ platform. Accordingly, the system 10 may provide satellite coverage over a smaller area or larger area, for example, regional coverage may be dozens or hundreds of miles wide. Also, for example, the system 10 may provide continental coverage.
  • If the antenna alignment of the satellite terminal 30 is not within a certain tolerance, transmission and/or reception of data may degrade and/or fail. However, even with proper antenna alignment, a satellite terminal 30 may have reception or transmission problems due to environmental issues such as inclement weather conditions. For example, rain fade is a common problem for certain frequency ranges (e.g., the Ka band). Also, other interference sources, such as structures which may block a satellite terminal's 30 line of sight, may impede communication. Further, problems with terminal components and/or settings may cause signal degradation or failure. Components may fail or degrade for a variety of reasons (e.g., physical structural damage, short circuit). In some cases, a particular satellite terminal 30 may be experiencing multiple different problems simultaneously. Moreover, there are many potential causes of suboptimal communication for a satellite terminal 30, and it is often difficult to correctly diagnose the specific problem or problems a satellite terminal 30 may need corrected. Accordingly, for an operator of a satellite communication system 10, it may be highly advantageous to improve the accuracy of terminal diagnosis when a satellite terminal 30 is experiencing a problem with service. Also, it may be advantageous to detect a problem before a customer notices any interruption or decline in service quality.
  • It should be appreciated that satellite terminals 30, which may also be known as user terminals, earth terminals, ground stations, antenna sites, or the like, may be referred to in the present application simply as terminals or sites. Similarly, the terms customer service representative, customer service agent, and service agent may be used interchangeably in the present disclosure. Likewise, installer, service technician, repair technician, onsite technician and technician may be used interchangeably in the present disclosure. Also, customer, end user, and user may be used interchangeably in the present disclosure. Further, it should be appreciated that, the present application may provide example embodiments relating to a satellite based communication system 10 as illustrated in FIG. 1, however, the present disclosure may be similarly applicable to other wireless communication systems.
  • A high level block diagram of an example network communications system 100 is illustrated in FIG. 2. The illustrated system 100 includes one or more client devices 102, one or more host devices 104, and one or more communication channels 106 (e.g., satellite communication). In a satellite communication system 10, the communication channels 106 include communication via the air interface between a hub terminal 40 and a satellite 20, and the satellite 20 and a satellite terminal 30. Also, for example, the hub terminal 40 may communicate with a host device 104 (e.g., content provider) and the satellite terminal 30 may communicate with a client device 102 (e.g., personal computer). Likewise, a hub terminal 40 and/or satellite terminal 30 may communicate with devices and/or networks that are not satellite based systems or not wireless (e.g., a local area network).
  • The system 100 may include a variety of client devices 102, such as desktop computers, televisions, and the like, which typically include a display 112, which is a user display for providing information to users 114, and various interface elements as will be discussed in further detail below. A client device 102 may be a mobile device 103, which may be a laptop computer, a tablet computer, a cellular phone, a personal digital assistant, etc. The client devices 102 may communicate with the host device 104 via a connection to one or more communications channels 106 such as the Internet or some other data network, including, but not limited to, any suitable wide area network or local area network. It should be appreciated that any of the devices described herein may be directly connected to each other instead of over a network. Typically, one or more servers 108 may be part of the network communications system 100, and may communicate with host servers 104 and client devices 102.
  • One host device 104 may interact with a large number of users 114 at a plurality of different client devices 102. Accordingly, each host device 104 is typically a high end computer with a large storage capacity, one or more fast microprocessors, and one or more high speed network connections. Conversely, relative to a typical host device 104, each typical client device 102 may often include less storage capacity, a single microprocessor, and a single network connection. It should be appreciated that a user 114 as described herein may include any customer, person, or entity which uses the presently disclosed system and may include a wide variety of parties for both business use and personal use.
  • Typically, host devices 104 and servers 108 store one or more of a plurality of files, programs, databases, and/or web pages in one or more memories for use by the client devices 102, and/or other host devices 104 or servers 108. A host device 104 or server 108 may be configured according to its particular operating system, applications, memory, hardware, etc., and may provide various options for managing the execution of the programs and applications, as well as various administrative tasks. A host device 104 or server may interact via one or more networks with one or more other host devices 104 or servers 108, which may be operated independently. For example, host devices 104 and servers 108 operated by a separate and distinct entities may interact together according to some agreed upon protocol.
  • A detailed block diagram of the electrical systems of an example computing device (e.g., a client device 102, a host device 104) is illustrated in FIG. 3. In this example, the computing device 102, 104 includes a main unit 202 which preferably includes one or more processors 204 electrically coupled by an address/data bus 206 to one or more memory devices 208, other computer circuitry 210, and one or more interface circuits 212. The processor 204 may be any suitable processor, such as a microprocessor from the INTEL PENTIUM® family of microprocessors. The memory 208 preferably includes volatile memory and non-volatile memory. Preferably, the memory 208 stores a software program that interacts with the other devices in the system 100 as described below. This program may be executed by the processor 204 in any suitable manner. In an example embodiment, memory 208 may be part of a “cloud” such that cloud computing may be utilized by a computing devices 102, 104. The memory 208 may also store digital data indicative of documents, files, programs, web pages, etc. retrieved from a computing device 102, 104 and/or loaded via an input device 214.
  • The interface circuit 212 may be implemented using any suitable interface standard, such as an Ethernet interface and/or a Universal Serial Bus (USB) interface. One or more input devices 214 may be connected to the interface circuit 212 for entering data and commands into the main unit 202. For example, the input device 214 may be a keyboard, mouse, touch screen, remote control, track pad, track ball, isopoint, image sensor, character recognition, barcode scanner, microphone, and/or a speech or voice recognition system.
  • One or more displays 112, printers, speakers, and/or other output devices 216 may also be connected to the main unit 202 via the interface circuit 212. The display 112 may be a cathode ray tube (CRTs), a liquid crystal display (LCD), or any other type of display. The display 112 generates visual displays generated during operation of the computing device 102, 104. For example, the display 112 may provide a user interface that may display one or more web pages received from a computing device 102, 104. A user interface may typically include prompts for human input from a user 114 including links, buttons, tabs, checkboxes, thumbnails, text fields, drop down boxes, etc., and may provide various outputs in response to the user inputs, such as text, still images, videos, audio, and animations.
  • One or more storage devices 218 may also be connected to the main unit 202 via the interface circuit 212. For example, a hard drive, CD drive, DVD drive, and/or other storage devices may be connected to the main unit 202. The storage devices 218 may store any type of data, such as image data, video data, audio data, tag data, historical access or usage data, statistical data, security data, etc., which may be used by the computing device 102, 104.
  • The computing device 102, 104 may also exchange data with other network devices 220 via a connection to communication channel 106. Network devices 220 may include one or more servers 226, which may be used to store certain types of data, and particularly large volumes of data which may be stored in one or more data repository 222. A server 226 may include any kind of data 224 including databases, programs, files, libraries, configuration data, index or tag data, historical access or usage data, statistical data, security data, etc. A server 226 may store and operate various applications relating to receiving, transmitting, processing, and storing the large volumes of data. It should be appreciated that various configurations of one or more servers 226 may be used to support and maintain the system 100. For example, servers 226 may be operated by various different entities. Also, certain data may be stored in a client device 102 which is also stored on the server 226, either temporarily or permanently, for example in memory 208 or storage device 218. The network connection may be any type of network connection, for example, wireless connection, satellite connection, Bluetooth connection, Ethernet connection, digital subscriber line (DSL), telephone line, coaxial cable, etc.
  • FIG. 4 is a block diagram of an example peer group diagnosis detection system 400. The peer group diagnosis detection system 400 may include a peer group diagnostic information processing system 402, a satellite 406, a plurality of terminals 406, and a peer group 408. The terminal diagnostic information processing system 402 include satellite system profile information 410, a profile normalizing tool 412, an operational statistics normalizing tool 414, and a peer group diagnosis tool 416. It should be appreciated that the respective diagram blocks of FIG. 4 may represent one or more physical devices for ease of understanding.
  • A peer group diagnosis detection information processing system 402 may be used, for example, by a company that provides satellite services, such as television, internet, telephone, etc., to customers, including home use customers, commercial businesses, and the like. The peer group diagnosis detection information processing system 402 is used to detect problem terminals 406 by diagnosing terminals 406 within a peer group 408, for example, as good, degraded, or bad. The peer group diagnosis detection information processing system 402 may be implemented at a diagnostic center. The satellite 404 may communicate with the peer group diagnosis detection information processing system 402 to provide data from terminals 406 in the peer group 408. The satellite 404 may communicate with the peer group diagnosis detection information processing system 402 and terminals 406, for example, as discussed above. It should be appreciated that many terminals 406 (e.g., hundreds or thousands) may be part of a peer group 408, and likewise, many satellites 406 and/or peer groups 408 may be included in a peer group diagnosis detection system 400.
  • The peer group diagnosis detection information processing system 402 may include a database, files, or the like with satellite system profile information 410. The satellite system profile information typically includes satellite beam profiles, satellite terminal profiles, and various other information regarding satellites 404 and terminals 406. The satellite system profile information may be used to determine peer groups 408. A profile normalizing tool 412 may be used to normalize a baseline profile for a peer group 408. An operational statistics normalizing tool 414 may be used to normalize operational statistics (e.g., signal to noise ratio, symbol rate) which may be measured at terminals 406 of the peer group 408. A peer group diagnosis tool 416 is used to diagnose terminals 406 of the peer group 408 based on the normalized operational statistics.
  • FIG. 5 includes a flowchart of an example process 500 for peer group diagnosis detection. Although the process 500 is described with reference to the flowchart illustrated in FIG. 5, it will be appreciated that many other methods of performing the acts associated with the process 500 may be used. For example, the order of many of the blocks may be changed, many blocks may be intermittently repeated or continually performed, certain blocks may be combined with other blocks, and many of the blocks described are optional or may only be contingently performed.
  • The example process 500 may begin when a beam profile with a plurality of satellite beam characteristics is determined (block 502). For example, a beam profile for a satellite beam may include characteristics such as carrier frequency, beam transmission power (e.g., Effective Isotropic Radiated Power or EIRP), the geolocation information on the beam including the center point or common point, the size and attenuation pattern of the beam, antenna gain, signal to noise ratio, modulation type, bit rate, tolerances, etc. It should be appreciated that a satellite beam is not uniform as measured from the ground, and that a common point generally located at the center of the beam may have the maximum downlink gain and maximum uplink sensitivity. In an example embodiment, satellite beam may be part of a communication system operating in any broadband network, for example, using the Ka band on the SPACEWAY® platform.
  • A peer group of satellite terminals is determined (block 504). For example, a peer group may include all the terminals using a particular beam and transponder. Also, for example, if a beam has a large coverage area, a peer group may include all of the terminals located within a block defined by a certain upper and lower latitude and longitude. It should be appreciated that a peer group may be determined based on a variety of other factors, for example, geological structures, weather patterns, other boundaries, or the like. A peer group may typically include hundreds or thousands of terminals.
  • Terminal profiles with terminal characteristics for the satellite terminals in the peer group are determined (block 506). For example, for each terminal, the terminal characteristics may include all relevant hardware specifications and the geolocation coordinates (e.g., latitude and longitude) and/or the location from the beam center (e.g., in radial ground distance or radial angle from the beam center). Hardware specifications may include antenna type and size, a transmission power, an antenna gain, a signal to noise ratio, a symbol rate, and any other specifications relevant to the configuration of a terminal.
  • A normalized baseline profile including normalized terminal characteristics for the peer group is determined (block 508). For example, a normalized baseline profile may be determined as a specific hardware configuration at a specific location, such as at the beam center. For example, the hardware configuration may be a 1 watt transmitter, a 0.74 meter dish, a symbol rate of 256, etc. It should be appreciated that the normalized baseline profile may typically represent a common hardware configuration at the beam center. In an example embodiment, at the center of the beam, a terminal may have an expected uplink signal to noise ratio (Es/No) of approximately 15 dB and an expected downlink Es/No of approximately 22 dB. These expected Es/No values may represent an optimally configured terminal in optimal conditions. However, terminals located away from the beam center may have attenuated Es/No values under optimal conditions even when optimally configured. For example, an installing technician may set up a terminal with all the proper equipment, proper align the antenna, etc., and if the terminal is near the edge of the satellite beam, the expected Es/No values may be lower, and thus, more susceptible to service interruptions from weather conditions or the like. Because the optimal operational values (e.g., downlink Es/No) are different for terminals with different hardware configurations and/or locations, a comparison of operational statistics between the different terminals is often of limited value.
  • Operational statistics of the satellite terminals in the peer group are measured and received (block 510). For example, any or all uplink and downlink statistics may be measured at the terminal, including any raw RF statistics or such as Es/No, G/T, transmission power, reception power or other data statistics such as symbol rate, CRC error rates, latency values, packet loss ratio, throughput speeds, or response times. The operational statistics may be continuously measured or intermittently measured, for example, on a daily or hourly basis, or any other time interval. The measured operational statistics may then be transmitted on a regular basis to a remote location for peer group diagnosis detection, for example, hourly, daily, weekly, or on a continuous basis.
  • The measured operational statistics are converted into normalized operation statistics using the terminal profiles and the normalized baseline profile (block 512). For example, each of the measured operational statistics is adjusted to normalize each terminal to the normalized baseline profile expected or measured operational statistics. In an example embodiment, converting the measured uplink and downlink signal to noise ratios includes adjusting the measured values by adding an uplink normalization value and a downlink normalization value specific to each satellite terminal based on an antenna size, a transmission power, an antenna gain, and a distance from a satellite beam center point. Accordingly, once the measured operational statistics are converted into normalized operation statistics, the data represents a group of peer terminals that have the same equipment configuration and same location. For example, if a transmitting power of a terminal is less than the transmitting power of the transmitting power of the normalized baseline profile, a value to account for this difference may be added to the uplink Es/No. Similarly, if a terminal is 50 miles from the center the satellite beam, a value accounting for this difference may be added to the uplink and downlink Es/No. Thus, all the terminals normalized operation statistics should generally be the same, except for variations due to varying cable lengths, equipment variations, measurement errors, and other various interference, which would typically be relatively minor. Thus, when a terminal's normalized operation statistics deviate beyond the ordinary variation levels, a problem is indicated.
  • Normalized peer group operational statistics are determined including a mean and standard deviation of at least two of the normalized operational statistics (block 514). For example, the normalized peer group operational statistics may have an uplink mean Es/No of 12 dB, a downlink mean of Es/No of 17.5 dB, with an uplink Es/No standard deviation of 2, and a downlink Es/No standard deviation of 2.5. In an example embodiment, a site count associated with the peer group is included with the normalized peer group operational statistics. It should be appreciated that the normalized peer group operational statistics may vary based on the particular communication system, the satellite and terminals, the frequency band, the antenna types, and various other variables. It should be appreciated that determining peer group operational statistics from the terminal normalized operational statistics may include outlier removal, or other manipulation for statistical purposes. For example, any uplink or downlink signal to noise ratio that has a deviation greater than 1.3 standard deviations from the peer group mean may be removed from the data set to obtain a revised mean and standard deviation of the remaining terminals. Accordingly, any outliers may be removed to ensure that the normalized peer group operational statistics are representative of a normally functioning terminal. Also, other operational statistics besides the uplink and downlink signal to noise ratio may be normalized for the peer group in a similar fashion. For example, symbol rate, latency values, error rates, throughput speeds, signal strength, or any signal or performance quality metric, may advantageously be used as normalized peer group operational statistics, alone, or in conjunction with other statistics.
  • A normalized deviation of at least two operational statistics is determined for each satellite terminal (block 516). For example, using the normalized peer group operational statistics, a normalized uplink Es/No deviation and a normalized downlink Es/No deviation may be determined for each terminal in the peer group. For example, the normalized uplink and downlink Es/No deviations of a given terminal may be UL −0.6σ and DL −0.8σ. It should be appreciated that the normalized deviation may be expressed in units other than standard deviations (a), for example, in decibels (dB). In this example embodiment, the normalized deviations may be expressed, for example, as UL −1.2 dB and DL −20 dB instead of UL −0.6σ and DL −0.8σ. Other typical examples of normalized deviations for terminals in the example peer group may be as follows: UL −1.5σ and DL −0.2σ; UL −2.1σ and DL +0.4σ; UL +1.2σ and DL −0.5 a; UL +0.3σ and DL +1.1σ.
  • The normalized deviations for each satellite terminal are compared to a threshold deviation (block 518). In an example embodiment, each normalized uplink and downlink deviation may be compared to a threshold of −2.5σ. In an example embodiment, each normalized uplink and downlink deviation may be compared to a threshold of −4.0σ. It should be appreciated that a value of a threshold deviation may depend largely on the communication system. Also, multiple threshold deviations may used for comparison for each normalized deviation of each terminal, or each normalized deviation may only be compared to a single threshold deviation.
  • Each satellite terminal is diagnosed as good, degraded, or bad (block 520). For example, when a terminal's normalized uplink and downlink deviations are above the threshold of −2.5σ, the terminal may be diagnosed as good or OK. When either of a terminal's normalized uplink and downlink deviations is below the threshold of −4.0σ, the terminal may be diagnosed as bad, and likely in need of service. When either of a terminal's normalized uplink and downlink deviations is below the threshold of −2.5σ, and both of a terminal's normalized uplink and downlink deviations are above the threshold of −4.0σ, the terminal is diagnosed as degraded. As discussed below, FIG. 6 illustrates an example scatter diagram illustrating such an exemplary diagnosis of terminals. It should be appreciated that the thresholds may be used to differentiate varying degrees of problem severity, such as by differentiating between merely degraded terminals and bad terminals. Typically, for example, a bad terminal may provide significant service interruptions while a degraded terminal may provide limited service interruptions which may not even be noticeable to the customer or a reduction in internet throughput speed and response times for both the uplink and downlink. However, the threshold(s) may be adjusted for each communication system to provide a diagnosis as needed. For example, if a terminal is merely degraded, no action may be required, however, if the customer calls to complain about poor service, there is already data confirming that the service is not optimal and may be improved with a service call to optimize the terminal. Also, for example, if a terminal is bad, the service provider may contact the customer and schedule an appointment to repair and optimize the terminal, which may improve customer relations. In an example embodiment, newly installed terminals may have their performance validated to ensure that installation technicians are properly installing terminals.
  • FIG. 6 includes a scatter diagram 600 illustrating an example data set of terminal deviations for peer group diagnosis detection. The scatter diagram 600 plots the normalized deviations for the satellite terminals of a peer group, with the x-axis representing the normalized uplink deviation and the y-axis representing the normalized downlink deviation, such that each data point illustrates the normalized uplink and downlink deviations for a satellite terminal. As discussed above, the threshold deviations may be used to diagnose the terminals in the peer group as good, degraded, or bad. FIG. 6 illustrates diagnosis zones 602, 604, 606, which are presented on the two dimensional scatter diagram for ease of understanding. The deviation thresholds of −2.5σ and −4.0σ separate the good zone 602, the degraded zone 604, and the bad zone 606. Accordingly, terminals which have normalized deviations falling in the good zone 602 are diagnosed as good, terminals which have normalized deviations falling in the degraded zone 604 are diagnosed as degraded, and terminals which have normalized deviations falling in the bad zone 602 are diagnosed as bad. It should be appreciated that using a scatter diagram is not necessary to make a diagnosis, but FIG. 6 is informative in that it illustrates that the normalized deviations for the terminals in the peer group may be advantageously compared regardless of hardware configuration and location differences. Also, for example, using the normalized deviations provides for improved performance when a rain fade occurs within the peer group. Generally, the entire peer group will experience a signal degradation, so a properly working terminal will not show any degradation relative to the peer group because the peer group is being subjected to rain fade collectively, so there will typically not be any change in the normalized deviation.
  • Accordingly, the presently disclosed methods and systems may advantageously detect a problem before a customer notices any decline in service, thus improving customer service relations. For example, a customer may never need to call a customer service line to request that a problem be diagnosed because, before any decline in internet speed or television reception quality occurs, the problem is detected and diagnosed by the peer group diagnosis detection method and system. Further, the presently disclosed methods and systems may validate good installations of satellite terminals and minimize repair visits. It should be appreciated that, for example, the rate of unnecessary repair visits may be reduced to less than 0.01% of all repair visits. Accordingly, a great reduction in costs and improvement in customer service may be achieved using the presently disclosed peer group diagnosis detection method and system.
  • For exemplary purposes, the present disclosure discusses a various examples relating to a satellite communication system. However, it should be appreciated that the disclosed system, methods, and apparatus may be advantageously used in various different types of communication systems including, for example, systems that do not use satellites (e.g., a terrestrial point to point communication system).
  • It will be appreciated that all of the disclosed methods and procedures described herein can be implemented using one or more computer programs or components. These components may be provided as a series of computer instructions on any conventional computer readable medium, including RAM, ROM, flash memory, magnetic or optical disks, optical memory, or other storage media. The instructions may be configured to be executed by a processor, which when executing the series of computer instructions performs or facilitates the performance of all or part of the disclosed methods and procedures.
  • It should be understood that various changes and modifications to the example embodiments described herein will be apparent to those skilled in the art. Such changes and modifications can be made without departing from the spirit and scope of the present subject matter and without diminishing its intended advantages. It is therefore intended that such changes and modifications be covered by the appended claims. Also, it should be appreciated that the features of the dependent claims may be embodied in the systems, methods, and apparatus of each of the independent claims.

Claims (20)

The invention is claimed as follows:
1. A method comprising:
determining a beam profile including a plurality of satellite beam characteristics;
determining a peer group of satellite terminals;
determining terminal profiles for the satellite terminals, each terminal profile including a plurality of terminal characteristics;
determining a normalized baseline profile for the peer group, the normalized baseline profile including a plurality of normalized terminal characteristics;
receiving measured operational statistics of the satellite terminals in the peer group;
converting the measured operational statistics into normalized operation statistics using the terminal profiles and the normalized baseline profile;
determining normalized peer group operational statistics including at least a mean and a standard deviation of at least two normalized operational statistics;
determining, for each satellite terminal, a normalized deviation of the at least two normalized operational statistics;
comparing the normalized deviations for each satellite terminal to a threshold deviation; and
diagnosing each satellite terminal as at least one of good, degraded, and bad.
2. The method of claim 1, wherein the beam characteristics include effective isotropic radiated power, antenna gain, signal to noise ratio, geographic beam profile, carrier frequency, and modulation type.
3. The method of claim 1, wherein the peer group includes all satellite terminals on a beam.
4. The method of claim 1, wherein the peer group includes all satellite terminals within a geographical area defined by a set of latitudes and longitudes.
5. The method of claim 1, wherein each terminal profile includes an antenna size and type, a transmission power, an antenna gain, a signal to noise ratio, a symbol rate, and a geolocation.
6. The method of claim 1, wherein operational statistics include at least a reception power, a transmission power, a signal to noise ratio, an error rate, and a latency value.
7. The method of claim 1, wherein the operational statistics include at least an uplink signal to noise ratio and a downlink signal to noise ratio.
8. The method of claim 7, wherein converting the measured uplink and downlink signal to noise ratios includes adjusting the measured values by adding an uplink normalization value and a downlink normalization value specific to each satellite terminal based on at least, an antenna size, a transmission power, an antenna gain, and a distance from a satellite beam center point.
9. The method of claim 7, wherein the normalized peer group operational statistics include at least a mean and a standard deviation for each of the uplink signal to noise ratio and the downlink signal to noise ratio.
10. The method of claim 9, wherein for each satellite terminal, the normalized deviation for each of the uplink signal to noise ratio and the downlink signal to noise ratio are determined and compared to a threshold uplink deviation and a threshold downlink deviation.
11. The method of claim 10, wherein the normalized deviation for each of the uplink signal to noise ratio and the downlink signal to noise ratio is represented in units of standard deviations.
12. The method of claim 1, wherein measuring operational statistics occurs at least one of continuously and on a regular time interval to provide an updated diagnosis using updated operational statistics.
13. A system comprising:
a computer readable medium storing satellite profile information; and
at least one processing device operably coupled to the computer readable medium, the at least one processing device executing instructions to:
determine a beam profile including a plurality of satellite beam characteristics;
determine a peer group of satellite terminals;
determine terminal profiles for the satellite terminals, each terminal profile including a plurality of terminal characteristics;
determine a normalized baseline profile for the peer group, the normalized baseline profile including a plurality of normalized terminal characteristics;
receive measured operational statistics of the satellite terminals in the peer group;
convert the measured operational statistics into normalized operation statistics using the terminal profiles and the normalized baseline profile;
determine normalized peer group operational statistics including at least a mean and a standard deviation of at least two normalized operational statistics;
determine, for each satellite terminal, a normalized deviation of the at least two normalized operational statistics;
compare the normalized deviations for each satellite terminal to a threshold deviation; and
diagnose each satellite terminal as at least one of good, degraded, and bad.
14. The system of claim 13, wherein the operational statistics include at least an uplink signal to noise ratio and a downlink signal to noise ratio.
15. The system of claim 14, wherein converting the measured uplink and downlink signal to noise ratios includes adjusting the measured values by adding an uplink normalization value and a downlink normalization value specific to each satellite terminal based on at least, an antenna size, a transmission power, an antenna gain, and a distance from a satellite beam center point.
16. The system of claim 14, wherein the normalized peer group operational statistics include at least a mean and a standard deviation for each of the uplink signal to noise ratio and the downlink signal to noise ratio, and for each satellite terminal, the normalized deviation for each of the uplink signal to noise ratio and the downlink signal to noise ratio are determined and compared to a threshold uplink deviation and a threshold downlink deviation.
17. The system of claim 12, wherein a satellite beam profile indicates at least one of operation in the Ka band and the Ku band.
18. A method comprising:
determining a beam profile including a plurality of satellite beam characteristics;
determining a peer group of satellite terminals;
determining terminal profiles for the satellite terminals, each terminal profile including a plurality of terminal characteristics;
determining a normalized baseline profile for the peer group, the normalized baseline profile including a plurality of normalized terminal characteristics;
determining at least one normalized peer group operational statistic including at least a mean and a standard deviation of the at least one normalized operational statistic;
receiving measured at least one operational statistic of at least one satellite terminal in the peer group;
converting the measured at least one operational statistic into a normalized operation statistic using the terminal profile for the at least one satellite terminal and the normalized baseline profile;
determining, for the at least one satellite terminal, a normalized deviation of the at least one normalized operational statistic;
comparing the normalized deviation for the at least one satellite terminal to a threshold deviation; and
diagnosing the at least one satellite terminal as at least one of good, degraded, and bad.
19. The method of claim 18, wherein the at least one normalized operational statistic is uplink signal to noise ratio.
20. The method of claim 18, wherein the at least one normalized operational statistic is downlink signal to noise ratio.
US13/536,604 2012-06-28 2012-06-28 Peer group diagnosis detection method and system Active 2033-04-20 US9197315B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/536,604 US9197315B2 (en) 2012-06-28 2012-06-28 Peer group diagnosis detection method and system
US14/949,397 US9525478B2 (en) 2012-06-28 2015-11-23 Peer group diagnosis detection method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/536,604 US9197315B2 (en) 2012-06-28 2012-06-28 Peer group diagnosis detection method and system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/949,397 Continuation US9525478B2 (en) 2012-06-28 2015-11-23 Peer group diagnosis detection method and system

Publications (2)

Publication Number Publication Date
US20140004790A1 true US20140004790A1 (en) 2014-01-02
US9197315B2 US9197315B2 (en) 2015-11-24

Family

ID=49778603

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/536,604 Active 2033-04-20 US9197315B2 (en) 2012-06-28 2012-06-28 Peer group diagnosis detection method and system
US14/949,397 Active US9525478B2 (en) 2012-06-28 2015-11-23 Peer group diagnosis detection method and system

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/949,397 Active US9525478B2 (en) 2012-06-28 2015-11-23 Peer group diagnosis detection method and system

Country Status (1)

Country Link
US (2) US9197315B2 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140120830A1 (en) * 2012-11-01 2014-05-01 Hughes Network Systems, Llc Real-time signal validation method and system
US9197315B2 (en) 2012-06-28 2015-11-24 Hughes Network Systems, Llc Peer group diagnosis detection method and system
US9294203B2 (en) 2012-06-28 2016-03-22 Hughes Network Systems, Llc Problem signature terminal diagnosis method and system
US9350467B2 (en) 2012-06-28 2016-05-24 Hughes Network Systems, Llc Terminal diagnosis self correction method and system
US10362095B2 (en) * 2016-11-04 2019-07-23 Airwatch Llc Distributed network diagnostics of enterprise devices utilizing device management

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6445916B1 (en) * 1999-01-07 2002-09-03 Lucent Technologies Inc. Wireless system and method for evaluating quality of service
US20030054816A1 (en) * 2001-09-20 2003-03-20 Krebs Lawrence W. Methods and apparatus for mitigating rain fading over satcom links via information throughput adaptation
US6771929B1 (en) * 2000-10-20 2004-08-03 Northrop Grumman Corporation Satellite communication system threshold leveling techniques
US6847817B2 (en) * 2001-12-12 2005-01-25 Northrop Grumman Corporation Satellite communication apparatus with multiple hub stations providing increased bandwidth to meet service requirements
US20060084377A1 (en) * 2004-09-10 2006-04-20 Samsung Electronics Co., Ltd. Method for controlling broadcasting signal transmission in wireless communication system providing broadcasting service and corresponding system
US20080055152A1 (en) * 2006-08-29 2008-03-06 Wildblue Communications, Inc. Network-access satellite communication system
US20100150017A1 (en) * 2007-08-23 2010-06-17 Kt Corporation Device and method for link balancing detection
US20110143654A1 (en) * 2009-06-15 2011-06-16 Viasat, Inc. Link performance difference metrics and link adaptation for mesh satellite networks

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5878329A (en) 1990-03-19 1999-03-02 Celsat America, Inc. Power control of an integrated cellular communications system
US5491791A (en) 1995-01-13 1996-02-13 International Business Machines Corporation System and method for remote workstation monitoring within a distributed computing environment
US5974032A (en) 1997-05-19 1999-10-26 Motorola, Inc. Method and apparatus for adjusting data rate in a synchronous communication system
US6078810A (en) 1997-06-12 2000-06-20 Motorola, Inc. Multiple-tier satelite communication system and method of operation thereof
US6337658B1 (en) 1999-11-30 2002-01-08 Nortel Networks Limited Transmit antenna alignment peak search method and apparatus
US6476764B2 (en) 2000-09-29 2002-11-05 Hughes Electronics Corporation Post-installation monitoring method for a satellite terminal antenna
US20040236843A1 (en) 2001-11-15 2004-11-25 Robert Wing Online diagnosing of computer hardware and software
US20020137457A1 (en) 2001-03-23 2002-09-26 Nivens Dennis A. Satellite communication system uplink power control
DE60128152D1 (en) 2001-06-19 2007-06-06 Stratos Wireless Inc DIPLEXER SWITCHING / CIRCUIT WITH MODEM FUNCTION
US20030050015A1 (en) 2001-09-10 2003-03-13 Frank Kelly Automated signal measurement in a satellite communication system
US20040199573A1 (en) 2002-10-31 2004-10-07 Predictive Systems Engineering, Ltd. System and method for remote diagnosis of distributed objects
US7266726B1 (en) 2003-11-24 2007-09-04 Time Warner Cable Inc. Methods and apparatus for event logging in an information network
FR2883086B1 (en) 2005-03-11 2007-05-04 Alcatel Sa DEVICE FOR OPTIMIZING DIAGNOSTIC TREES OF A DIAGNOSTIC TOOL OF A COMMUNICATION NETWORK
TWI557746B (en) 2011-05-10 2016-11-11 電子戰協會公司 Systems and methods of implementing content validation of microcomputer based circuits
US9197315B2 (en) 2012-06-28 2015-11-24 Hughes Network Systems, Llc Peer group diagnosis detection method and system
US8923753B2 (en) 2012-06-28 2014-12-30 Hughes Network Systems, Llc Problem signature terminal diagnosis method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6445916B1 (en) * 1999-01-07 2002-09-03 Lucent Technologies Inc. Wireless system and method for evaluating quality of service
US6771929B1 (en) * 2000-10-20 2004-08-03 Northrop Grumman Corporation Satellite communication system threshold leveling techniques
US20030054816A1 (en) * 2001-09-20 2003-03-20 Krebs Lawrence W. Methods and apparatus for mitigating rain fading over satcom links via information throughput adaptation
US6847817B2 (en) * 2001-12-12 2005-01-25 Northrop Grumman Corporation Satellite communication apparatus with multiple hub stations providing increased bandwidth to meet service requirements
US20060084377A1 (en) * 2004-09-10 2006-04-20 Samsung Electronics Co., Ltd. Method for controlling broadcasting signal transmission in wireless communication system providing broadcasting service and corresponding system
US20080055152A1 (en) * 2006-08-29 2008-03-06 Wildblue Communications, Inc. Network-access satellite communication system
US20100150017A1 (en) * 2007-08-23 2010-06-17 Kt Corporation Device and method for link balancing detection
US20110143654A1 (en) * 2009-06-15 2011-06-16 Viasat, Inc. Link performance difference metrics and link adaptation for mesh satellite networks

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9197315B2 (en) 2012-06-28 2015-11-24 Hughes Network Systems, Llc Peer group diagnosis detection method and system
US9294203B2 (en) 2012-06-28 2016-03-22 Hughes Network Systems, Llc Problem signature terminal diagnosis method and system
US9350467B2 (en) 2012-06-28 2016-05-24 Hughes Network Systems, Llc Terminal diagnosis self correction method and system
US9525478B2 (en) 2012-06-28 2016-12-20 Hughes Network Systems, Llc Peer group diagnosis detection method and system
US20140120830A1 (en) * 2012-11-01 2014-05-01 Hughes Network Systems, Llc Real-time signal validation method and system
US8954000B2 (en) * 2012-11-01 2015-02-10 Hughes Network Systems, Llc Real-time signal validation method and system
US20150155931A1 (en) * 2012-11-01 2015-06-04 Hughes Network Systems, Llc Real-time signal validation method and system
US9419701B2 (en) * 2012-11-01 2016-08-16 Hughes Network Systems, Llc Real-time signal validation method and system
US20160352414A1 (en) * 2012-11-01 2016-12-01 Hughes Network Systems, Llc Real-time signal validation method and system
US9793980B2 (en) * 2012-11-01 2017-10-17 Hughes Network Systems, Llc Real-time signal validation method and system
US10362095B2 (en) * 2016-11-04 2019-07-23 Airwatch Llc Distributed network diagnostics of enterprise devices utilizing device management
US10931740B2 (en) * 2016-11-04 2021-02-23 Airwatch Llc Distributed network diagnostics of enterprise devices utilizing device management

Also Published As

Publication number Publication date
US9197315B2 (en) 2015-11-24
US20160080070A1 (en) 2016-03-17
US9525478B2 (en) 2016-12-20

Similar Documents

Publication Publication Date Title
US9294203B2 (en) Problem signature terminal diagnosis method and system
US9525478B2 (en) Peer group diagnosis detection method and system
US9793980B2 (en) Real-time signal validation method and system
EP2923509B1 (en) Wireless access point mapping
US11533151B2 (en) Determining one or more data modulation profiles for one or more devices
US8792901B2 (en) System and method for assessing radio sensing data
EP2755442B1 (en) Communication network
US20150319623A1 (en) Multi-standard coverage map generation
US9350467B2 (en) Terminal diagnosis self correction method and system
US20180176867A1 (en) Headend device of distributed antenna system and signal processing method thereof
WO2022022336A1 (en) Service satellite operation state diagnosis method, and related apparatus
US11070256B2 (en) Method of processing communication signal and communication node using the same
US11778496B2 (en) In-service fade margin measurement
US20230413084A1 (en) System and Method for Determining Wireless Service Quality using Inference
WO2017194510A1 (en) Satellite operations support system
EP2784952B1 (en) A method and system for signal measurement and approval over controlled environment
EP2926540A1 (en) System and method for determining and verifying geo-location of a radio device

Legal Events

Date Code Title Description
AS Assignment

Owner name: HUGHES NETWORK SYSTEMS, LLC, MARYLAND

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ROZMARYN, JACK;REEL/FRAME:028990/0600

Effective date: 20120919

AS Assignment

Owner name: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS COLLATE

Free format text: SECURITY INTEREST;ASSIGNOR:HUGHES NETWORK SYSTEMS LLC;REEL/FRAME:032404/0094

Effective date: 20140220

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

AS Assignment

Owner name: U.S. BANK NATIONAL ASSOCIATION, MINNESOTA

Free format text: ASSIGNMENT OF PATENT SECURITY AGREEMENTS;ASSIGNOR:WELLS FARGO BANK, NATIONAL ASSOCIATION;REEL/FRAME:050600/0314

Effective date: 20191001

AS Assignment

Owner name: U.S. BANK NATIONAL ASSOCIATION, MINNESOTA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION NUMBER 15649418 PREVIOUSLY RECORDED ON REEL 050600 FRAME 0314. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF PATENT SECURITY AGREEMENTS;ASSIGNOR:WELLS FARGO, NATIONAL BANK ASSOCIATION;REEL/FRAME:053703/0367

Effective date: 20191001

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8