WO2005045775A1

WO2005045775A1 - Smoke detection method and apparatus

Info

Publication number: WO2005045775A1
Application number: PCT/US2004/038633
Authority: WO
Inventors: George Privalov
Original assignee: Axonx, L.L.C.
Priority date: 2003-11-07
Filing date: 2004-11-08
Publication date: 2005-05-19
Also published as: US7805002B2; DE602004019244D1; EP1687784A1; US20050100193A1; EP1687784B1

Abstract

A smoke detection method and apparatus (2), which uses the effects of the diffusion of light to identify the presence of smoke in a monitored area, are disclosed. This method comprises the steps of: (a) electronically capturing a sequence of images of a light source (6) in the monitored area, (b) transferring these images into an image buffer (8), (c) scanning these images to identify the chunks of adjacent pixels with brightness values above a prescribed threshold, (d) maintaining the sequence of such chunks obtained from consecutive images in a cluster stack, (e) analyzing the evolution of the features of each of these cluster over a prescribed period of time to identify the patterns that are caused by particle-induced light diffusion, and (f) issuing a prescribed system response in the event such light diffused patterns are identified.

Description

SMOKE DETECTION METHOD AND APPARATUS 2 3

BACKGROUND OF THE INVENTION 4

5 FIELD OF THE INVENTION

6 The present invention generally relates to electrical, condition responsive

7 systems and methods. More particularly, this invention relates to a method and

8 apparatus for detecting smoke in a monitored area using a sequence of digitized images

9 of the area. 0 1 2 DESCRIPTION OF THE RELATED ART 3 Smoke detectors are very important safety devices that can provide an early4 warning of fire in a monitored area. Considerable efforts have been devoted tos improving upon the technology used in smoke detectors as a means of increasing6 their usefulness and reliability. 7 One of the most commonly used methodologies for smoke detectors involvess measuring the presence of aerosol particles at the location of a smoke detector's9 sensor. Such measurements are based either on light scattering phenomena or on the0 effects due to smoke particle interactions with an ionization current created within thei detector. See Rattman, et al., U.S. Patent No. 5,719,557. 2 A disadvantage of this approach is that its measurements are limited in terms3 of their sensing area since such detectors monitor for the presence of smoke only at4 those points that are in close proximity to the location of the detector's sensor. The₅ successful detection of smoke in a monitored area using this technique greatly6 depends upon the rate of movement of smoke particles toward the detector's sensor7 which, depending upon the size of the monitored area, can be located a considerable8 distance from the initial source of any smoke. To address this insufficient sample size problem, it has been suggested that air0 samples be collected at multiple locations in the monitored area and then to guidei these samples to the location of the detector's sensor. See Knox, et al., U.S. Patent No. 6,285,291. Although effectively increasing the extent of spatial sampling within a monitored area, this method has the disadvantage of requiring the installation of multiple sampling tubes at assorted locations throughout the monitored area. Another approach for smoke detection has been to monitor the light scattering effect of smoke particles on a laser beam that is directed across a monitored area. Rather than just sensing smoke in just the relatively small vicinity of a single sensor, the laser beam approach effective senses for smoke along a line that can extended for a considerable distant throughout the monitored area. See Moore, et al., U.S. Patent No. 3,973,852. However, a disadvantages of using such a laser beam approach is that, although it may effectively measure smoke conditions at more points within a monitored area that just those points in the vicinity of a single sensor, it still does not provided feedback on the smoke conditions at all or most of the points within the monitored area. Despite the considerable prior art relating to smoke detectors, there is still a need for smoke detector methods and systems that can more effectively measure smoke conditions throughout the entire volume of a desired monitored area.

3. OBJECTS AND ADVANTAGES There has been summarized above, rather broadly, the prior art that is related to the present invention in order that the context of the present invention may be better understood and appreciated. In this regard, it is instructive to also consider the objects and advantages of the present invention. It is an object of the present invention to provide apparatus and methods that are effective at detecting smoke within the entire volume of a monitored area. It is another object of the present invention to provide apparatus and methods that are effective at detecting smoke in industrial petrochemical installations. It is an object of the present invention to provide apparatus and methods that can operate within the framework of the ordinary Closed Circuit Television (CCTV) surveillance systems that are used to monitor commercial, outdoor, industrial and residential areas It is yet another object of the present invention to demonstrate how existing security surveillance equipment may be combined into unique systems which provide the best means to address the detection of smoke in industrial, commercial and residential installations. It is a further object of the present invention to provide a means for providing notification of smoky conditions within a monitored area to remote operators who are using closed circuit television to monitor the area. These and other objects and advantages of the present invention will become readily apparent as the invention is better understood by reference to the accompanying summary, drawings and the detailed description that follows.

SUMMARY OF THE INVENTION

Recognizing the need for the development of improved smoke detection systems and methods, the present invention is generally directed to satisfying the needs set forth above and overcoming the disadvantages identified with prior art devices and methods. In accordance with the present invention, the foregoing need can be satisfied by providing an early smoke detection means that can operate within the framework of the ordinary Closed Circuit Television (CCTV) surveillance system for commercial, outdoor, industrial and residential installation. In a preferred embodiment, the present invention monitors the images being collected from a light source in the monitored area and looks for changes in these images to identify the presence of smoke in any part of the path between the light source and the camera. The present invention includes: (a) a means for capturing the digital images from a light source in the monitored remote area and transmitting them into a frame buffer, (b) a means of analyzing these images to identify the clusters of pixels that have brightness levels higher than a prescribed threshold level, (c) a means of maintaining the database of these clusters obtained over a prescribed period of time, (d) a means of analyzing these clusters over a prescribed period to identify any evolving patterns which are consistent with the presence of smoke or fog, and (e) a means of issuing and delivering an alert notification to responsible parties including, but not limited to live video images from the location when the presence of smoke has been identified. Thus, there has been summarized above, rather broadly, the present invention in order that the detailed description that follows may be better understood and appreciated. There are, of course, additional features of the invention that will be described hereinafter and which will form the subject matter of the claims to this invention. BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a block diagram of a preferred embodiment of the smoke detection method and apparatus of the present invention. FIG. 2 shows the algorithm for a preferred embodiment of the smoke detection method and apparatus of the present invention. FIG. 3 illustrates the effect of the light source diffusion caused by smoke. FIG. 4A illustrates the diffused image of a light source captured by an embodiment of the present invention. FIG. 4B illustrates how the brightness values over the image of FIG. 4A vary at different points within the image, especially when such an image is being influenced by the presence of smoke between the light source and the capture which captures such an image; see profile denoted as 3-4. FIG. 4C compares two histograms which illustrate the frequency at which various brightness values are observed in the images illustrated in FIG. 4B: a histogram of the original light source and a histogram for this light source when smoke is present between the light source and a capture which is capturing its image.

l DESCRIPTION OF THE PREFERRED EMBODIMENT

2

3 Before explaining at least one embodiment of the present invention in detail, it

4 is to be understood that the invention is not limited in its application to the details of

5 construction and to the arrangements of the components set forth in the following

6 description or illustrated in the drawings. The invention is capable of other

7 embodiments and of being practiced and carried out in various ways. Also, it is to be

8 understood that the phraseology and terminology employed herein are for the purpose

9 of description and should not be regarded as limiting. 0 FIG. 1 shows a preferred embodiment of the smoke detection method and 1 apparatus of the present invention. The smoke detection system 2 includes: at least2 one digital video camera 4 with a field of view that includes but is not limited to at3 least one stable light source 6, such as a light fixture, illuminated emergency exit or4 other sign, or light source installed specifically for the purpose of providing thes diffusion effect for detecting smoke. 6 The digital video camera 4 provides a means for detecting and capturing, at a 7 prescribed frequency (e.g., 16 frames per second) and spatial resolution (e.g., 160 xs 120 pixels), video frames or bitmap images of an area that is to be temporally 9 monitored for the presence of smoke. See FIG. 3. 0 In the event of smoke, the cloud of aerosol particles accumulating within thei observed area will have a diffusion effect on the light from the light source 6 when it2 travels towards the camera 4 affecting the image or bitmap of the light source. The3 effect of this diffusion on the image can be identified using prescribed imaging4 techniques and is subject of the present invention. 5 The sequence of digitized images acquired by the television camera 4 are6 placed in a storage device or frame buffer 8 for further analysis, with the buffer7 serving as a means for cyclically accumulating a sequential set of said captured8 bitmaps for analysis. The step utilizes a means 10 for providing for the extraction of9 the bright spot areas of the image in the form of pixel regions, and a means 12 for0 arranging overlapping pixel regions gathered from frames collected at consecutivei instances in a sequential collection, which I denote as a bright spot cluster stack 14. Such stacks 14 are maintained for each non-overlapping bright spot in the image and are constantly monitored by an analyzer 16 for the anomalies that, with certain degree of confidence, are caused by the smoke-induced scattering of light. In the event of such anomalies, a means 18 for providing an alert notification is used to issue such a notification to invoke the proper system response that may include, but is not limited to, issuing light and/or sound alarms, notifying a remote operator by means of messages sent over assorted transmission lines, existing computer network architecture, and other communication devices. Alert notification may also include a live video image being transmitted from the monitored location. FIG. 2 shows an operating flowchart of a preferred algorithm that implements a preferred embodiment of the smoke detection method and apparatus of the present invention. It comprises of the following steps: the starting point (1) that includes the initiation of hardware and the data structures necessary for further steps, the image or frame acquisition step (2) that may include but is not limited to gathering a digitized frame and digital filtering to reduce the noise in such an image. The appropriate thresholds for bright spot identification are determined at step (3) that may include, but is not limited to statistical analysis of the sequence of images gathered over a prescribed period of time. Further, the image is scanned to determine the pixels that are qualified as bright spots (4) where the brightness level of the pixel is higher than the threshold determined at step (3) and are static, i.e., these bright spots were present at the location over prescribed period of time, so the moving light sources will be excluded. If such pixels are present (5), the adjacent pixels that fall into this category are grouped into the isolated clusters, further referred to as spots, where each of such spots is verified for overlapping with the spots gathered at the previous frames (6) and stored in the bright spots stack (7). In case of the overlap (8), the relevant entry in the bright spot stack is appended with the new instance of the cluster or spot (10) determined at the last frame. Otherwise, the new entry in the bright spot stack is created (9) with only one instance. Once the entry has more then prescribed number of instances, the determination is made of whether the cluster or spot may indicate the presence of smoke (11). This decision is made based on evolution of one of a number of possible properties of the images or bitmaps, such as: variations in their area as a function of time, the statistical distribution of their brightness values, a computation of what is denoted as their Shannon entropy or the movement of the light source which generates such images. In case of a positive identification for the presence of smoke (12), the relevant alarms are issued (13). FIG 3 illustrates the effect of smoke on the image of a light source. The light from the source 6 is diffused by the smoke on its way to the camera 4 where it forms the image of the light source on the camera's lens or sensor. Normally the image is small with sharp edges. The size of the bright spot reflects the distance and size of the light source. The brightness value across this image is uniform. In case of diffusion of light caused by the presence of smoke between the light source and the camera, the overall area of the bright spot will expand while the brightness values will become more diverse and gradually decaying from the center of the spot. Successful identification of smoke conditions with the present invention depends on the analysis of the evolving patterns of various parameters of such clusters or spots gathered over a period of time. Various ways that the present invention provides for analyzing these spots include: Evolution of the Spot's Size of Area In the first approximation, the degree of the light diffusion caused by smoke is proportional to the concentration of smoke, the length of travel between light source and the camera, and the size and reflective properties of smoke particles. In the event of fire, smoke is being produced at a certain rate and gradually builds up in the monitored space. That results in a gradual increase in overall concentration of the smoke over the light's path of travel to the camera. That in turn will induce a gradual increase in the size and the area of the monitored bright spots. 1 Therefore, one of the criteria for the existence of or identification of a smoke

2 condition in the monitored area is a steady gradual increase in area of the bright spot

3 or cluster.

4 In one of the possible embodiments of this invention, such steady growth can

5 be estimated by linear approximation. The slope of the linear approximation and the

6 quality of such approximation (least squares) is used to accept or reject the area to be

7 related to smoke-induced diffusion.

8 In another preferred embodiment, the polynomial approximation is used to

9 interpolate the trends in the area of such clusters. In yet another preferred 0 embodiment, the trained neural network can be used to determine whether the area of 1 the bright spot cluster evolves in the way consistent with the presence of smoke.2 Diversification of the Spot's Brightness Values 3 It has been observed that the diversity of the brightness values within the area4 of cluster of the light source is usually very limited. This phenomenon is caused bys the fact that pixels within the bright spots are within the saturation limits of the 6 television camera which in turn is a result of function of the Automatic Gain Control7 (AGC) circuitry of the camera that is designed to keep a certain average level ofs brightness across the whole image. 9 FIG. 4B contrasts two brightness profiles, the typical brightness profile (3-3)0 across the image of the light source in the reference case when no smoke is present ini the light's path to diffuse the light's transmission, and the smoke-induced profile (3-2 4) when smoke and diffusion are present. A bright spot cluster is formed when the3 brightness values exceed a specified threshold (3-1). Such video signals are also4 limited by the dynamic range of the camera that determines the upper limit of5 saturation (3-2). 6 Thus the undiffused light source forms near rectangular profile (3-3) while the7 diffused profile (3-4) forms the bell-shaped profile that may or may not be truncated8 by the upper limit of camera sensor saturation. The histogram of the relative 9 brightness values is shown at (4). The distribution of the brightness values for0 undiffused source (4-1) has very limited variation of values leaving most slots of thei histogram unpopulated. The histogram for diffused source (4-2) however is more evenly populated. The measure of the diversity in the brightness values within the bright spot cluster can be used to positively identify the effect of diffusion caused by the smoke. In another preferred embodiment of the present invention, the presence of smoke in a monitored area is identified by changes in the Shannon entropy of the monitored signal. Shannon entropy is defined as:

Where p_t is a probability of the brightness of the given value and N is a total number of different values. Thus, due to more populated probability values, a diffused light source exhibits higher Shannon entropy. In another preferred embodiment, direct pattern matching of the brightness value histograms generated within the diffused source can be used to identify the presence of smoke. The possible techniques to be employed to identify smoke- induced anomalies include, but are not limited to neural networks and fuzzy logic. As a means of reducing the rate of false alarms that may be caused by moving and advancing light sources, the evolution of other geometric properties of a light source can be monitored. For example, the basic shape properties of a light source, such as its aspect ratio (height to width ratio) is monitored to ensure that it does not exceed a prescribed range. In another preferred embodiment, the motion of a light source is monitored to determine if the initial footprint of the source remains within the footprints of the subsequent views of the source. As yet another additional means of reducing the rate of false alarms, especially those due spurious changes in light source intensity, the maximum brightness of each cluster is monitored and those clusters that show significant increase in maximum brightness are rejected as nuisances. Although the foregoing disclosure relates to preferred embodiments of the present invention, it is understood that these details have been given for the purposes of clarification only. Various changes and modifications of the invention will be apparent, to one having ordinary skill in the art, without departing from the spirit and scope of the invention as hereinafter set forth in the claims.

Claims

l CLAIMS

2

3 I claim:

4 L A method of detecting smoke in a monitored area containing a light source, said

5 method comprising the steps of:

6 capturing, at a point in said monitored area that is distant from said light

7 source and at a prescribed frequency, video images of said light source in the form of

8 two-dimensional bitmaps,

9 wherein the spatial resolution of said bitmap is determined by the number of0 pixels comprising said bitmaps, 1 wherein the pixels coπesponding to said light source are identified as such by2 the brightness levels of said pixels exceeding a prescribed threshold value, 3 temporally monitoring the smoke influenced properties reflected in said4 bitmaps of the pixels corresponding to said light source so as to identify the presence 5 of smoke in said monitored area, 6 wherein said smoke influenced properties of said pixels chosen from the7 group consisting of the size of the bitmap area associated with those pixels that ares identified as corresponding to said light source, the variations in the brightness of said9 pixels that are identified as corresponding to said light source, and the shape of the0 bitmap area associated with those pixels that are identified as corresponding to saidi light source. 2 2. The method of smoke detection as recited in claim 1, wherein said brightness3 level threshold is dynamically adjusted for temporal changes in the background4 brightness conditions within said monitored area. 5 3. The method of smoke detection as recited in claim 1, wherein: 6 the calculation of the temporal change in the size of the bitmap area, that is7 associated with those pixels that are identified as corresponding to said light source, is8 approximated by an assumed linear trend in said size change over a prescribed period of time, and 0 the magnitude of the rate of this assumed linear trend being above a prescribedi value is used to identify the presence of smoke in said monitored area.

1 4. The method of smoke detection as recited in claim 1, wherein:

2 the calculation of the temporal change in the variation in the brightness levels

3 of said pixels that are identified as corresponding to said light source utilizes the

4 computation of the Shannon entropy for said pixels, and

5 the increase over time of said Shannon entropy being above a prescribed value

6 is used to identify the presence of smoke in said monitored area.

7 5. The method of smoke detection as recited in claim 1 , wherein:

8 the calculation of the temporal change in the variation in the brightness levels

9 of said pixels that are identified as corresponding to said light source utilizes the0 computation of the changes in the shape of the histograms of the brightness levels 1 corresponding to said successive captured images. 2 6. The method of smoke detection as recited in claim 1, further comprising the step3 of: 4 in the event that said presence of smoke in said monitored area is identified,s signaling the detection of smoke in said monitored area. 6 7. An apparatus (2) for detecting smoke in a monitored area having a light source7 (6), said apparatus comprising: s a means (4), located at a point in said monitored area that is distant from said9 light source, for capturing at a prescribed frequency, video images of said light source0 in the form of two-dimensional bitmaps having a specified number of pixels,i a means (8) for cyclically accumulating a sequential set of said captured2 bitmaps, 3 a means (10) for examining said set of bitmaps to identify those pixels in said4 bitmaps that correspond to said light source, said identification being dependent upon5 the brightness levels of said pixels exceeding a prescribed threshold value, 6 a means (16) for temporally monitoring and analyzing the smoke influenced7 properties reflected in said bitmaps of the pixels corresponding to said light source so8 as to identify the presence of smoke in said monitored area, 9 wherein said smoke influenced properties of said pixels chosen from the0 group consisting of the size of the bitmap area associated with those pixels that arei identified as corresponding to said light source, the variations in the brightness of said 1 pixels that are identified as corresponding to said light source, and the shape of the

2 bitmap area associated with those pixels that are identified as coπesponding to said

3 light source.

4 8. The apparatus (2) as recited in claim 7, wherein said brightness level threshold is

5 dynamically adjusted for temporal changes in the background brightness conditions

6 within said monitored area.

7 9. The apparatus (2) as recited in claim 7, wherein:

8 the calculation of the temporal change in the size of the bitmap area, that is

9 associated with those pixels that are identified as corresponding to said light source, is lo approximated by an assumed linear trend in said size change over a prescribed period π of time, and

12 the magnitude of the rate of this assumed linear trend being above a prescribed

13 value is used to identify the presence of smoke in said monitored area.

14 10. The apparatus (2) as recited in claim 7, wherein: is the calculation of the temporal change in the variation in the brightness levels

16 of said pixels that are identified as coπesponding to said light source utilizes the

17 computation of the Shannon entropy for said pixels, and is the increase over time of said Shannon entropy being above a prescribed value

19 is used to identify the presence of smoke in said monitored area.

20 11. The apparatus (2) as recited in claim 7, wherein:

2i the calculation of the temporal change in the variation in the brightness levels

22 of said pixels that are identified as corresponding to said light source utilizes the

23 computation of the changes in the shape of the histograms of the brightness levels

24 corresponding to said successive captured images.

25 12. The apparatus (2) as recited in claim 7, further comprising:

26 a means (18) for, in the event that said presence of smoke in said monitored

27 area is identified, signaling the detection of smoke in said monitored area.

28 29