WO2016203718A1

WO2016203718A1 - Facial recognition system, facial recognition server, and customer information presentation method

Info

Publication number: WO2016203718A1
Application number: PCT/JP2016/002568
Authority: WO
Inventors: 正茂常野; 馨鶴海; 寛夫齊藤
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2015-06-15
Filing date: 2016-05-27
Publication date: 2016-12-22
Also published as: JP2017004432A

Abstract

In the present invention, when a customer enters a store, information pertaining to the customer's preferences is presented to an employee. The customer ID, facial image data feature values, and attribute information are associated and registered in a customer database (41). The customer ID and order history are associated and registered in a sales database (51). A facial feature value extraction unit (32) extracts the feature values in facial image data including the face appearing in an image captured by a camera device (10). A facial feature value comparison unit (33) compares the extracted facial image data feature values to the facial image data feature values registered in the customer database (41). If these feature values are similar, a communication unit (31) transmits, to an order terminal (60), customer information including the facial image data, attribute information, and order history corresponding to the customer ID having the similar feature values. The order terminal (60) displays the customer information on a display (62).

Description

Face recognition system, face recognition server, and customer information presentation method

The present disclosure relates to a face recognition system, a face recognition server, and a customer information presentation method for authenticating a person's face using an image captured by a camera device.

Conventionally, when determining the customer segment of a person who appears in an imaging area set in a store, it is determined whether or not the customer is an analysis target from the person's behavior form, and the person who does not correspond is excluded from the analysis target Thus, a customer segment analysis system that accurately analyzes the customer segment of customers who have visited the store is known (see, for example, Patent Document 1).

In this customer segment analysis system, for example, an imaging region is set so that a customer heading for a customer seat from a waiting area for guidance in the vicinity of a store entrance is imaged from the front. Further, the customer segment analysis system detects a person who takes a behavior different from the behavior of moving toward the audience seat, and excludes the person who takes such a behavior from the analysis target as being a clerk or the like, that is, other than the customer.

JP 2014-232495 A

However, in the configuration of Patent Document 1, although customer behavior can be analyzed, customer preference information cannot be presented to the store clerk when the customer visits the store.

In view of the above-described conventional situation, the present disclosure aims to provide a face recognition system, a face recognition server, and a customer information presentation method capable of presenting customer preference information to a store clerk when a customer visits the store. .

The present disclosure is a face recognition system in which a camera device, a face recognition server, and an order terminal held by a service provider are connected, and the face recognition server is a person's face appearing in video data captured by the camera device. A feature amount extraction unit that extracts feature amounts of face image data including: a customer database in which customer identification information, feature amounts of face image data and customer attribute information are registered in association with each other; customer identification information; When the order database in which the customer order history is registered in association with the feature amount of the face image data extracted by the feature amount extraction unit and the feature amount of the face image data registered in the customer database are similar, A transmission unit that transmits customer information including facial image data extracted by the feature amount extraction unit, customer attribute information, and customer order history to the order terminal, It has a radical 113, the display unit customer information transmitted from the face recognition server, a face recognition system.

In addition, the present disclosure is a face recognition server in which a camera device and an order terminal held by a service provider are connected, and features of face image data having a human face appearing in video data captured by the camera device Feature quantity extraction unit, customer database in which customer identification information, facial image data feature quantity and customer attribute information are registered in association with each other, customer identification information and customer order history In addition, when the order database registered with the feature data and the feature quantity of the face image data extracted by the feature quantity extraction section are similar to the feature quantity of the face image data registered in the customer database, the feature database is extracted by the feature quantity extraction section. A face recognition server comprising: a transmission unit that transmits customer information including face image data, customer attribute information, and customer order history to an order terminal.

Furthermore, the present disclosure is a customer information presentation method in a face recognition system in which a camera device, a face recognition server, and an order terminal held by a service provider are connected, and includes customer identification information and customer face image data. Processing for associating feature quantities with customer attribute information and registering them in the customer database, processing for associating customer identification information with customer order history and registering them in the order database, and video data captured by the camera device Is extracted when the feature amount of the face image data having the face of the person appearing in is similar to the feature amount of the extracted face image data and the feature amount of the face image data registered in the customer database. Processing for transmitting customer information including the face image data, customer attribute information, and customer order history to the ordering terminal, and transmitting the received customer information to the display unit of the ordering terminal. To run and Shimesuru processing, the, is the customer information presentation method.

According to the present disclosure, when a customer visits the store, the customer's preference information can be presented to the store clerk.

The block diagram which shows an example of an internal structure of the face recognition system of this embodiment in detail The flowchart explaining an example of the operation | movement procedure of the face detection process in the face recognition server of this embodiment. The figure which shows the example of a display of the screen of the order terminal where a customer's favorite menu is displayed when a regular customer visits the store The figure which shows the example of a display of the screen of the order terminal in which a new store recommended menu is displayed when a new customer visits the store The block diagram which shows an example of an internal structure of the face recognition system of the modification of this embodiment in detail

Hereinafter, an embodiment (hereinafter referred to as “the present embodiment”) that specifically discloses the face recognition system, the face recognition server, and the customer information presentation method of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter.

FIG. 1 is a block diagram showing an example of the internal configuration of the face recognition system 5 of the present embodiment. The face recognition system 5 shown in FIG. 1 has a configuration in which a plurality of camera devices 10, a face recognition server 30, a POS (Point Of Sales) server 50, and an order terminal 60 are connected. Hereinafter, although the face recognition system 5 of this embodiment is demonstrated supposing the case installed in a shop, for example, you may set in places other than a shop.

Each camera device 10 captures a predetermined place (for example, a passenger seat or a passage leading to the passenger seat) set in advance for each camera device 10 as an imaging region, and the captured video data (that is, by imaging) Face image data having the face of a person appearing in the obtained video data) is acquired. Each camera device 10 includes an imaging unit 11, a face detection unit 12, a face cutout unit 13, and a communication unit 14. In addition, the camera apparatus 10 of this embodiment may be one unit, or may be a plurality.

The imaging unit has an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, and enters from a preset imaging region. The light to be imaged is formed on the light receiving surface, and the optical image is converted into an electric signal. Thereby, a frame of video data representing the video in the imaging region is obtained.

The face detection unit 12 detects a human face included in the video imaged by the imaging unit 11. This face detection process is a known method such as a method for detecting facial parts such as human eyes, nose and mouth, a method for detecting skin color, a method for detecting hair, a method for detecting parts such as the neck and shoulders, etc. This is a process for detecting a face using a technology. Further, as a face detection processing method, a pattern recognition technique based on statistical learning may be used.

The face cutout unit 13 cuts out face image data having a human face detected by the face detection unit 12 from a frame of video data captured by the imaging unit 11. Cut-out face image data (hereinafter simply referred to as “cut-out face image data”) is data including a rectangular image having a size that includes a captured human face. The face detection unit 12 and the face cutout unit 13 are functions executed by a processor 16 such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a DSP (Digital Signal Processor). The processor 16 realizes the functions of the face detection unit 12 and the face cutout unit 13 by executing an application program stored in an internal memory, for example.

The communication unit 14 is connected to the face recognition server 30 by wire or wirelessly, and transmits the face image data cut out by the face cutout unit 13 to the face recognition server 30. For example, when the camera device 10 is a network camera, the communication unit 14 can transmit face image data via an IP (Internet Protocol) network.

The face recognition server 30 recognizes the face included in the face image data received from each camera device 10 by comparing it with a face registered in advance. The face recognition server 30 includes a communication unit 31, a face feature amount extraction unit 32, a face feature amount comparison unit 33, and a customer database 41. Further, the face feature amount comparison unit 33 includes an age / sex determination unit 35.

The communication unit 31 as an example of a receiving unit receives face image data from each camera device 10. Moreover, the communication part 31 as an example of a transmission part transmits the customer information as a search response with respect to the search request from the order terminal 60 with respect to the order terminal 60 mentioned later.

The face feature amount extraction unit 32 as an example of the feature amount extraction unit extracts a face feature amount (hereinafter simply referred to as “face feature amount”) from the face image data received by the communication unit 31. The face feature amount extraction process is a process for extracting feature amounts such as the position of the eyes, the positional relationship between the eyes, the nose, and the mouth, and how to wrinkle, using a known technique.

The face feature amount comparison unit 33 compares the face feature amount extracted by the face feature amount extraction unit 32 with the face feature amount registered in the customer database 41, and whether the similarity is higher than a predetermined value. Determine whether or not. When these similarities are not higher than a predetermined value (that is, when the similarity is less than a predetermined value), the face feature amount comparison unit 33 determines that the similarity is low. When the degree of similarity is higher than a predetermined value, the face feature amount comparison unit 33 determines that the customer who has visited the store is a regular customer (in other words, a customer). On the other hand, when the similarity is less than the predetermined value and low, the face feature amount comparison unit 33 determines that the customer who has visited the store is a new customer. Note that the predetermined value (second threshold value) when determining that the similarity is low may be the same value or lower than the first threshold value with respect to the predetermined value (first threshold value) when determining that the similarity is high. It may be a value.

Further, the age and gender determination unit 35 included in the face feature amount comparison unit 33 is based on the face feature amount extracted by the face feature amount extraction unit 32 when it is a new customer (hereinafter simply referred to as “new customer”). In addition, the age and sex of new customers are estimated using known techniques. The estimated age may be expressed in a certain age range, or may be expressed as an average value or a representative value.

The face feature amount extraction unit 32 and the face feature amount comparison unit 33 are functions executed by the processor 40. The processor 40 implements the functions of the facial feature quantity extraction unit 32 and the facial feature quantity comparison unit 33 by executing an application program stored in an internal memory, for example.

The customer database 41 registers information related to face image data having a person's face that appears in video data captured by the camera device 10 when the customer is a new customer. Specifically, the customer database 41 issues customer identification information (hereinafter also referred to as “customer ID”) to a new customer, and the facial feature amount extraction unit 32 in addition to the face image data. Is associated with the attribute information (for example, customer age, gender, etc.) of the new customer and the information (ie, customer ID, facial feature of the customer face image data). Volume, customer attribute information) as customer information. Further, when the store is, for example, a chain-expanded store, the customer database 41 registers the customer information by diverting the customer information to any store out of all stores. deep. By storing a considerable amount of customer information data in all stores, it can be expected to be used as big data.

The POS server 50 is a system that records order information (sales information) every time an order is received at a store (in other words, a product is sold), and uses the totaled result for marketing such as sales management and inventory management. And a sales database 51. The sales database 51 as an example of an order database registers sales data (sales information) such as order history (menu, amount, etc.) for each customer identification information (customer ID). When the sales database 51 is a chain-expanded store, the sales data is registered for all stores.

The customer database 41 and the sales database 51 are always linked while the face recognition server 30 and the POS server 50 are online, and data transmission is performed between them. Data transmission is performed with the face recognition server 30 via a dedicated cable or when the POS server 50 is a cloud server connected to the Internet via an IP network. In FIG. 1, the POS server 50 is shown as a separate device from the face recognition server 30, but may be built in the face recognition server 30. In this case, data transmission between the POS server 50 and the face recognition server 30 is performed inside the face recognition server 30, and a communication line or the like for connecting the POS server 50 and the face recognition server 30 (for example, transmission) Installation of cable) can be omitted.

The order terminal 60 is a portable data communication terminal such as a tablet terminal or a smartphone that can be held by a store clerk as an example of a service provider. The order terminal 60 receives customer information from the face recognition server 30 and transmits order information to the POS server 50. The order terminal 60 includes an input unit 61, a display 62, a control unit 63, and a communication unit 64. Here, the input part 61 and the display 62 are comprised with the touchscreen integrated so that it might overlap. The input unit 61 receives an operation input by the user by touching the screen of the display 62. The display 62 as an example of a display unit displays customer information received from the face recognition server 30. Note that the input unit and the display may be provided separately.

The communication unit 64 is wirelessly connected to the face recognition server 30 and the POS server 50 and is capable of data communication. For example, the communication unit 64 is connected to the face recognition server 30 and the POS server 50 via a wireless LAN.

The control unit 63 is configured using a processor such as a CPU, MPU, or DSP, for example, and comprehensively controls the operation of the order terminal 60. The control unit 63 activates the application, can receive customer information from the face recognition server 30 during execution of the application, and transmits order information to the POS server 50.

The operation of the face recognition system 5 having the above configuration will be described.

FIG. 2 is a flowchart for explaining an example of the operation procedure of the face detection process in the face recognition server 30 of the present embodiment. In FIG. 2, the communication unit 31 in the face recognition server 30 receives the cut face image data transmitted from the camera device 10 (S1).

The face feature quantity extraction unit 32 extracts a face feature quantity from the received cut face image data (S2). As face feature amounts, for example, feature amounts such as the position of the eyes, the positional relationship between eyes, nose, and mouth, and how to wrinkle are extracted. The face feature amount comparison unit 33 compares the face feature amount extracted by the face feature amount extraction unit 32 with the face feature amount registered in the customer database 41 (S3), and the degree of similarity is equal to or greater than a predetermined value. It is determined whether or not it is high (S4).

When it is determined that the similarity is higher than a predetermined value (S4, YES), the communication unit 31 includes customer information (customer data) registered in the customer database 41 of the customer determined to be similar and The sales data registered in the sales database 51 is transmitted to the order terminal 60 (S5). Upon receiving the customer data and sales data from the face recognition server 30, the order terminal 60 displays these data on the display 62 (S6).

The clerk holding the order terminal 60 sees the customer data and sales data displayed on the screen of the display 62 (see FIG. 3), knows the customer's preference, and recommends a favorite menu to the customer. I do. Upon receiving an order from the customer, the store clerk performs an order input operation on the order terminal 60. Upon receiving the order input operation, the order terminal 60 registers the sales data of the order in the sales database 51 in association with the customer ID (S7). At this time, the order terminal 60 may communicate with the POS server 50 and be registered in the sales database 51 via the POS server 50, or may communicate with the face recognition server 30 and communicate with the face recognition server 30 in the sales database 51. You may ask for registration. Thereafter, the face recognition system 5 ends this operation.

On the other hand, when it is determined that the similarity is less than the predetermined value and low (S4, NO), the face recognition server 30 acquires a new customer ID from the customer database 41 (S8). Here, the face recognition server 30 has acquired a new customer ID issued by the customer database 41, but even if the own device (that is, the face recognition server 30) issues a new customer ID and assigns it to the customer database 41. Good.

The face feature amount comparison unit 33 is estimated by the face image data from the camera device 10 in the new customer ID, the face feature amount of the face image data extracted by the face feature amount extraction unit 32, and the age and gender determination unit 35. Customer data (customer information) including age and gender is registered in the customer database 41 (S9). The communication unit 31 transmits this customer data (customer information) to the order terminal 60 (S10).

The order terminal 60 displays the customer data (customer information) received from the face recognition server 30 on the screen of the display 62 (S11). When the store clerk holding the order terminal 60 looks at the customer data displayed on the screen of the display 62 (see FIG. 4) and knows that the customer is a new customer, for example, a service such as recommending the first push menu of the store is provided. Do. Upon receiving an order from the customer, the store clerk performs an order input operation on the order terminal 60. Upon receiving the order input operation, the order terminal 60 registers the sales data of the order in the sales database 51 in association with the customer ID (S12). At this time, as described above, the order terminal 60 may communicate with the POS server 50 and may be registered in the sales database 51 via the POS server 50, or may communicate with the face recognition server 30 and communicate with the face recognition server. 30 may be requested to register in the sales database 51. Thereafter, the face recognition system 5 ends this operation.

FIG. 3 is a diagram illustrating an example of a screen of the order terminal 60 on which a customer's favorite menu (preference information) is displayed when a regular customer (that is, a customer) visits the store. On the screen of the display 62 arranged on the front surface of the order terminal 60, customer information CS1 and sales information SL1 for each customer ID are displayed. The customer information CS1 includes face image data G1 and attribute information TG1. The attribute information TG1 includes age, sex, and remarks. In FIG. 3, face image data G1 of “customer ID: 0581” is displayed, and “age: 38 years old”, “sex: male” and “remarks:” are displayed as attribute information TG1, and further, “Card payment” and “Last visit 3 days ago” are displayed.

Further, the sales information SL1 includes an order history OR1. In the order history OR1, the menu of meals and desserts ordered by the customer in the past is displayed as “Fried oyster set meal 700 yen” or the like. In addition, the preference information PR1 is displayed on the screen of the order terminal 60. In FIG. 3, recommended information RM1 of “Fish set meals directly from the production area” and “Various cakes of a new menu” is displayed as part of the preference information PR1. In addition to the recommended information RM1, various event information based on customer information may be displayed in the preference information PR1.

The store clerk receives an order from the customer while presenting the recommended information RM1 to the customer while viewing the information displayed on the screen of the order terminal 60 held by his / her hand. When the order is received, the store clerk touches the order button 62z arranged at the bottom of the screen of the order terminal 60, and changes the screen of the order terminal 60 to an order input screen (not shown). When the clerk touches and inputs the order contents from the order input screen, the order terminal 60 receives the order contents and transmits the sales data of the customer ID corresponding to the order contents to the POS server 50. The POS server 50 reflects the sales data of the customer ID received from the order terminal 60 in the sales database 51.

FIG. 4 is a diagram illustrating an example of a screen of the order terminal 60 on which a menu for pushing our store (new customer preference information) is displayed when a new customer visits the store. On the screen of the display 62 arranged on the front surface of the order terminal 60, customer information CS2 of a new customer ID is displayed. Sales information is not displayed on this screen.

Include customer and gender. At this point, remarks are not included. In FIG. 4, the face image data G2 of “customer ID: 0683” is displayed, and “age: 25 years old” and “sex: female” are displayed as the attribute information TG2.

Also, the preference information PR2 is displayed on the screen of the order terminal 60. In FIG. 4, since there is no order history yet, recommended information RM2 of, for example, our shop first push menu is displayed as a part of the preference information PR2.

The store clerk receives an order from the customer while presenting the recommended information RM2 to the customer while viewing the information displayed on the screen of the order terminal 60 held by his / her hand. When the order is received, the store clerk touches the order button 62z arranged at the bottom of the screen of the order terminal 60, and changes the screen of the order terminal 60 to an order input screen (not shown). When the clerk touches and inputs the order contents from the order input screen, the order terminal 60 receives the order contents and transmits the sales data of the new customer ID corresponding to the order contents to the POS server 50. The POS server 50 reflects the sales data of the new customer ID received from the order terminal 60 in the sales database 51.

As described above, in the face recognition system 5 of the present embodiment, the customer ID (customer identification information), the feature amount of the face image data, and the attribute information are registered in the customer database 41 in association with each other. In the sales database 51, a customer ID and an order history are registered in association with each other. The face feature amount extraction unit 32 extracts a feature amount of face image data including a face appearing in an image captured by the camera device 10. The face feature amount comparison unit 33 compares the feature amount of the face image data extracted by the face feature amount extraction unit 32 with the feature amount of the face image data registered in the customer database 41. As a result of the comparison, if these feature quantities are similar, the communication unit 31 sends the customer information CS1 including the face image data G1, the attribute information TG1, and the order history OR1 corresponding to the customer ID having the similar feature quantity to the order terminal 60. Send. The order terminal 60 displays the customer information CS1 transmitted from the face recognition server 30 on the display 62. Thereby, when the customer visits the store, customer information is displayed on the order terminal held by the store clerk and the like, so that the customer's preference information can be presented to the store clerk. Therefore, the store clerk can receive orders from customers smoothly and quickly, leading to sales promotion.

Further, when receiving a new order from the customer of the customer information displayed on the display 62, the order terminal 60 transmits the sales information of the order to the face recognition server 30. The face recognition server 30 registers the received order sales information in the sales database 51 in association with customer identification information (customer ID). Thereby, the latest sales information can be reflected in the sales database, and the accuracy of the preference information to be presented can be improved. In addition, the data volume of the sales database is increased, the accuracy is improved, and various uses are expected.

Further, the face recognition server 30, when the feature amount of the face image data extracted by the face feature amount extraction unit 32 and the feature amount of the face image data registered in the customer database 41 are not similar, Customer identification information (customer ID) is acquired, and sales information is associated with new customer identification information and registered in the sales database 51. Thereby, the identification information and sales information of a new customer can be increased, and the utility value of the customer database and the sales database is increased.

(Modification of this embodiment)
FIG. 5 is a block diagram showing in detail an example of the internal configuration of a face recognition system 5A according to a modification of the present embodiment. The same components as those in the present embodiment are denoted by the same reference numerals, and the description thereof is omitted. In the face recognition system 5A according to the modified example of the present embodiment, the camera device 10A includes only the imaging unit 11 and the communication unit 14, and the image data captured by the imaging unit 11 is transmitted to the communication unit. 14 is transmitted to the face recognition server 30A as it is.

Unlike the above-described embodiment, the face recognition server 30 </ b> A includes a face detection unit 52 and a face cutout unit 53 in the processor 40. The face detection unit 52 detects the face included in the video, similar to the face detection unit 12 of the embodiment, from the image data (video) transmitted from the camera device 10A. The face cutout unit 53 cuts out face image data including the face detected by the face detection unit 52 from the frame of the video, like the face cutout unit 13 of the embodiment.

As described above, in the face recognition system 5A according to the modification of the present embodiment, the load-intensive processing is concentrated on the face recognition server 30A, so that the load on the camera device 10A can be reduced. That is, since the camera device 10A only transmits captured image data (video) to the face recognition server 30, a simple configuration is required, and an existing camera device can be used. A general-purpose network camera can also be used.

As mentioned above, although embodiment was described referring drawings, it cannot be overemphasized that this indication is not limited to this example. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are of course within the technical scope of the present disclosure. Is done.

For example, in the above-described embodiment or its modification, the

face recognition systems

5 and 5A have been shown to be used in restaurants such as restaurants, but clothing stores such as boutiques, accommodation facilities such as hotels and inns, etc. Can be used in the same manner.

The present disclosure is useful as a face recognition system, a face recognition server, and a customer information presentation method that can present customer preference information to a store clerk when a customer visits the store when an image captured by a camera device is used.

5, 5A

Face recognition system

10, 10A Camera device 11 Imaging unit 12, 52 Face detection unit 13, 53

Face extraction unit

14, 31, 64

Communication unit

16, 40

Processor

30, 30A Face recognition server 31 Communication unit 32 Face feature amount Extraction unit 33 Face feature amount comparison unit 35 Age sex determination unit 41 Customer database 50 POS server 51 Sales database 60 Order terminal 61 Input unit 62 Display 62z Order button 63 Control unit CS1, CS2 Customer information G1, G2 Face image data OR1 Order history PR1, PR2 Preference information RM1, RM2 Recommended information SL1 Sales information TG1, TG2 Attribute information

Claims

A face recognition system in which a camera device, a face recognition server, and an order terminal are connected,
The face recognition server
A feature amount extraction unit that extracts a feature amount of face image data having a human face appearing in video data captured by the camera device;
A customer database in which customer identification information, feature amounts of the face image data, and customer attribute information are registered in association with each other;
An order database in which the identification information of the customer and the order history of the customer are registered in association with each other;
When the feature amount of the face image data extracted by the feature amount extraction unit is similar to the feature amount of the face image data registered in the customer database, the face image data extracted by the feature amount extraction unit And a transmission unit for transmitting customer information including the customer attribute information and the customer order history to the order terminal,
The order terminal is
A display unit for displaying the customer information transmitted from the face recognition server on the display unit;
Face recognition system.
The face recognition system according to claim 1,
When the order terminal receives a new order from the customer corresponding to the customer information displayed on the display unit, the order terminal transmits the order information to the face recognition server according to the operation of the service provider. ,
The face recognition server registers the order information transmitted from the order terminal in the order database in association with the customer identification information;
Face recognition system.
The face recognition system according to claim 1,
When the feature quantity of the face image data extracted by the feature quantity extraction unit and the feature quantity of the face image data registered in the customer database are not similar, the face recognition server uses the identification information of a new customer. , Registering the feature amount of the face image data extracted by the feature amount extraction unit in association with the attribute information of the new customer in the customer database,
Face recognition system.
A face recognition server in which a camera device and an order terminal are connected,
A feature amount extraction unit that extracts a feature amount of face image data having a human face appearing in video data captured by the camera device;
A customer database in which customer identification information, feature amounts of the face image data, and customer attribute information are registered in association with each other;
An order database in which the identification information of the customer and the order history of the customer are registered in association with each other;
When the feature amount of the face image data extracted by the feature amount extraction unit is similar to the feature amount of the face image data registered in the customer database, the face image data extracted by the feature amount extraction unit And a transmission unit that transmits customer information including the customer attribute information and the customer order history to the order terminal.
Face recognition server.
A customer information presentation method in a face recognition system in which a camera device, a face recognition server, and an order terminal are connected,
Processing for registering customer identification information, feature quantity of the customer face image data and the customer attribute information in association with the customer database;
A process of registering the customer identification information and the customer order history in association with the order database;
Processing for extracting feature amounts of face image data having a human face appearing in video data captured by the camera device;
When the feature amount of the extracted face image data is similar to the feature amount of the face image data registered in the customer database, the extracted face image data, the customer attribute information, and the customer's attribute information Processing for sending customer information including order history to the order terminal;
A process of displaying the transmitted customer information on a display unit of the order terminal;
Customer information presentation method.