WO2016187771A1 - Cloud television data acquisition method and system based on user behaviour analysis - Google Patents
Cloud television data acquisition method and system based on user behaviour analysis Download PDFInfo
- Publication number
- WO2016187771A1 WO2016187771A1 PCT/CN2015/079664 CN2015079664W WO2016187771A1 WO 2016187771 A1 WO2016187771 A1 WO 2016187771A1 CN 2015079664 W CN2015079664 W CN 2015079664W WO 2016187771 A1 WO2016187771 A1 WO 2016187771A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- cluster
- server cluster
- redis
- fpm
- php
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
Definitions
- the present invention relates to the field of smart television technologies, and more particularly to a cloud television data acquisition method and system based on user behavior analysis.
- Smart TVs and TV boxes are becoming more and more popular, but these products are complicated and complex. Most of the people who use the TV are old people and children. These people are not familiar with intelligent products.
- the cloud TV system collects resources and observes the user's behavior. Make these smart TV products easy to use. However, the current cloud TV system is too dependent on the network, and the system cannot be used when there is no network or the network is not in good condition.
- the technical problem to be solved by the present invention is to provide a cloud television data acquisition method and system based on user behavior analysis that does not rely on a network, implements user behavior analysis by creating a database and a server cluster manner, in view of the above-mentioned shortcomings of the prior art.
- the Nginx server cluster obtains the request information sent by the user
- the Nginx server cluster determines whether the cgi cache exists, and when the cgi cache exists, the Cgi cache file is read by the Nginx server cluster and returned to the UE;
- the Php-fpm server cluster When the cgi cache does not exist, the Php-fpm server cluster globally indexes the mysql database through the full-text search engine, and returns the indexed document id to the Php-fpm server cluster;
- the Php-fpm server cluster determines whether video parsing is required. When video parsing is required, the video parsing cluster completes video parsing, and then returns the parsing result to the Php-fpm server cluster.
- the Php-fpm server cluster performs optimization analysis on the received parsed video data, and sends the optimal data resource back to the user end through the Nginx server cluster.
- a redis cluster is created. After completing the video parsing, the video parsing cluster saves the parsing result to the redis cluster and generates a mysql update message.
- the redis cluster determines whether the redis cache exists. When the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
- the redis cluster reads the mysql update message every 10 seconds and updates the message queue process. The execution result is saved in the redis cluster.
- the mysql cluster reads the latest data and updates the mysql data to the redis cluster.
- the invention also provides a cloud television data acquisition system based on user behavior analysis, which comprises:
- the Php-fpm server cluster is further configured to determine whether video parsing is required. When video parsing is required, the video parsing cluster completes video parsing, and then returns the parsing result to the Php-fpm server cluster.
- the Php-fpm server cluster is further configured to perform optimization analysis on the received parsed video data, and send the optimal data resource to the user end through the Nginx server cluster.
- system further comprises:
- a redis cluster configured to receive and save the parsing result sent by the video parsing cluster after the video parsing cluster completes video parsing, generate a mysql update message, and determine not to use the Php-fpm server cluster
- the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
- system further comprises:
- the mysql cluster is configured to save the corresponding cache data in the mysql database to the redis cluster when the redis cache does not exist.
- redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster
- the mysql cluster reads the latest data and updates the mysql data to the redis cluster.
- the invention has the beneficial effects of: server clustering through Nginx, as a user server door and window, Sphinx global index and redis caching mechanism for mysql database, convenient for customers to obtain information more quickly, Php-fpm service cluster automatically analyzes data and puts good resources. It is sent back to the customer through nginx, so that the user's user feedbacks the information, and the automatic extraction of the better resources is presented on the user interface.
- FIG. 1 is a flow chart of a method for acquiring cloud television data based on user behavior analysis according to a preferred embodiment of the present invention
- FIG. 2 is a schematic block diagram of a cloud television data acquisition system based on user behavior analysis according to a preferred embodiment of the present invention.
- the flow of the cloud television data acquisition method based on the user behavior analysis according to the preferred embodiment of the present invention is as shown in FIG. 1.
- the method flow begins in step S101; in step S10, the component Nginx server cluster, the Php-fpm server cluster, and mysql The database and the video parsing cluster; S103, the Nginx server cluster obtains the request information sent by the user; S104, the Nginx server cluster determines whether the cgi cache exists, and when the cgi cache exists, the Nginx server cluster reads the cgi cache file and returns to the user end; S105.
- the Php-fpm server cluster When the cgi cache does not exist, the Php-fpm server cluster globally indexes the mysql database through the full-text search engine, and returns the indexed document id to the Php-fpm service.
- S106 Php-fpm server cluster to determine whether video parsing is required. When video parsing is required, the video parsing cluster completes the video parsing and returns the parsing result to the Php-fpm server cluster;
- S107 Php-fpm server The cluster performs optimization analysis on the received parsed video data, and sends the optimal data resource back to the user end through the Nginx server cluster; the process ends in step S108.
- the invention uses Nginx for server clustering, as a user server door and window, Sphinx global index and redis caching mechanism for mysql database, which facilitates customers to obtain information more quickly, Php-fpm service cluster automatically analyzes data and sends good resources back to nginx. The customer enables the customer's user to feedback back the information, and automatically extracts the better used resources to be presented on the user interface.
- the method for acquiring the cloud television data based on the user behavior analysis further includes the steps of: creating a redis cluster, and after completing the video parsing, the video parsing cluster saves the parsing result to the redis cluster and generates a mysql update message.
- the cloud television data acquisition method based on the user behavior analysis further includes the steps of: when the Php-fpm server cluster determines that video resolution is not required, the redis cluster determines whether the redis cache exists, and when the redis cache exists, directly The redis cache file is sent to the Php-fpm server cluster.
- the cloud television data acquisition method based on the user behavior analysis further includes the steps of: creating a mysql cluster; and saving the corresponding cache data in the mysql database to the redis cluster when the redis cache does not exist.
- the cloud music data acquisition method based on the user behavior analysis further includes the steps of: the redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster.
- the foregoing cloud television data acquisition method based on user behavior analysis further includes steps Step:
- the mysql cluster reads the latest data and updates the mysql data to the redis cluster.
- the present invention also provides a cloud television data acquisition system based on user behavior analysis, as shown in FIG. 2, comprising: obtaining user request information, determining whether a cgi cache exists, and transmitting data when the cgi cache exists.
- a cloud television data acquisition system based on user behavior analysis, as shown in FIG. 2, comprising: obtaining user request information, determining whether a cgi cache exists, and transmitting data when the cgi cache exists.
- Nginx server cluster 10 of the client used to globally index the mysql database through the full-text search engine when the cgi cache does not exist, and return the Php-fpm server cluster 20 of the indexed document id; Php-fpm server cluster 20 It is also used to determine whether video parsing is required.
- the video parsing cluster 30 completes the video parsing, and then returns the parsing result to the Php-fpm server cluster; the Php-fpm server cluster 20 is also used to receive the video.
- the parsed video data is optimized and analyzed, and the optimal data resources are sent back to the client 40 through the Nginx server cluster.
- the system further includes: a redis cluster 50, configured to receive and save the parsing result sent by the video parsing cluster 30 after the video parsing cluster completes the video parsing, and generate a mysql update message, and used in Php-fpm
- a redis cluster 50 configured to receive and save the parsing result sent by the video parsing cluster 30 after the video parsing cluster completes the video parsing, and generate a mysql update message, and used in Php-fpm
- the server cluster 20 determines whether the redis cache exists. When the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
- the above system further includes: a mysql cluster, configured to save the corresponding cache data in the mysql database to the redis cluster 50 when the redis cache does not exist.
- the redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster; the mysql cluster reads the latest data and updates the mysql data to the redis cluster. in.
- Php-fpm service cluster automatically analyzes the data and sends good resources back to the customer through nginx So that the customer's user feedbacks back the information, and automatically extracts the better used resources to be presented on the user interface.
Abstract
The present invention relates to a cloud television data acquisition method and system based on user behaviour analysis. The method comprises the following steps: constructing an Nginx server cluster, a Php-fpm server cluster, an mysql database and a video parsing cluster; the Nginx server cluster acquiring request information sent by a user; judging whether a cgi cache exists; if the cgi cache exists, the Nginx server cluster reading a cgi cache file and returning same to a user end; if the cgi cache does not exist, the Php-fpm server cluster carrying out global indexing on the mysql database via a full text search engine, and returning an indexed document id to the Php-fpm server cluster; and after the Php-fpm server cluster completes video parsing via the video parsing cluster, returning a parsing result, performing optimization analysis on received parsed video data, and sending an optimal data resource to the user end via the Nginx server cluster.
Description
本发明涉及智能电视技术领域，更具体地说，涉及一种基于用户行为分析的云电视数据获取方法及系统。The present invention relates to the field of smart television technologies, and more particularly to a cloud television data acquisition method and system based on user behavior analysis.
智能电视和电视盒目前越来越流行，但是这些产品功能繁多复杂，而习惯用电视人群大多数为老人和小孩，这些人群对智能化产品不熟悉，云电视系统通过收集资源，观察用户的行为，把这些智能电视产品变得简单易用。但目前的云电视系统太过于依赖网络，在没有网络或网络状况不好的时候，系统则无法使用。Smart TVs and TV boxes are becoming more and more popular, but these products are complicated and complex. Most of the people who use the TV are old people and children. These people are not familiar with intelligent products. The cloud TV system collects resources and observes the user's behavior. Make these smart TV products easy to use. However, the current cloud TV system is too dependent on the network, and the system cannot be used when there is no network or the network is not in good condition.
发明内容Summary of the invention
本发明要解决的技术问题在于，针对现有技术的上述缺陷，提供一种不依赖网络、通过创建数据库和服务器集群方式实现用户行为分析的基于用户行为分析的云电视数据获取方法及系统。The technical problem to be solved by the present invention is to provide a cloud television data acquisition method and system based on user behavior analysis that does not rely on a network, implements user behavior analysis by creating a database and a server cluster manner, in view of the above-mentioned shortcomings of the prior art.
本发明解决其技术问题所采用的技术方案是：The technical solution adopted by the present invention to solve the technical problem thereof is:
构造一种基于用户行为分析的云电视数据获取方法，其中，包括以下步骤：Constructing a cloud TV data acquisition method based on user behavior analysis, comprising the following steps:
构件Nginx服务器集群、Php-fpm服务器集群及mysql数据库、视频解析集群；Component Nginx server cluster, Php-fpm server cluster and mysql database, video parsing cluster;
Nginx服务器集群获取用户发送的请求信息；
The Nginx server cluster obtains the request information sent by the user;
Nginx服务器集群判断cgi缓存是否存在，在所述cgi缓存存在时，由所述Nginx服务器集群读取cgi缓存文件并返回至用户端；The Nginx server cluster determines whether the cgi cache exists, and when the cgi cache exists, the Cgi cache file is read by the Nginx server cluster and returned to the UE;
在所述cgi缓存不存在时，所述Php-fpm服务器集群通过全文检索引擎对mysql数据库进行全局索引，并返回索引到的文档id至所述Php-fpm服务器集群；When the cgi cache does not exist, the Php-fpm server cluster globally indexes the mysql database through the full-text search engine, and returns the indexed document id to the Php-fpm server cluster;
所述Php-fpm服务器集群判断是否需要进行视频解析，在需要进行视频解析时，通过视频解析集群完成视频解析后，将解析结果返回至所述Php-fpm服务器集群；The Php-fpm server cluster determines whether video parsing is required. When video parsing is required, the video parsing cluster completes video parsing, and then returns the parsing result to the Php-fpm server cluster.
所述Php-fpm服务器集群对接收到的解析后的视频数据进行优化分析，并将最优数据资源通过所述Nginx服务器集群发回至用户端。The Php-fpm server cluster performs optimization analysis on the received parsed video data, and sends the optimal data resource back to the user end through the Nginx server cluster.
本发明所述的方法，其中，所述方法还进一步包括步骤：The method of the present invention, wherein the method further comprises the steps of:
创建redis集群，所述视频解析集群在完成视频解析后，保存解析结果至所述redis集群，并生成mysql更新消息。A redis cluster is created. After completing the video parsing, the video parsing cluster saves the parsing result to the redis cluster and generates a mysql update message.
本发明所述的方法，其中，所述方法还进一步包括步骤：The method of the present invention, wherein the method further comprises the steps of:
在所述Php-fpm服务器集群判断不需要进行视频解析时，由redis集群判断redis缓存是否存在，在所述redis缓存存在时，直接将redis缓存文件发送至所述Php-fpm服务器集群。When the Php-fpm server cluster determines that video resolution is not required, the redis cluster determines whether the redis cache exists. When the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
本发明所述的方法，其中，所述方法还进一步包括步骤：The method of the present invention, wherein the method further comprises the steps of:
创建mysql集群；Create a mysql cluster;
在所述redis缓存不存在时，将所述mysql数据库中的相应缓存数据保存至所述redis集群中。When the redis cache does not exist, the corresponding cache data in the mysql database is saved to the redis cluster.
本发明所述的方法，其中，所述方法还进一步包括步骤：The method of the present invention, wherein the method further comprises the steps of:
所述redis集群每隔10秒钟读取mysql更新消息，并更新消息队列进程，
并将执行结果保存在所述redis集群中。The redis cluster reads the mysql update message every 10 seconds and updates the message queue process.
The execution result is saved in the redis cluster.
本发明所述的方法，其中，所述方法还进一步包括步骤：The method of the present invention, wherein the method further comprises the steps of:
mysql集群读取最新数据，并更新mysql数据到所述redis集群中。The mysql cluster reads the latest data and updates the mysql data to the redis cluster.
本发明还提供了一种基于用户行为分析的云电视数据获取系统，其中，包括：The invention also provides a cloud television data acquisition system based on user behavior analysis, which comprises:
用于获取用户发送的请求信息、判断cgi缓存是否存在，并在所述cgi缓存存在时将数据发回至用户端的Nginx服务器集群；Used to obtain request information sent by the user, determine whether the cgi cache exists, and send the data back to the Nginx server cluster of the user end when the cgi cache exists;
用于在所述cgi缓存不存在时，通过全文检索引擎对mysql数据库进行全局索引，并返回索引到的文档id的Php-fpm服务器集群；Used to globally index the mysql database through the full-text search engine when the cgi cache does not exist, and return the Php-fpm server cluster of the indexed document id;
所述Php-fpm服务器集群还用于判断是否需要进行视频解析，在需要进行视频解析时，通过视频解析集群完成视频解析后，将解析结果返回至所述Php-fpm服务器集群；The Php-fpm server cluster is further configured to determine whether video parsing is required. When video parsing is required, the video parsing cluster completes video parsing, and then returns the parsing result to the Php-fpm server cluster.
所述Php-fpm服务器集群还用于对接收到的解析后的视频数据进行优化分析，并将最优数据资源通过所述Nginx服务器集群发回至用户端。The Php-fpm server cluster is further configured to perform optimization analysis on the received parsed video data, and send the optimal data resource to the user end through the Nginx server cluster.
本发明所述的系统，其中，所述系统还进一步包括：The system of the present invention, wherein the system further comprises:
redis集群，用于在所述视频解析集群在完成视频解析后，接收并保存由所述视频解析集群发送的解析结果，并生成mysql更新消息，以及用于在所述Php-fpm服务器集群判断不需要进行视频解析时，判断redis缓存是否存在，在所述redis缓存存在时，直接将redis缓存文件发送至所述Php-fpm服务器集群。a redis cluster, configured to receive and save the parsing result sent by the video parsing cluster after the video parsing cluster completes video parsing, generate a mysql update message, and determine not to use the Php-fpm server cluster When the video parsing needs to be performed, it is determined whether the redis cache exists. When the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
本发明所述的系统，其中，所述系统还进一步包括：The system of the present invention, wherein the system further comprises:
mysql集群，用于在所述redis缓存不存在时，将所述mysql数据库中的相应缓存数据保存至所述redis集群中。
The mysql cluster is configured to save the corresponding cache data in the mysql database to the redis cluster when the redis cache does not exist.
本发明所述的系统，其中，所述redis集群每隔10秒钟读取mysql更新消息，并更新消息队列进程，并将执行结果保存在所述redis集群中；The system of the present invention, wherein the redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster;
所述mysql集群读取最新数据，并更新mysql数据到所述redis集群中。The mysql cluster reads the latest data and updates the mysql data to the redis cluster.
本发明的有益效果在于：通过Nginx进行服务器集群，做为用户服务器门窗，Sphinx对mysql数据库全局索引和redis缓存机制，方便客户更快速获取信息，Php-fpm服务集群自动分析数据并把好的资源通过nginx发回给客户，使得客户的用户反馈回来信息，自动提取比较好用资源呈现在用户界面上。The invention has the beneficial effects of: server clustering through Nginx, as a user server door and window, Sphinx global index and redis caching mechanism for mysql database, convenient for customers to obtain information more quickly, Php-fpm service cluster automatically analyzes data and puts good resources. It is sent back to the customer through nginx, so that the user's user feedbacks the information, and the automatic extraction of the better resources is presented on the user interface.
下面将结合附图及实施例对本发明作进一步说明，附图中：The present invention will be further described below in conjunction with the accompanying drawings and embodiments, in which:
图1是本发明较佳实施例的基于用户行为分析的云电视数据获取方法流程图；1 is a flow chart of a method for acquiring cloud television data based on user behavior analysis according to a preferred embodiment of the present invention;
图2是本发明较佳实施例的基于用户行为分析的云电视数据获取系统原理框图。2 is a schematic block diagram of a cloud television data acquisition system based on user behavior analysis according to a preferred embodiment of the present invention.
本发明较佳实施例的基于用户行为分析的云电视数据获取方法流程如图1所示，所述方法流程开始于步骤S101；在步骤S10中、构件Nginx服务器集群、Php-fpm服务器集群及mysql数据库、视频解析集群；S103、Nginx服务器集群获取用户发送的请求信息；S104、Nginx服务器集群判断cgi缓存是否存在，在cgi缓存存在时，由Nginx服务器集群读取cgi缓存文件并返回至用户端；S105、在cgi缓存不存在时，Php-fpm服务器集群通过全文检索引擎对mysql数据库进行全局索引，并返回索引到的文档id至Php-fpm服务
器集群；S106、Php-fpm服务器集群判断是否需要进行视频解析，在需要进行视频解析时，通过视频解析集群完成视频解析后，将解析结果返回至Php-fpm服务器集群；S107、Php-fpm服务器集群对接收到的解析后的视频数据进行优化分析，并将最优数据资源通过Nginx服务器集群发回至用户端；该流程结束于步骤S108。本发明通过Nginx进行服务器集群，做为用户服务器门窗，Sphinx对mysql数据库全局索引和redis缓存机制，方便客户更快速获取信息，Php-fpm服务集群自动分析数据并把好的资源通过nginx发回给客户，使得客户的用户反馈回来信息，自动提取比较好用资源呈现在用户界面上。The flow of the cloud television data acquisition method based on the user behavior analysis according to the preferred embodiment of the present invention is as shown in FIG. 1. The method flow begins in step S101; in step S10, the component Nginx server cluster, the Php-fpm server cluster, and mysql The database and the video parsing cluster; S103, the Nginx server cluster obtains the request information sent by the user; S104, the Nginx server cluster determines whether the cgi cache exists, and when the cgi cache exists, the Nginx server cluster reads the cgi cache file and returns to the user end; S105. When the cgi cache does not exist, the Php-fpm server cluster globally indexes the mysql database through the full-text search engine, and returns the indexed document id to the Php-fpm service.
S106, Php-fpm server cluster to determine whether video parsing is required. When video parsing is required, the video parsing cluster completes the video parsing and returns the parsing result to the Php-fpm server cluster; S107, Php-fpm server The cluster performs optimization analysis on the received parsed video data, and sends the optimal data resource back to the user end through the Nginx server cluster; the process ends in step S108. The invention uses Nginx for server clustering, as a user server door and window, Sphinx global index and redis caching mechanism for mysql database, which facilitates customers to obtain information more quickly, Php-fpm service cluster automatically analyzes data and sends good resources back to nginx. The customer enables the customer's user to feedback back the information, and automatically extracts the better used resources to be presented on the user interface.
进一步地，上述基于用户行为分析的云电视数据获取方法还进一步包括步骤：创建redis集群，视频解析集群在完成视频解析后，保存解析结果至redis集群，并生成mysql更新消息。Further, the method for acquiring the cloud television data based on the user behavior analysis further includes the steps of: creating a redis cluster, and after completing the video parsing, the video parsing cluster saves the parsing result to the redis cluster and generates a mysql update message.
进一步地，上述基于用户行为分析的云电视数据获取方法还进一步包括步骤：在Php-fpm服务器集群判断不需要进行视频解析时，由redis集群判断redis缓存是否存在，在redis缓存存在时，直接将redis缓存文件发送至Php-fpm服务器集群。Further, the cloud television data acquisition method based on the user behavior analysis further includes the steps of: when the Php-fpm server cluster determines that video resolution is not required, the redis cluster determines whether the redis cache exists, and when the redis cache exists, directly The redis cache file is sent to the Php-fpm server cluster.
进一步地，上述基于用户行为分析的云电视数据获取方法还进一步包括步骤：创建mysql集群；在redis缓存不存在时，将mysql数据库中的相应缓存数据保存至redis集群中。Further, the cloud television data acquisition method based on the user behavior analysis further includes the steps of: creating a mysql cluster; and saving the corresponding cache data in the mysql database to the redis cluster when the redis cache does not exist.
进一步地，上述基于用户行为分析的云电视数据获取方法还进一步包括步骤：redis集群每隔10秒钟读取mysql更新消息，并更新消息队列进程，并将执行结果保存在redis集群中。Further, the cloud music data acquisition method based on the user behavior analysis further includes the steps of: the redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster.
进一步地，上述基于用户行为分析的云电视数据获取方法还进一步包括步
骤：mysql集群读取最新数据，并更新mysql数据到redis集群中。Further, the foregoing cloud television data acquisition method based on user behavior analysis further includes steps
Step: The mysql cluster reads the latest data and updates the mysql data to the redis cluster.
本发明还提供了一种基于用户行为分析的云电视数据获取系统，如图2所示，包括：用于获取用户发送的请求信息、判断cgi缓存是否存在，并在cgi缓存存在时将数据发回至用户端的Nginx服务器集群10；用于在cgi缓存不存在时，通过全文检索引擎对mysql数据库进行全局索引，并返回索引到的文档id的Php-fpm服务器集群20；Php-fpm服务器集群20还用于判断是否需要进行视频解析，在需要进行视频解析时，通过视频解析集群30完成视频解析后，将解析结果返回至Php-fpm服务器集群；Php-fpm服务器集群20还用于对接收到的解析后的视频数据进行优化分析，并将最优数据资源通过Nginx服务器集群发回至用户端40。The present invention also provides a cloud television data acquisition system based on user behavior analysis, as shown in FIG. 2, comprising: obtaining user request information, determining whether a cgi cache exists, and transmitting data when the cgi cache exists. Back to the Nginx server cluster 10 of the client; used to globally index the mysql database through the full-text search engine when the cgi cache does not exist, and return the Php-fpm server cluster 20 of the indexed document id; Php-fpm server cluster 20 It is also used to determine whether video parsing is required. When video parsing is required, the video parsing cluster 30 completes the video parsing, and then returns the parsing result to the Php-fpm server cluster; the Php-fpm server cluster 20 is also used to receive the video. The parsed video data is optimized and analyzed, and the optimal data resources are sent back to the client 40 through the Nginx server cluster.
进一步地，上述系统还包括：redis集群50，用于在视频解析集群在完成视频解析后，接收并保存由视频解析集群30发送的解析结果，并生成mysql更新消息，以及用于在Php-fpm服务器集群20判断不需要进行视频解析时，判断redis缓存是否存在，在redis缓存存在时，直接将redis缓存文件发送至Php-fpm服务器集群。Further, the system further includes: a redis cluster 50, configured to receive and save the parsing result sent by the video parsing cluster 30 after the video parsing cluster completes the video parsing, and generate a mysql update message, and used in Php-fpm When the server cluster 20 determines that video resolution is not required, it determines whether the redis cache exists. When the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
进一步地，上述系统还包括：mysql集群，用于在redis缓存不存在时，将mysql数据库中的相应缓存数据保存至redis集群50中。Further, the above system further includes: a mysql cluster, configured to save the corresponding cache data in the mysql database to the redis cluster 50 when the redis cache does not exist.
进一步地，上述系统中，redis集群每隔10秒钟读取mysql更新消息，并更新消息队列进程，并将执行结果保存在redis集群中；mysql集群读取最新数据，并更新mysql数据到redis集群中。Further, in the above system, the redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster; the mysql cluster reads the latest data and updates the mysql data to the redis cluster. in.
本发明的上述方案中，需要搭建服务器，进行负载均衡防止用户量大服务器死机，同时需要根据通信协议编程客户端程序和管理系统，统计分析；同时需要根据客户的用户反馈回来信息，自动提取比较好用资源呈现在用户界面
上。通过上述Nginx进行服务器集群，做为用户服务器门窗，Sphinx对mysql数据库全局索引和redis缓存机制，方便客户更快速获取信息，Php-fpm服务集群自动分析数据并把好的资源通过nginx发回给客户，使得客户的用户反馈回来信息，自动提取比较好用资源呈现在用户界面上。In the above solution of the present invention, it is necessary to set up a server to perform load balancing to prevent a large amount of server crashes, and at the same time, to program a client program and a management system according to a communication protocol, and perform statistical analysis; and at the same time, it is necessary to automatically return the information according to feedback from the user. Easy to use resources presented in the user interface
on. Through the above Nginx server cluster, as a user server door and window, Sphinx mysql database global index and redis caching mechanism, to facilitate customers to obtain information faster, Php-fpm service cluster automatically analyzes the data and sends good resources back to the customer through nginx So that the customer's user feedbacks back the information, and automatically extracts the better used resources to be presented on the user interface.
应当理解的是，对本领域普通技术人员来说，可以根据上述说明加以改进或变换，而所有这些改进和变换都应属于本发明所附权利要求的保护范围。
It is to be understood that those skilled in the art will be able to make modifications and changes in accordance with the above description, and all such modifications and variations are intended to be included within the scope of the appended claims.
Claims (10)
- 一种基于用户行为分析的云电视数据获取方法，其特征在于，包括以下步骤：A cloud television data acquisition method based on user behavior analysis, comprising the following steps:构件Nginx服务器集群、Php-fpm服务器集群及mysql数据库、视频解析集群；Component Nginx server cluster, Php-fpm server cluster and mysql database, video parsing cluster;Nginx服务器集群获取用户发送的请求信息；The Nginx server cluster obtains the request information sent by the user;Nginx服务器集群判断cgi缓存是否存在，在所述cgi缓存存在时，由所述Nginx服务器集群读取cgi缓存文件并返回至用户端；The Nginx server cluster determines whether the cgi cache exists, and when the cgi cache exists, the Cgi cache file is read by the Nginx server cluster and returned to the UE;在所述cgi缓存不存在时，所述Php-fpm服务器集群通过全文检索引擎对mysql数据库进行全局索引，并返回索引到的文档id至所述Php-fpm服务器集群；When the cgi cache does not exist, the Php-fpm server cluster globally indexes the mysql database through the full-text search engine, and returns the indexed document id to the Php-fpm server cluster;所述Php-fpm服务器集群判断是否需要进行视频解析，在需要进行视频解析时，通过视频解析集群完成视频解析后，将解析结果返回至所述Php-fpm服务器集群；The Php-fpm server cluster determines whether video parsing is required. When video parsing is required, the video parsing cluster completes video parsing, and then returns the parsing result to the Php-fpm server cluster.所述Php-fpm服务器集群对接收到的解析后的视频数据进行优化分析，并将最优数据资源通过所述Nginx服务器集群发回至用户端。The Php-fpm server cluster performs optimization analysis on the received parsed video data, and sends the optimal data resource back to the user end through the Nginx server cluster.
- 根据权利要求1所述的方法，其特征在于，所述方法还进一步包括步骤：The method of claim 1 wherein the method further comprises the step of:创建redis集群，所述视频解析集群在完成视频解析后，保存解析结果至所述redis集群，并生成mysql更新消息。A redis cluster is created. After completing the video parsing, the video parsing cluster saves the parsing result to the redis cluster and generates a mysql update message.
- 根据权利要求2所述的方法，其特征在于，所述方法还进一步包括步骤： The method of claim 2, wherein the method further comprises the step of:在所述Php-fpm服务器集群判断不需要进行视频解析时，由redis集群判断redis缓存是否存在，在所述redis缓存存在时，直接将redis缓存文件发送至所述Php-fpm服务器集群。When the Php-fpm server cluster determines that video resolution is not required, the redis cluster determines whether the redis cache exists. When the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
- 根据权利要求3所述的方法，其特征在于，所述方法还进一步包括步骤：The method of claim 3, wherein the method further comprises the step of:创建mysql集群；Create a mysql cluster;在所述redis缓存不存在时，将所述mysql数据库中的相应缓存数据保存至所述redis集群中。When the redis cache does not exist, the corresponding cache data in the mysql database is saved to the redis cluster.
- 根据权利要求4所述的方法，其特征在于，所述方法还进一步包括步骤：The method of claim 4, wherein the method further comprises the step of:所述redis集群每隔10秒钟读取mysql更新消息，并更新消息队列进程，并将执行结果保存在所述redis集群中。The redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster.
- 根据权利要求5所述的方法，其特征在于，所述方法还进一步包括步骤：The method of claim 5, wherein the method further comprises the step of:mysql集群读取最新数据，并更新mysql数据到所述redis集群中。The mysql cluster reads the latest data and updates the mysql data to the redis cluster.
- 一种基于用户行为分析的云电视数据获取系统，其特征在于，包括：A cloud television data acquisition system based on user behavior analysis, comprising:用于获取用户发送的请求信息、判断cgi缓存是否存在，并在所述cgi缓存存在时将数据发回至用户端的Nginx服务器集群；Used to obtain request information sent by the user, determine whether the cgi cache exists, and send the data back to the Nginx server cluster of the user end when the cgi cache exists;用于在所述cgi缓存不存在时，通过全文检索引擎对mysql数据库进行全局索引，并返回索引到的文档id的Php-fpm服务器集群；Used to globally index the mysql database through the full-text search engine when the cgi cache does not exist, and return the Php-fpm server cluster of the indexed document id;所述Php-fpm服务器集群还用于判断是否需要进行视频解析，在需要进行视频解析时，通过视频解析集群完成视频解析后，将解析结果返回至所述Php-fpm服务器集群； The Php-fpm server cluster is further configured to determine whether video parsing is required. When video parsing is required, the video parsing cluster completes video parsing, and then returns the parsing result to the Php-fpm server cluster.所述Php-fpm服务器集群还用于对接收到的解析后的视频数据进行优化分析，并将最优数据资源通过所述Nginx服务器集群发回至用户端。The Php-fpm server cluster is further configured to perform optimization analysis on the received parsed video data, and send the optimal data resource to the user end through the Nginx server cluster.
- 根据权利要求7所述的系统，其特征在于，所述系统还进一步包括：The system of claim 7 wherein the system further comprises:redis集群，用于在所述视频解析集群在完成视频解析后，接收并保存由所述视频解析集群发送的解析结果，并生成mysql更新消息，以及用于在所述Php-fpm服务器集群判断不需要进行视频解析时，判断redis缓存是否存在，在所述redis缓存存在时，直接将redis缓存文件发送至所述Php-fpm服务器集群。a redis cluster, configured to receive and save the parsing result sent by the video parsing cluster after the video parsing cluster completes video parsing, generate a mysql update message, and determine not to use the Php-fpm server cluster When the video parsing needs to be performed, it is determined whether the redis cache exists. When the redis cache exists, the redis cache file is directly sent to the Php-fpm server cluster.
- 根据权利要求8所述的系统，其特征在于，所述系统还进一步包括：The system of claim 8 wherein the system further comprises:mysql集群，用于在所述redis缓存不存在时，将所述mysql数据库中的相应缓存数据保存至所述redis集群中。The mysql cluster is configured to save the corresponding cache data in the mysql database to the redis cluster when the redis cache does not exist.
- 根据权利要求9所述的系统，其特征在于，所述redis集群每隔10秒钟读取mysql更新消息，并更新消息队列进程，并将执行结果保存在所述redis集群中；The system according to claim 9, wherein the redis cluster reads the mysql update message every 10 seconds, updates the message queue process, and saves the execution result in the redis cluster;所述mysql集群读取最新数据，并更新mysql数据到所述redis集群中。 The mysql cluster reads the latest data and updates the mysql data to the redis cluster.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2015/079664 WO2016187771A1 (en) | 2015-05-25 | 2015-05-25 | Cloud television data acquisition method and system based on user behaviour analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2015/079664 WO2016187771A1 (en) | 2015-05-25 | 2015-05-25 | Cloud television data acquisition method and system based on user behaviour analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016187771A1 true WO2016187771A1 (en) | 2016-12-01 |
Family
ID=57392281
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2015/079664 WO2016187771A1 (en) | 2015-05-25 | 2015-05-25 | Cloud television data acquisition method and system based on user behaviour analysis |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2016187771A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109672711A (en) * | 2017-10-17 | 2019-04-23 | 航天信息股份有限公司 | A kind of http request processing method and system based on Reverse Proxy Nginx |
| CN109861958A (en) * | 2018-11-20 | 2019-06-07 | 新疆福禄网络科技有限公司 | Data gathering system and method based on Nginx |
| CN112988499A (en) * | 2019-12-16 | 2021-06-18 | 北京百度网讯科技有限公司 | Data processing method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5907837A (en) * | 1995-07-17 | 1999-05-25 | Microsoft Corporation | Information retrieval system in an on-line network including separate content and layout of published titles |
| CN102426589A (en) * | 2011-10-31 | 2012-04-25 | 合一网络技术(北京)有限公司 | Interlayer system used for searching database information and information searching method |
| WO2013064815A1 (en) * | 2011-11-04 | 2013-05-10 | Performance Horizon Group | Method and database system for manipulating data |
| CN104361030A (en) * | 2014-10-24 | 2015-02-18 | 西安未来国际信息股份有限公司 | Distributed cache architecture with task distribution function and cache method |
-
2015
- 2015-05-25 WO PCT/CN2015/079664 patent/WO2016187771A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5907837A (en) * | 1995-07-17 | 1999-05-25 | Microsoft Corporation | Information retrieval system in an on-line network including separate content and layout of published titles |
| CN102426589A (en) * | 2011-10-31 | 2012-04-25 | 合一网络技术(北京)有限公司 | Interlayer system used for searching database information and information searching method |
| WO2013064815A1 (en) * | 2011-11-04 | 2013-05-10 | Performance Horizon Group | Method and database system for manipulating data |
| CN104361030A (en) * | 2014-10-24 | 2015-02-18 | 西安未来国际信息股份有限公司 | Distributed cache architecture with task distribution function and cache method |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109672711A (en) * | 2017-10-17 | 2019-04-23 | 航天信息股份有限公司 | A kind of http request processing method and system based on Reverse Proxy Nginx |
| CN109672711B (en) * | 2017-10-17 | 2021-08-06 | 航天信息股份有限公司 | Reverse proxy server Nginx-based http request processing method and system |
| CN109861958A (en) * | 2018-11-20 | 2019-06-07 | 新疆福禄网络科技有限公司 | Data gathering system and method based on Nginx |
| CN109861958B (en) * | 2018-11-20 | 2022-08-16 | 新疆福禄网络科技有限公司 | Nginx-based data collection system and method |
| CN112988499A (en) * | 2019-12-16 | 2021-06-18 | 北京百度网讯科技有限公司 | Data processing method and device, electronic equipment and storage medium |
| US11445008B2 (en) | 2019-12-16 | 2022-09-13 | Apollo Intelligent Connectivity (Beijing) Technology Co., Ltd. | Data processing methods, electronic devices, and storage media |
| CN112988499B (en) * | 2019-12-16 | 2022-10-21 | 阿波罗智联(北京)科技有限公司 | Data processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108984650B (en) | Computer-readable recording medium and computer device | |
| US10027739B1 (en) | Performance-based content delivery | |
| US20160217013A1 (en) | Method and system for generating a virtual device resource accessible by an application | |
| US10891302B2 (en) | Scalable synchronization with cache and index management | |
| US20140365523A1 (en) | Push subscriptions | |
| WO2017092582A1 (en) | Data processing method and apparatus | |
| US20200218699A1 (en) | Systems and computer implemented methods for semantic data compression | |
| CN103095743A (en) | Handling method and system of grey release | |
| EP2047382A1 (en) | Two-way and multi-master synchronization over web syndications | |
| CN104899274B (en) | A kind of memory database Efficient Remote access method | |
| WO2020108507A1 (en) | Method and system for providing metadata information of a network function service and related device | |
| CN103312751A (en) | Instant messaging method based on browser | |
| TWI507890B (en) | Pushlet instant messaging method and platform | |
| CN102375865B (en) | The message updating method of a kind of information client side and information client side | |
| WO2016187771A1 (en) | Cloud television data acquisition method and system based on user behaviour analysis | |
| US9531827B1 (en) | Push notification delivery system with feedback analysis | |
| CN105871590A (en) | Client data updating method, client and server | |
| WO2016101446A1 (en) | Data analysis method, apparatus, system, and terminal, and server | |
| CN105701224A (en) | Security information customized service system based on big data | |
| US9544384B2 (en) | Method and system for pushing associated users in social networking service network | |
| WO2017124660A1 (en) | System and method for associating multi-stage assembly transactions | |
| US10033737B2 (en) | System and method for cross-cloud identity matching | |
| CN106445968B (en) | Data merging method and device | |
| CN113377817A (en) | Data processing method, system, device and storage medium | |
| CN105636121A (en) | Server login and data synchronization method and system for client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15892852 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 15892852 Country of ref document: EP Kind code of ref document: A1 |