WO2013082742A1 - Resource scheduling method, device and system - Google Patents

Resource scheduling method, device and system Download PDF

Info

Publication number
WO2013082742A1
WO2013082742A1 PCT/CN2011/083472 CN2011083472W WO2013082742A1 WO 2013082742 A1 WO2013082742 A1 WO 2013082742A1 CN 2011083472 W CN2011083472 W CN 2011083472W WO 2013082742 A1 WO2013082742 A1 WO 2013082742A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual machine
application
resources
cloud platform
external
Prior art date
Application number
PCT/CN2011/083472
Other languages
French (fr)
Chinese (zh)
Inventor
张妮
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2011/083472 priority Critical patent/WO2013082742A1/en
Priority to CN201180003668.6A priority patent/CN103503404A/en
Publication of WO2013082742A1 publication Critical patent/WO2013082742A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061Partitioning or combining of resources
    • G06F9/5072Grid computing

Definitions

  • Embodiments of the present invention relate to network communication technologies, and in particular, to a resource scheduling method, apparatus, and system. Background technique
  • the cloud is an emerging network-based distributed technology that encapsulates specific technical details through the cloud and then provides services by providing users with a relatively simple interface.
  • Many enterprises currently deploy private cloud platforms to migrate applications to their own private cloud platforms.
  • ERP Enterprise Resource Planning
  • the enterprise calculates the amount of resources required based on the traffic of a specific application, thereby deploying resources for the application within the enterprise private cloud platform.
  • the existing technology for deploying resources for an application in the enterprise's private cloud platform is to calculate the virtual machine cluster of the internal cloud platform by calculating the resources required for each time zone application and then applying the maximum required resources according to each time zone application. Perform static configuration of resources.
  • the business volume of applications in most enterprises is not stable in different time zones. For example: The business volume of applications in most enterprises has surged at the end of the year, but it has been stable in other time zones. If the enterprise deploys the application based on the maximum number of resources calculated in each time zone, in the most time zone where the traffic is low, more resources in the configured resources are idle, resulting in waste of resources. If the enterprise does not deploy resources based on the maximum amount of traffic calculated by the application in each time zone, when the application peaks in traffic, the pre-deployed resources will be insufficient to provide the corresponding services. Summary of the invention
  • the embodiment of the invention provides a resource scheduling method, device and system for supplementing internal cloud resources by scheduling external cloud resources, thereby ensuring service quality of the application.
  • the embodiment of the invention provides a resource scheduling method, including:
  • the process of the application After receiving the virtual machine information returned by the external cloud platform, the process of the application is deployed to an external virtual machine pointed to by the virtual machine information.
  • the embodiment of the invention further provides a resource scheduling device, including:
  • the information is obtained by using the ear block to obtain the traffic of each process currently running in the application, and the application is deployed in the virtual machine cluster of the internal cloud platform;
  • a resource number determining module configured to determine, according to the pre-obtained process scaling policy of the application, the number of resources that the virtual machine cluster needs to expand, when the traffic of each process that is currently running in the application meets a preset condition
  • a resource scheduling application module configured to send a virtual machine application request to the external cloud platform according to the determined number of resources when determining to apply for scheduling resources to the external cloud platform;
  • the application process migration module is configured to deploy the process of the application to an external virtual machine pointed to by the virtual machine information after receiving the virtual machine information returned by the external cloud platform.
  • the embodiment of the invention further provides a resource scheduling system, including:
  • the resource scheduling device is connected to the internal cloud platform and the external cloud platform.
  • the resource scheduling method, device, and system provided by the embodiments of the present invention may perform dynamic resource scheduling according to the process of the process for the service volume of each application of the deployed virtual machine cluster.
  • the dynamic scheduling process of the resource if the idle resource of the internal cloud platform cannot meet the service growth requirement of the application, the external cloud platform may apply for resources for resource supplementation, and the process of the external virtual machine is deployed, thereby ensuring The quality of service applied.
  • FIG. 1 is a flowchart of a resource scheduling method according to Embodiment 1 of the present invention.
  • FIG. 2 is a schematic structural diagram of a resource scheduling system according to Embodiment 2 of the present invention.
  • FIG. 3 is an example of an internal structure of the internal cloud platform in FIG. 2;
  • FIG. 4 is a signaling interaction diagram of a resource scheduling method according to Embodiment 3 of the present invention.
  • FIG. 5 is a signaling interaction diagram of a resource scheduling method according to Embodiment 4 of the present invention.
  • FIG. 6 is a schematic structural diagram of a resource scheduling apparatus according to Embodiment 5 of the present invention. detailed description
  • FIG. 1 is a flowchart of a resource scheduling method according to Embodiment 1 of the present invention. The method shown in Figure 1 includes:
  • Step 11 Obtain the traffic of each process currently running in the application, where the application is deployed in a virtual machine cluster of the internal cloud platform.
  • the internal cloud platform is pre-deployed with multiple virtual machine clusters; one virtual machine cluster includes multiple virtual machines; one virtual machine cluster can deploy one application or multiple applications; one application can include one or more processes; one process can be deployed at On one or more virtual machines.
  • the real-time business load of the deployed applications in the virtual machine cluster in the internal cloud platform can be obtained.
  • the real-time service load of an application may include: information about the currently running process in the application, the traffic volume of each process, and the like; the traffic of a certain process is information such as the number of user requests received by the process.
  • Step 12 When the traffic of each process currently running in the application meets the preset condition, determine the number of resources that the virtual machine cluster needs to expand according to the pre-obtained process scaling policy of the application.
  • the preset conditions described in this step can be set according to actual needs.
  • the preset condition may be: the sum of the traffic of each process of the application is greater than the first preset threshold, and the idle resources of the virtual machine cluster cannot be The traffic of the virtual machine cluster cannot be satisfied. These processes have increased business volume requirements.
  • the idle resources of the virtual machine cluster may be acquired in advance.
  • the number of resources that the virtual machine cluster needs to expand is determined according to the pre-obtained process scaling policy of the application.
  • the application's process scaling policy can be pre-fetched, such as obtaining from an application deployment request provided by the user.
  • the process scaling policy may include: increasing the number of processes of the application; in this case, the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes.
  • the process scaling policy may include: increasing the number of resources of one or more processes currently running in the application; in this case, the number of resources that the virtual machine cluster needs to expand is: for each process currently running in the application. The total number of resources to be added.
  • Step 13 When determining to apply for scheduling resources to the external cloud platform, send a virtual machine application request to the external cloud platform according to the determined number of the resources.
  • This step may decide whether to apply for scheduling resources to the external cloud platform according to a predetermined policy.
  • this step may be based on the idle resource status of the internal cloud platform, and the decision is to apply for scheduling resources to the external cloud platform or the internal cloud platform. For example, if the resources of the internal cloud platform are sufficient, and the idle resources of the internal cloud platform can provide the determined scheduling of the number of the resources, the determined resources may be scheduled for the virtual machine cluster in the idle resources of the internal cloud platform. number. If the resources of the internal cloud platform are insufficient, and the idle resources of the internal cloud platform cannot provide the determined scheduling of the number of the resources, the virtual machine application request may be sent to the external cloud platform according to the determined number of the resources, and used to the external cloud platform. Apply for scheduling resources.
  • the step may further determine whether to apply for scheduling resources to the external cloud platform according to the traffic volume change trend of each process currently running in the application. If the traffic growth of each process currently running in the application is a short-term behavior, it is determined to apply for scheduling resources to the external cloud platform; if the traffic growth of each process currently running in the application is a long-term behavior, then determining to the external cloud platform Apply for scheduling resources.
  • Step 14 After receiving the virtual machine information returned by the external cloud platform, deploy the process of the application to an external virtual machine pointed to by the virtual machine information.
  • virtual environment deployment based on internal cloud platform The virtual machine is called an internal virtual machine; the virtual machine deployed based on the physical resources of the external cloud platform is called an external virtual machine.
  • the external cloud platform After receiving the virtual machine application request, the external cloud platform deploys the external virtual machine according to the virtual machine application request and returns the virtual machine information; the virtual machine information includes: information such as the access address of the external virtual machine.
  • the process of the application After receiving the virtual machine information returned by the external cloud platform, the process of the application may be deployed to the external virtual machine according to the preset process migration policy.
  • the preset process migration policy is as follows: a process in which the frequency of interaction with other processes is lower than a preset threshold, that is, the first process, the internal virtual machine of the virtual machine cluster of the application is deployed from the internal cloud platform, and the internal virtual machine is migrated to the external virtual machine. on. After the first process is migrated to the external virtual machine, the internal cloud platform deploys the resources occupied by the first process released by the virtual machine cluster of the application, and can be used by other processes provided to the application to meet the service quality of the application. Claim. In addition, since the first process interacts with other processes less frequently, the migration of the first process to the external virtual machine does not increase the interaction between the processes, thereby having less impact on the performance and quality of the application. .
  • the preset process migration policy may also be: deploying all processes currently running in the application on the external virtual machine, and migrating part of the application's business load from the internal virtual machine of the virtual machine cluster to the external virtual machine. After this deployment, the application can load balance through internal virtual machines and external virtual machines, thus ensuring the service quality of the application.
  • the above two process migration strategies can be applied to deploy a single application in a virtual machine cluster, and can also be applied to deploy multiple applications in a virtual machine cluster.
  • the preset process migration policy may also be, for example, one of a plurality of applications deployed in the virtual machine cluster, that is, the first application and the currently running in the application. All processes migrate from the internal virtual machines of the virtual machine cluster to the external virtual machines. After the deployment, the resources occupied by the first application released by the virtual machine cluster can be used to provide services for other applications deployed in the virtual machine cluster to ensure the service quality of other applications, and the service and quality of service of the first application may be External virtual machine is provided.
  • the resource scheduling method provided in this embodiment may dynamically schedule resources according to the process of the process for the service volume of each process of the application deployed in the virtual machine cluster.
  • the external cloud platform may apply for resources for resource supplementation, and the process of the external virtual machine is deployed, thereby ensuring The quality of service applied.
  • FIG. 2 is a schematic structural diagram of a resource scheduling system according to Embodiment 2 of the present invention.
  • the resource scheduling system shown in FIG. 2 includes: an internal cloud platform 21, a resource scheduling device 22, and an external cloud platform 23; the resource scheduling device 22 is communicatively coupled to the internal cloud platform 21 and the external cloud platform 23, respectively.
  • the internal structure of the internal cloud platform 21 can be as shown in FIG. 3.
  • the internal cloud platform can deploy multiple virtual machine clusters based on physical resources of the internal cloud platform, and each virtual machine cluster includes one or more virtual machines, one virtual A cluster consists of multiple virtual machines; a virtual machine cluster can deploy one application or multiple applications; one application can include multiple processes; and one process can be deployed on one or more virtual machines.
  • the internal cloud platform 21 can be a private cloud platform; or the internal cloud platform 21 can be a public cloud platform, such as the Amazon Elastic Compute Cloud (Amazon EC2) platform.
  • Amazon Elastic Compute Cloud Amazon Elastic Compute Cloud
  • the resource scheduling device 22 is responsible for requesting resources such as external virtual machines from the external cloud platform when the service load of an application deployed on the internal cloud platform meets the preset conditions and the idle resources of the internal cloud platform cannot meet the application service quality.
  • the external cloud platform 23 may be a private cloud platform; or the external cloud platform 23 may be a public cloud platform, such as Amazon EC2, IBM Capacity on Demand (IBM COD), HP Enterprise service, etc. cloud platform.
  • Amazon EC2 IBM Capacity on Demand (IBM COD)
  • IBM Capacity on Demand (IBM COD) HP Enterprise service, etc. cloud platform.
  • FIG. 4 is a signaling interaction diagram of a resource scheduling method according to Embodiment 3 of the present invention. This embodiment is described by taking the resource scheduling system shown in FIG. 2 and FIG. 3 as an example. In this embodiment, a virtual machine cluster is taken as an example, and an application is deployed in the virtual machine cluster. As shown in Figure 2-4, the resource scheduling method provided in this embodiment includes:
  • Step 41 The resource scheduling device collects information about the virtual machine cluster information and the application service quality.
  • the VM cluster information includes: the identifier of the deployed VM cluster, the application of each VM cluster deployment, and the resource usage of each VM cluster.
  • the application service quality related information includes: application corresponding virtual machine cluster, application load status, and the like; application load conditions include: information about the currently running process in the application, and the traffic volume of each process.
  • Step 42 The resource scheduling device determines, according to the application service quality related information of the application, whether the traffic volume of each process currently running in the application meets the preset condition. If yes, go to step 43; otherwise, go to step 41.
  • the preset conditions described in this step can be set according to actual needs.
  • the preset condition can be: The sum of the traffic of each process is greater than the first preset threshold, and the idle resources of the virtual machine cluster cannot meet the traffic growth requirement of each process of the application; or, the preset condition may also be: The traffic of each of the multiple processes is greater than the second preset threshold, and the idle resources of the virtual machine cluster cannot meet the traffic growth requirements of the processes.
  • the idle resources of the virtual machine cluster may be acquired in advance.
  • the number of resources that the virtual machine cluster needs to expand is determined according to the pre-obtained process scaling policy of the application.
  • Step 43 The resource scheduling device acquires a process scaling policy of the application, and determines, according to the process scaling policy, the number of resources that the virtual machine cluster needs to expand.
  • the application's process scaling policy can be pre-fetched, such as obtaining from an application deployment request provided by the user.
  • the process scaling policy may include: increasing the number of processes of the application; in this case, the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes.
  • the process scaling policy may include: increasing the number of resources of one or more processes currently running in the application; in this case, the number of resources that the virtual machine cluster needs to expand is: for each process currently running in the application. The total number of resources to be added.
  • Step 44 The resource scheduling device may apply for the resource to the internal cloud platform or the external cloud platform according to the application service quality related information of the application, and if it is determined to apply for the resource to the internal cloud platform, perform step 45; if it is determined to the external cloud platform To apply for resources, go to Step 49.
  • the resource scheduling device may analyze the traffic volume change trend of each application process according to the application service quality related information of the application, and determine whether to apply for scheduling resources to the internal cloud platform or the external cloud platform according to the analysis result. If the analysis results indicate that the business load of each process of the application is a long-term phenomenon, resources can be applied to the internal cloud platform. If the analysis result indicates that the service load of each process of the application is a short-term phenomenon, resources can be applied to the external cloud platform, thereby avoiding the problem of low resource utilization caused by the blind expansion of the physical resources of the internal cloud platform.
  • Step 45 The resource scheduling device sends a resource request request to the internal cloud platform for requesting the determined number of resources for the virtual machine cluster scheduling.
  • the resource application request may include: determining the number of the resources, the identifier of the virtual machine cluster, and the like.
  • Step 46 The internal cloud platform receives the resource application request, determines whether the determined scheduling of the number of resources can be provided, and if yes, performs step 47; otherwise, performs step 49.
  • the internal cloud platform determines the number of idle resources and the number of resources requested by the resource application request. Is it possible to provide this resource scheduling?
  • the internal cloud platform may provide the determined scheduling of the number of resources.
  • the internal cloud platform cannot provide the determined scheduling of the number of resources.
  • Step 47 The internal cloud platform allocates physical resources matching the determined number of the resources in the idle resource, and sends the information of the allocated physical resources to the resource scheduling device.
  • the internal cloud platform determines a schedule that can provide the determined number of the resources, allocate, in an idle resource of the internal cloud platform, a physical resource that matches the determined number of the resources, and send the information of the allocated physical resource to the resource. Dispatching device.
  • Step 48 The resource scheduling device performs process scaling processing according to the foregoing process scaling policy based on the physical resources allocated by the internal cloud platform.
  • the resource scheduling device process scaling processing for example, the resource scheduling device adds a preset number of processes to the virtual machine cluster, or the resource scheduling device increases the memory resources available to the one or more processes that the application needs to increase resources.
  • Step 49 The resource scheduling apparatus sends a virtual machine application request to the external cloud platform according to the determined number of the resources.
  • the virtual machine application request includes: the specification and quantity of the virtual machine, the image identifier that the virtual machine needs to be installed, the virtual machine cluster information corresponding to the virtual machine, and the external cloud platform identifier.
  • the file corresponding to the image ID that the virtual machine needs to be installed can be uploaded to the external cloud platform through the interface of the external cloud platform.
  • the external cloud platform can be a private cloud platform; or the external cloud platform can be a public cloud platform, such as
  • Cloud platforms such as Amazon EC2, IBM COD, and HP Enterprise Business.
  • the resource scheduling device specifically requests from which external cloud platform to apply for resources, which can be pre-configured by the administrator.
  • the resource scheduling device may automatically decide which external cloud platform to apply for the resource according to the predetermined condition, for example, according to the specification information of the virtual machine that can be provided by the external cloud platform acquired in advance, the same specification of the virtual machine specification required for the current resource scheduling can be provided. Or an external cloud platform close to the specification, as a target external cloud platform.
  • Step 410 The external cloud platform receives the virtual machine application request, and deploys the external virtual machine according to the virtual machine application request in the physical resource of the external cloud platform.
  • the virtual machine information is returned to the resource scheduling device.
  • Step 411 The external cloud platform returns virtual machine information to the resource scheduling device.
  • the virtual machine information may include: an access address of an external virtual machine, and the like.
  • Step 412 The resource scheduling device stores related information of the external virtual machine.
  • the resource scheduling device may include: an access address of the external virtual machine, a virtual machine cluster information corresponding to the external virtual machine, a resource attribute of the external virtual machine, and the like; wherein the resource attribute of the external virtual machine may be: an external cloud Resources.
  • Step 413 The resource scheduling device performs process scaling processing according to the foregoing process scaling policy, and deploys the applied process according to the preset process migration policy on the external virtual machine pointed to by the received virtual machine information.
  • the resource scheduling device process scaling processing for example, the resource scheduling device adds a preset number of processes to the virtual machine cluster, or the resource scheduling device increases the memory resources available to the one or more processes that the application needs to increase resources.
  • the preset process migration policy is as follows: a process in which the frequency of interaction with other processes is lower than a preset threshold, that is, the first process, the internal virtual machine of the virtual machine cluster of the application is deployed from the internal cloud platform, and the internal virtual machine is migrated to the external virtual machine. on. After the first process is migrated to the external virtual machine, the internal cloud platform deploys the resources occupied by the first process released by the virtual machine cluster of the application, and can be used by other processes provided to the application to meet the service quality of the application. Claim. In addition, since the first process interacts with other processes less frequently, the migration of the first process to the external virtual machine does not increase the interaction between the processes, thereby having less impact on the performance and quality of the application. .
  • the preset process migration policy may also be: deploying all processes currently running in the application on the external virtual machine, and migrating part of the application's business load from the internal virtual machine of the virtual machine cluster to the external virtual machine. After this deployment, the application can load balance through internal virtual machines and external virtual machines, thus ensuring the service quality of the application.
  • the dynamic scheduling of the resources may be performed according to the real-time service load of the deployed application of the virtual machine cluster.
  • the dynamic scheduling process of resources it is possible to determine whether to allocate resources to the internal cloud platform or to the external cloud platform according to the service load trend of the application, thereby improving the flexibility of resource scheduling.
  • the external cloud platform can be applied for resources for resource supplementation, and the flexible process migration strategy is used to deploy the external virtual machine process, thereby ensuring the protection. The quality of service applied.
  • FIG. 5 is a signaling interaction diagram of a resource scheduling method according to Embodiment 4 of the present invention.
  • This embodiment is described by taking the resource scheduling system shown in FIG. 2 and FIG. 3 as an example.
  • a virtual machine cluster is taken as an example, and the virtual machine cluster is deployed with multiple applications.
  • the resource scheduling method provided in this embodiment includes:
  • Step 51 The resource scheduling device collects information about the application service quality of each application deployed by the virtual machine cluster information and the virtual machine cluster.
  • Step 52 The resource scheduling device determines, according to the application service quality related information of each application in the virtual machine cluster, whether the traffic volume of each process currently running in each application meets the preset condition. If yes, go to step 53; otherwise, perform the step. 51.
  • Step 53 - Step 512 The application involved in the step 53 - 512 is an application in which the traffic of each process currently running meets the preset condition in the application deployed in the virtual machine cluster, and other technical solutions and steps 43 - 412 Similar, it will not be repeated here.
  • Step 513 The resource scheduling device deploys the process of the application according to the preset process migration policy on the external virtual machine pointed to by the received virtual machine information.
  • the resource scheduling device may include: an access address of the external virtual machine, a virtual machine cluster information corresponding to the external virtual machine, a resource attribute of the external virtual machine, and the like; wherein the resource attribute of the external virtual machine may be: an external cloud Resources.
  • the preset process migration policy is as follows: a process in which the frequency of interaction with other processes is lower than a preset threshold, that is, the first process, the internal virtual machine of the virtual machine cluster of the application is deployed from the internal cloud platform, and the internal virtual machine is migrated to the external virtual machine. on. After the first process is migrated to the external virtual machine, the internal cloud platform deploys the resources occupied by the first process released by the virtual machine cluster of the application, and can be used by other processes provided to the application to meet the service quality of the application. Claim. In addition, since the first process interacts with other processes less frequently, the migration of the first process to the external virtual machine does not increase the interaction between the processes, thereby having less impact on the performance and quality of the application. .
  • the preset process migration policy may also be: deploying all processes currently running in the application on the external virtual machine, and migrating part of the application's business load from the internal virtual machine of the virtual machine cluster to the external virtual machine. After this deployment, the application can load balance through internal virtual machines and external virtual machines, thus ensuring the service quality of the application.
  • one of the multiple applications deployed in the virtual machine cluster such as the first application and all processes currently running in the application, all migrate from the internal virtual machine of the virtual machine cluster to the external virtual Planned.
  • the resources occupied by the first application released by the virtual machine cluster can be used to provide services for other applications deployed in the virtual machine cluster to ensure the service quality of other applications, and the service and quality of service of the first application may be External virtual machine is provided.
  • the real-time service load of each deployed application of the virtual machine cluster is dynamically scheduled in a scenario where multiple applications are deployed in a virtual machine cluster.
  • the dynamic scheduling process of resources it is possible to determine whether to allocate resources to the internal cloud platform or to the external cloud platform according to the traffic load trend of an application, thereby improving the flexibility of resource scheduling.
  • the external cloud platform can be applied for resources for resource supplementation, and the flexible process migration strategy is used to deploy the external virtual machine process, thereby ensuring the protection. Quality of service for multiple applications deployed by this virtual machine cluster.
  • FIG. 6 is a schematic structural diagram of a resource scheduling apparatus according to Embodiment 5 of the present invention.
  • the resource scheduling apparatus shown in FIG. 6 includes: an information obtaining module 61, a resource number determining module 62, a resource scheduling request module 63, and an application process migration module 64.
  • the information acquisition block 61 can be used to obtain the traffic of each process currently running in the application, and the application is deployed in the virtual machine cluster of the internal cloud platform;
  • the resource number determining module 62 is configured to determine, according to the pre-obtained process scaling policy of the application, the number of resources that the virtual machine cluster needs to expand, when the traffic of each process that is currently running in the application meets the preset condition;
  • the resource scheduling application module 63 may be configured to send a virtual machine application request to the external cloud platform according to the determined number of resources when determining to apply for scheduling resources to the external cloud platform;
  • the application process migration module 64 is configured to deploy the process of the application to an external virtual machine pointed to by the virtual machine information after receiving the virtual machine information returned by the external cloud platform.
  • the process scaling policy includes: increasing the number of processes of the application; the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes.
  • the process scaling policy includes: increasing a number of resources of one or more processes currently running in the application; the number of resources that the virtual machine cluster needs to expand is: being currently running in the application The total amount of resources required for each process.
  • the application process migration module can perform process migration deployment according to the preset process migration policy. For example, if a virtual machine cluster is deployed with one or more applications, the application process migration module 64 is specifically configured to determine the first process according to the inter-process topology relationship of the application, and the first process is The internal virtual machine of the virtual machine cluster is migrated to the external virtual machine; the first process is a process that is currently running in the application and whose frequency of interaction with other processes is lower than a preset frequency.
  • the application process migration module 64 is specifically configured to deploy each process currently running in the application on the external virtual machine, and load part of the service load of the application.
  • the internal virtual machine of the virtual machine cluster is migrated to the external virtual machine.
  • the application process migration module 64 is specifically configured to use the first application of the plurality of applications and the processes currently running in the first application from the internal of the virtual machine cluster. The virtual machine is migrated to the external virtual machine.
  • the resource scheduling apparatus may further include: a scheduling decision module 65.
  • the scheduling decision module 65 may be configured to determine to apply for scheduling resources to the external cloud platform when the idle resources of the internal cloud platform cannot provide the determined scheduling of the number of resources. Alternatively, the scheduling decision module 65 may be configured to analyze a trend of the traffic volume of each process currently running in the application, and determine to apply for scheduling resources to the external cloud platform according to the analysis result.
  • the resource scheduling apparatus can dynamically schedule resources according to the real-time service load of the deployed application of the virtual machine cluster.
  • the dynamic scheduling process of resources it is possible to determine whether to allocate resources to the internal cloud platform or to the external cloud platform according to the service load trend of the application, thereby improving the flexibility of resource scheduling.
  • the external cloud platform can be applied for resources for resource supplementation, and the flexible process migration strategy is used to deploy the external virtual machine process, thereby ensuring the protection.
  • the quality of service applied For the working mechanism of the resource scheduling apparatus in this embodiment, refer to the corresponding descriptions of the corresponding embodiments in FIG. 1 and FIG. 4-5.
  • the structure of the resource scheduling system in the hybrid cloud mode of the resource scheduling apparatus can be referred to the corresponding embodiment in FIG. 2-3. Record; no longer repeat here.
  • modules in the apparatus in the embodiments may be distributed in the apparatus of the embodiment according to the embodiment, or may be correspondingly changed in one or more apparatuses different from the embodiment.
  • the modules of the above embodiments may be combined into one module, or may be further split into a plurality of sub-modules.
  • the foregoing program may be stored in a computer readable storage medium, and when executed, the program includes the steps of the foregoing method embodiment; and the foregoing storage medium includes: ROM, RAM , a variety of media that can store program code, such as a disk or an optical disk.

Abstract

The present invention relates to a resource scheduling method, device and system. The method includes: acquiring the traffic of each service currently running in an application, the application being deployed in a virtual machine cluster of an internal cloud platform; determining the number of resources to be extended by the virtual machine cluster according to a pre-acquired process extension policy of the application when the traffic of each service currently running in the application meets a preset condition; sending a virtual machine application request to an external cloud platform according to the determined number of resources when it is determined to apply for resource scheduling to the external cloud platform; and after receiving virtual machine information returned by the external cloud platform, deploying a process of the application for an external virtual machine to which the virtual machine information points. The present invention ensures the quality of service of an application by scheduling external cloud resources to complement the internal cloud resources.

Description

资源调度方法、 装置和系统 技术领域  Resource scheduling method, device and system
本发明实施例涉及网络通信技术, 特别是涉及一种资源调度方法、 装置 和系统。 背景技术  Embodiments of the present invention relate to network communication technologies, and in particular, to a resource scheduling method, apparatus, and system. Background technique
云是一种新兴的基于网络的分布式技术, 通过云可以将具体的技术细节 进行封装, 然后通过向用户提供相对简单的接口来提供服务。 目前很多企业 都部署有私有云平台, 将应用迁移到企业各自的私有云平台。 如中国电信、 移动等企业, 他们的应用包括企业资源计划系统 ( Enterprise Resource Planning , 简称 ERP )、 计费、 网上营业厅、 计费统计分析、 营销分析、 门户 网站等, 他们将各自的应用部署到企业自身的私有云平台上。  The cloud is an emerging network-based distributed technology that encapsulates specific technical details through the cloud and then provides services by providing users with a relatively simple interface. Many enterprises currently deploy private cloud platforms to migrate applications to their own private cloud platforms. Such as China Telecom, mobile and other enterprises, their applications include Enterprise Resource Planning (ERP), billing, online business hall, billing statistics analysis, marketing analysis, portals, etc., they will deploy their respective applications. Go to the company's own private cloud platform.
通常, 企业会根据具体应用的业务量计算所需的资源数, 从而在企业私 有云平台内为该应用部署相应资源。 在企业的私有云平台中为某个应用部署 资源的现有技术, 是通过计算各时区应用所需的资源, 然后按照各时区应用 所需使用资源的最大值, 对内部云平台的虚拟机集群进行资源的静态配置。  Typically, the enterprise calculates the amount of resources required based on the traffic of a specific application, thereby deploying resources for the application within the enterprise private cloud platform. The existing technology for deploying resources for an application in the enterprise's private cloud platform is to calculate the virtual machine cluster of the internal cloud platform by calculating the resources required for each time zone application and then applying the maximum required resources according to each time zone application. Perform static configuration of resources.
但是, 多数企业的应用的业务量在不同时区并不稳定, 例如: 多数企业 的应用的业务量在年底激增, 但在其他时区则比较平稳。 如果企业按照各时 区计算的资源数的最大值进行应用部署, 则在业务量较低的多数时区, 已配 置的资源中较多资源处于空闲状态, 造成资源浪费。 如果企业不按该应用各 时区计算的业务量的最大值部署资源, 则在该应用出现业务量峰值时, 则会 因预先部署的资源不足, 从而无法提供相应业务。 发明内容  However, the business volume of applications in most enterprises is not stable in different time zones. For example: The business volume of applications in most enterprises has surged at the end of the year, but it has been stable in other time zones. If the enterprise deploys the application based on the maximum number of resources calculated in each time zone, in the most time zone where the traffic is low, more resources in the configured resources are idle, resulting in waste of resources. If the enterprise does not deploy resources based on the maximum amount of traffic calculated by the application in each time zone, when the application peaks in traffic, the pre-deployed resources will be insufficient to provide the corresponding services. Summary of the invention
本发明实施例提供一种资源调度方法、 装置和系统, 用以通过调度外部 云资源对内部云资源进行补充, 从而保障应用的服务质量。  The embodiment of the invention provides a resource scheduling method, device and system for supplementing internal cloud resources by scheduling external cloud resources, thereby ensuring service quality of the application.
本发明实施例提供了一种资源调度方法, 包括:  The embodiment of the invention provides a resource scheduling method, including:
获取应用中当前运行的各进程的业务量, 所述应用部署在内部云平台的 虚拟机集群中; 在所述应用中当前运行的各进程的业务量满足预设条件时, 根据预先获 取的所述应用的进程伸缩策略, 确定所述虚拟机集群需要扩展的资源数; 在确定向外部云平台申请调度资源时, 根据确定的所述资源数向外部云 平台发送虚拟机申请请求; Obtaining the traffic of each process currently running in the application, where the application is deployed in a virtual machine cluster of the internal cloud platform; When the traffic of each process currently running in the application meets the preset condition, determine the number of resources that the virtual machine cluster needs to expand according to the pre-obtained process scaling policy of the application; and determine to apply to the external cloud platform. When scheduling resources, sending a virtual machine application request to the external cloud platform according to the determined number of resources;
在接收到所述外部云平台返回的虚拟机信息之后, 向所述虚拟机信息指 向的外部虚拟机部署所述应用的进程。  After receiving the virtual machine information returned by the external cloud platform, the process of the application is deployed to an external virtual machine pointed to by the virtual machine information.
本发明实施例还提供了一种资源调度装置, 包括:  The embodiment of the invention further provides a resource scheduling device, including:
信息获耳 莫块, 用于获取应用中当前运行的各进程的业务量, 所述应用 部署在内部云平台的虚拟机集群中;  The information is obtained by using the ear block to obtain the traffic of each process currently running in the application, and the application is deployed in the virtual machine cluster of the internal cloud platform;
资源数确定模块, 用于在所述应用中当前运行的各进程的业务量满足预 设条件时, 根据预先获取的所述应用的进程伸缩策略, 确定所述虚拟机集群 需要扩展的资源数;  a resource number determining module, configured to determine, according to the pre-obtained process scaling policy of the application, the number of resources that the virtual machine cluster needs to expand, when the traffic of each process that is currently running in the application meets a preset condition;
资源调度申请模块, 用于在确定向外部云平台申请调度资源时, 根据确 定的所述资源数向外部云平台发送虚拟机申请请求;  a resource scheduling application module, configured to send a virtual machine application request to the external cloud platform according to the determined number of resources when determining to apply for scheduling resources to the external cloud platform;
应用进程迁移模块, 用于在接收到所述外部云平台返回的虚拟机信息之 后, 向所述虚拟机信息指向的外部虚拟机部署所述应用的进程。  The application process migration module is configured to deploy the process of the application to an external virtual machine pointed to by the virtual machine information after receiving the virtual machine information returned by the external cloud platform.
本发明实施例还提供了一种资源调度系统, 包括:  The embodiment of the invention further provides a resource scheduling system, including:
内部云平台和外部云平台; 以及  Internal cloud platform and external cloud platform;
上述资源调度装置; 所述资源调度装置与所述内部云平台和所述外部云 平台通信连接。  The resource scheduling device is connected to the internal cloud platform and the external cloud platform.
本发明实施例提供的资源调度方法、 装置和系统, 可根据对虚拟机集群 已部署的应用各进程的业务量, 以进程为粒度进行资源的动态调度。 在资源 的动态调度过程中, 如果内部云平台的空闲资源无法满足该应用的业务增长 需求时, 可向外部云平台申请资源以进行资源补充, 并进行外部虚拟机的进 程部署, 由此保障了应用的服务质量。 附图说明  The resource scheduling method, device, and system provided by the embodiments of the present invention may perform dynamic resource scheduling according to the process of the process for the service volume of each application of the deployed virtual machine cluster. In the dynamic scheduling process of the resource, if the idle resource of the internal cloud platform cannot meet the service growth requirement of the application, the external cloud platform may apply for resources for resource supplementation, and the process of the external virtual machine is deployed, thereby ensuring The quality of service applied. DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案, 下面将对实 施例或现有技术描述中所需要使用的附图作简单地介绍, 显而易见地, 下面 描述中的附图仅仅是本发明的一些实施例, 对于本领域普通技术人员来讲, 在不付出创造性劳动性的前提下, 还可以根据这些附图获得其他的附图。 图 1为本发明实施例一提供的资源调度方法流程图; In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is some embodiments of the present invention, and those of ordinary skill in the art, Other drawings may also be obtained from these drawings without the inventive labor. FIG. 1 is a flowchart of a resource scheduling method according to Embodiment 1 of the present invention;
图 2为本发明实施例二提供的资源调度系统的结构示意图;  2 is a schematic structural diagram of a resource scheduling system according to Embodiment 2 of the present invention;
图 3为图 2中内部云平台的内部结构示例;  FIG. 3 is an example of an internal structure of the internal cloud platform in FIG. 2;
图 4为本发明实施例三提供的资源调度方法的信令交互图;  4 is a signaling interaction diagram of a resource scheduling method according to Embodiment 3 of the present invention;
图 5为本发明实施例四提供的资源调度方法的信令交互图;  FIG. 5 is a signaling interaction diagram of a resource scheduling method according to Embodiment 4 of the present invention;
图 6为本发明实施例五提供的资源调度装置的结构示意图。 具体实施方式  FIG. 6 is a schematic structural diagram of a resource scheduling apparatus according to Embodiment 5 of the present invention. detailed description
下面将结合本发明实施例中的附图, 对本发明实施例中的技术方案进行 清楚、 完整地描述, 显然, 所描述的实施例仅仅是本发明一部分实施例, 而 不是全部的实施例。 基于本发明中的实施例, 本领域普通技术人员在没有付 出创造性劳动前提下所获得的所有其他实施例, 都属于本发明保护的范围。  The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without the creative work are all within the scope of the present invention.
本发明以下实施例的序号仅仅为了描述, 不代表实施例的优劣。  The serial numbers of the following embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.
图 1为本发明实施例一提供的资源调度方法流程图。 如图 1所示的方法包 括:  FIG. 1 is a flowchart of a resource scheduling method according to Embodiment 1 of the present invention. The method shown in Figure 1 includes:
步骤 11 : 获取应用中当前运行的各进程的业务量, 所述应用部署在内部 云平台的虚拟机集群中。  Step 11: Obtain the traffic of each process currently running in the application, where the application is deployed in a virtual machine cluster of the internal cloud platform.
内部云平台预先部署有多个虚拟机集群; 一个虚拟机集群包括多个虚拟 机; 一个虚拟机集群可部署一个应用或多个应用; 一个应用可包括一个或多 个进程; 一个进程可部署在一个或多个虚拟机上。  The internal cloud platform is pre-deployed with multiple virtual machine clusters; one virtual machine cluster includes multiple virtual machines; one virtual machine cluster can deploy one application or multiple applications; one application can include one or more processes; one process can be deployed at On one or more virtual machines.
在内部云平台的应用部署完成之后, 可获取内部云平台中虚拟机集群中 已部署的应用的实时业务负载。 某应用的实时业务负载可包括: 该应用中当 前运行的进程、 各进程的业务量等信息; 某一进程的业务量如该进程接收到 的用户请求数等信息。  After the application deployment of the internal cloud platform is completed, the real-time business load of the deployed applications in the virtual machine cluster in the internal cloud platform can be obtained. The real-time service load of an application may include: information about the currently running process in the application, the traffic volume of each process, and the like; the traffic of a certain process is information such as the number of user requests received by the process.
步骤 12: 在所述应用中当前运行的各进程的业务量满足预设条件时, 根 据预先获取的所述应用的进程伸缩策略, 确定所述虚拟机集群需要扩展的资 源数。  Step 12: When the traffic of each process currently running in the application meets the preset condition, determine the number of resources that the virtual machine cluster needs to expand according to the pre-obtained process scaling policy of the application.
本步骤所述的预设条件可根据实际需要设定。 例如, 预设条件可为: 应 用的各进程的业务量之和大于第一预设门限, 且虚拟机集群的空闲资源不能 满足该应用各进程的业务量增长需求; 或者, 预设条件还可为: 应用中当前 运行的一个或多个进程各自的业务量大于第二预设门限, 且虚拟机集群的空 闲资源不能满足这些进程业务量增长需求。 其中, 上述虚拟机集群的空闲资 源可预先获取。 The preset conditions described in this step can be set according to actual needs. For example, the preset condition may be: the sum of the traffic of each process of the application is greater than the first preset threshold, and the idle resources of the virtual machine cluster cannot be The traffic of the virtual machine cluster cannot be satisfied. These processes have increased business volume requirements. The idle resources of the virtual machine cluster may be acquired in advance.
如果所述应用中当前运行的各进程的业务量满足预设条件, 则根据预先 获取的所述应用的进程伸缩策略, 确定所述虚拟机集群需要扩展的资源数。  If the traffic of each process currently running in the application meets the preset condition, the number of resources that the virtual machine cluster needs to expand is determined according to the pre-obtained process scaling policy of the application.
该应用的进程伸缩策略可预先获取, 如从用户提供的应用部署请求中获 取等。 进程伸缩策略可包括: 增加所述应用的进程数; 该情形下, 虚拟机集 群需要扩展的资源数为: 增加预设数量的进程所需的资源数。 或者, 进程伸 缩策略可包括: 增加该应用中当前运行的一个或多个进程的资源数; 该情形 下, 所述虚拟机集群需要扩展的资源数为: 为该应用中当前运行的各进程所 需增加的资源总数。  The application's process scaling policy can be pre-fetched, such as obtaining from an application deployment request provided by the user. The process scaling policy may include: increasing the number of processes of the application; in this case, the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes. Alternatively, the process scaling policy may include: increasing the number of resources of one or more processes currently running in the application; in this case, the number of resources that the virtual machine cluster needs to expand is: for each process currently running in the application. The total number of resources to be added.
步骤 13 : 在确定向外部云平台申请调度资源时, 根据确定的所述资源数 向外部云平台发送虚拟机申请请求。  Step 13: When determining to apply for scheduling resources to the external cloud platform, send a virtual machine application request to the external cloud platform according to the determined number of the resources.
本步骤可根据预定策略, 决策是否向外部云平台申请调度资源。  This step may decide whether to apply for scheduling resources to the external cloud platform according to a predetermined policy.
可选的, 本步骤可根据内部云平台的空闲资源情况, 决策是向外部云平 台还是内部云平台申请调度资源。 例如: 如果内部云平台的资源较为充足, 内部云平台的空闲资源能够提供确定的所述资源数的调度, 则可在内部云平 台的空闲资源中, 为该虚拟机集群调度确定的所述资源数。 如果内部云平台 的资源不足, 内部云平台的空闲资源不能提供确定的所述资源数的调度, 则 可根据确定的所述资源数向外部云平台发送虚拟机申请请求, 用于向外部云 平台申请调度资源。  Optionally, this step may be based on the idle resource status of the internal cloud platform, and the decision is to apply for scheduling resources to the external cloud platform or the internal cloud platform. For example, if the resources of the internal cloud platform are sufficient, and the idle resources of the internal cloud platform can provide the determined scheduling of the number of the resources, the determined resources may be scheduled for the virtual machine cluster in the idle resources of the internal cloud platform. number. If the resources of the internal cloud platform are insufficient, and the idle resources of the internal cloud platform cannot provide the determined scheduling of the number of the resources, the virtual machine application request may be sent to the external cloud platform according to the determined number of the resources, and used to the external cloud platform. Apply for scheduling resources.
可选的,本步骤还可根据该应用中当前运行的各进程的业务量变化趋势, 决策是否向外部云平台申请调度资源。 如果该应用中当前运行的各进程的业 务量增长是个短期行为, 则确定向外部云平台申请调度资源; 如果该应用中 当前运行的各进程的业务量增长是个长期行为, 则确定向外部云平台申请调 度资源。  Optionally, the step may further determine whether to apply for scheduling resources to the external cloud platform according to the traffic volume change trend of each process currently running in the application. If the traffic growth of each process currently running in the application is a short-term behavior, it is determined to apply for scheduling resources to the external cloud platform; if the traffic growth of each process currently running in the application is a long-term behavior, then determining to the external cloud platform Apply for scheduling resources.
步骤 14: 在接收到所述外部云平台返回的虚拟机信息之后, 向所述虚拟 机信息指向的外部虚拟机部署所述应用的进程。  Step 14: After receiving the virtual machine information returned by the external cloud platform, deploy the process of the application to an external virtual machine pointed to by the virtual machine information.
为便于描述, 本发明实施例中: 将基于内部云平台的物理资源部署的虚 拟机, 称为内部虚拟机; 将基于外部云平台的物理资源部署的虚拟机, 称为 外部虚拟机。 For ease of description, in the embodiment of the present invention: virtual environment deployment based on internal cloud platform The virtual machine is called an internal virtual machine; the virtual machine deployed based on the physical resources of the external cloud platform is called an external virtual machine.
外部云平台在接收到虚拟机申请请求之后, 会根据虚拟机申请请求部署 外部虚拟机, 并返回虚拟机信息; 该虚拟机信息包括: 外部虚拟机的访问地 址等信息。 在接收到外部云平台返回的虚拟机信息之后, 可将该应用的进程, 按照预设进程迁移策略部署到外部虚拟机上。  After receiving the virtual machine application request, the external cloud platform deploys the external virtual machine according to the virtual machine application request and returns the virtual machine information; the virtual machine information includes: information such as the access address of the external virtual machine. After receiving the virtual machine information returned by the external cloud platform, the process of the application may be deployed to the external virtual machine according to the preset process migration policy.
预设进程迁移策略例如: 将应用中与其他进程交互频度低于预设门限的 进程, 即第一进程, 从内部云平台部署该应用的虚拟机集群的内部虚拟机, 迁移到外部虚拟机上。 当第一进程迁移到外部虚拟机上之后, 内部云平台部 署该应用的虚拟机集群释放的该第一进程占用的资源, 可用于提供给该应用 的其他进程使用, 以满足该应用服务质量的要求。 此外, 由于第一进程与其 他进程交互的频率较低, 因此, 将第一进程迁移到外部虚拟机, 不会增加太 多进程间的交互, 由此对应用的性能和服务质量的影响较小。  The preset process migration policy is as follows: a process in which the frequency of interaction with other processes is lower than a preset threshold, that is, the first process, the internal virtual machine of the virtual machine cluster of the application is deployed from the internal cloud platform, and the internal virtual machine is migrated to the external virtual machine. on. After the first process is migrated to the external virtual machine, the internal cloud platform deploys the resources occupied by the first process released by the virtual machine cluster of the application, and can be used by other processes provided to the application to meet the service quality of the application. Claim. In addition, since the first process interacts with other processes less frequently, the migration of the first process to the external virtual machine does not increase the interaction between the processes, thereby having less impact on the performance and quality of the application. .
或者, 预设进程迁移策略还可例如: 在外部虚拟机上部署该应用中当前 运行的所有进程, 并将该应用的部分业务负载从虚拟机集群的内部虚拟机迁 移到外部虚拟机。 如此部署之后, 该应用可通过内部虚拟机和外部虚拟机进 行负载分担, 由此保障了该应用的服务质量。  Alternatively, the preset process migration policy may also be: deploying all processes currently running in the application on the external virtual machine, and migrating part of the application's business load from the internal virtual machine of the virtual machine cluster to the external virtual machine. After this deployment, the application can load balance through internal virtual machines and external virtual machines, thus ensuring the service quality of the application.
上述两种进程迁移策略可应用于在一个虚拟机集群部署单个应用的情 形, 还可应用于在一个虚拟机集群部署多个应用的情形。  The above two process migration strategies can be applied to deploy a single application in a virtual machine cluster, and can also be applied to deploy multiple applications in a virtual machine cluster.
此外, 如果在一个虚拟机集群部署多个应用的情形下, 预设进程迁移策 略还可例如: 将该虚拟机集群部署的多个应用中一个应用, 即第一应用以及 该应用中当前运行的所有进程, 从虚拟机集群的内部虚拟机全部迁移到外部 虚拟机。 如此部署之后, 虚拟机集群释放的第一应用占用的资源, 可用于为 该虚拟机集群部署的其他应用提供服务, 来保障其他应用的服务质量, 而第 一应用的业务及其服务质量, 可由外部虚拟机提供。  In addition, if a plurality of applications are deployed in a virtual machine cluster, the preset process migration policy may also be, for example, one of a plurality of applications deployed in the virtual machine cluster, that is, the first application and the currently running in the application. All processes migrate from the internal virtual machines of the virtual machine cluster to the external virtual machines. After the deployment, the resources occupied by the first application released by the virtual machine cluster can be used to provide services for other applications deployed in the virtual machine cluster to ensure the service quality of other applications, and the service and quality of service of the first application may be External virtual machine is provided.
本实施例提供的资源调度方法, 可根据对虚拟机集群已部署的应用各进 程的业务量, 以进程为粒度进行资源的动态调度。 在资源的动态调度过程中, 如果内部云平台的空闲资源无法满足该应用的业务增长需求时, 可向外部云 平台申请资源以进行资源补充, 并进行外部虚拟机的进程部署, 由此保障了 应用的服务质量。 图 2为本发明实施例二提供的资源调度系统的结构示意图。 如图 2所示的 资源调度系统包括: 内部云平台 21、 资源调度装置 22和外部云平台 23; 资源 调度装置 22分别与内部云平台 21和外部云平台 23通信连接。 The resource scheduling method provided in this embodiment may dynamically schedule resources according to the process of the process for the service volume of each process of the application deployed in the virtual machine cluster. In the dynamic scheduling process of the resource, if the idle resource of the internal cloud platform cannot meet the service growth requirement of the application, the external cloud platform may apply for resources for resource supplementation, and the process of the external virtual machine is deployed, thereby ensuring The quality of service applied. FIG. 2 is a schematic structural diagram of a resource scheduling system according to Embodiment 2 of the present invention. The resource scheduling system shown in FIG. 2 includes: an internal cloud platform 21, a resource scheduling device 22, and an external cloud platform 23; the resource scheduling device 22 is communicatively coupled to the internal cloud platform 21 and the external cloud platform 23, respectively.
内部云平台 21的内部结构可参见图 3所示, 具体的, 内部云平台可基于内 部云平台的物理资源部署多个虚拟机集群, 每个虚拟机集群包括一个或多个 虚拟机, 一个虚拟机集群包括多个虚拟机; 一个虚拟机集群可部署一个应用 或多个应用; 一个应用可包括至多个进程; 一个进程可部署在一个或多个虚 拟机上。 内部云平台 21可为私有云平台; 或者, 内部云平台 21可为公有云平 台, 如亚马逊弹性可扩展的云计算(Amazon Elastic Compute Cloud, 简称 Amazon EC2 )平台等。  The internal structure of the internal cloud platform 21 can be as shown in FIG. 3. Specifically, the internal cloud platform can deploy multiple virtual machine clusters based on physical resources of the internal cloud platform, and each virtual machine cluster includes one or more virtual machines, one virtual A cluster consists of multiple virtual machines; a virtual machine cluster can deploy one application or multiple applications; one application can include multiple processes; and one process can be deployed on one or more virtual machines. The internal cloud platform 21 can be a private cloud platform; or the internal cloud platform 21 can be a public cloud platform, such as the Amazon Elastic Compute Cloud (Amazon EC2) platform.
资源调度装置 22负责在内部云平台已部署的某一应用的业务负载满足预 设条件、 且内部云平台的空闲资源不能满足应用服务质量时, 向外部云平台 申请外部虚拟机等资源。  The resource scheduling device 22 is responsible for requesting resources such as external virtual machines from the external cloud platform when the service load of an application deployed on the internal cloud platform meets the preset conditions and the idle resources of the internal cloud platform cannot meet the application service quality.
外部云平台 23可为私有云平台; 或者, 外部云平台 23可为公有云平台, 如 Amazon EC2、 IBM按需扩容( IBM Capacity on Demand, 简称 IBM COD )、 惠普企业业务 ( HP Enterprise service )等云平台。  The external cloud platform 23 may be a private cloud platform; or the external cloud platform 23 may be a public cloud platform, such as Amazon EC2, IBM Capacity on Demand (IBM COD), HP Enterprise service, etc. cloud platform.
图 4为本发明实施例三提供的资源调度方法的信令交互图。本实施例是以 图 2和图 3所示的资源调度系统为例进行说明。本实施例一个虚拟机集群为例, 且该虚拟机集群部署一个应用。 如图 2-4所示, 本实施例提供的资源调度方法 包括:  FIG. 4 is a signaling interaction diagram of a resource scheduling method according to Embodiment 3 of the present invention. This embodiment is described by taking the resource scheduling system shown in FIG. 2 and FIG. 3 as an example. In this embodiment, a virtual machine cluster is taken as an example, and an application is deployed in the virtual machine cluster. As shown in Figure 2-4, the resource scheduling method provided in this embodiment includes:
步骤 41 : 资源调度装置收集虚拟机集群信息和应用服务质量相关的信息。 虚拟机集群信息包括: 已部署的虚拟机集群的标识、 各虚拟机集群部署 的应用、 各虚拟机集群的资源使用情况等信息。  Step 41: The resource scheduling device collects information about the virtual machine cluster information and the application service quality. The VM cluster information includes: the identifier of the deployed VM cluster, the application of each VM cluster deployment, and the resource usage of each VM cluster.
应用服务质量相关的信息包括: 应用对应的虚拟机集群、 应用的负载情 况等信息; 应用的负载情况包括: 应用中当前运行的进程、 各进程的业务量 等信息。  The application service quality related information includes: application corresponding virtual machine cluster, application load status, and the like; application load conditions include: information about the currently running process in the application, and the traffic volume of each process.
步骤 42: 资源调度装置根据该应用的应用服务质量相关信息, 判断该应 用中当前运行的各进程的业务量是否满足预设条件, 如果满足, 执行步骤 43; 否则, 执行步骤 41。  Step 42: The resource scheduling device determines, according to the application service quality related information of the application, whether the traffic volume of each process currently running in the application meets the preset condition. If yes, go to step 43; otherwise, go to step 41.
本步骤所述的预设条件可根据实际需要设定。 例如, 预设条件可为: 应 用的各进程的业务量之和大于第一预设门限, 且虚拟机集群的空闲资源不能 满足该应用各进程的业务量增长需求; 或者, 预设条件还可为: 应用中当前 运行的一个或多个进程各自的业务量大于第二预设门限, 且虚拟机集群的空 闲资源不能满足这些进程业务量增长需求。 其中, 上述虚拟机集群的空闲资 源可预先获取。 The preset conditions described in this step can be set according to actual needs. For example, the preset condition can be: The sum of the traffic of each process is greater than the first preset threshold, and the idle resources of the virtual machine cluster cannot meet the traffic growth requirement of each process of the application; or, the preset condition may also be: The traffic of each of the multiple processes is greater than the second preset threshold, and the idle resources of the virtual machine cluster cannot meet the traffic growth requirements of the processes. The idle resources of the virtual machine cluster may be acquired in advance.
如果所述应用中当前运行的各进程的业务量满足预设条件, 则根据预先 获取的所述应用的进程伸缩策略, 确定所述虚拟机集群需要扩展的资源数。  If the traffic of each process currently running in the application meets the preset condition, the number of resources that the virtual machine cluster needs to expand is determined according to the pre-obtained process scaling policy of the application.
步骤 43 : 资源调度装置获取所述应用的进程伸缩策略, 根据所述进程伸 缩策略确定虚拟机集群需要扩展的资源数。  Step 43: The resource scheduling device acquires a process scaling policy of the application, and determines, according to the process scaling policy, the number of resources that the virtual machine cluster needs to expand.
该应用的进程伸缩策略可预先获取, 如从用户提供的应用部署请求中获 取等。 进程伸缩策略可包括: 增加所述应用的进程数; 该情形下, 虚拟机集 群需要扩展的资源数为: 增加预设数量的进程所需的资源数。 或者, 进程伸 缩策略可包括: 增加该应用中当前运行的一个或多个进程的资源数; 该情形 下, 所述虚拟机集群需要扩展的资源数为: 为该应用中当前运行的各进程所 需增加的资源总数。  The application's process scaling policy can be pre-fetched, such as obtaining from an application deployment request provided by the user. The process scaling policy may include: increasing the number of processes of the application; in this case, the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes. Alternatively, the process scaling policy may include: increasing the number of resources of one or more processes currently running in the application; in this case, the number of resources that the virtual machine cluster needs to expand is: for each process currently running in the application. The total number of resources to be added.
步骤 44: 资源调度装置可根据该应用的应用服务质量相关信息, 决策是 向内部云平台还是外部云平台申请资源, 如果确定向内部云平台申请资源, 则执行步骤 45; 如果确定向外部云平台申请资源, 则执行步骤 49。  Step 44: The resource scheduling device may apply for the resource to the internal cloud platform or the external cloud platform according to the application service quality related information of the application, and if it is determined to apply for the resource to the internal cloud platform, perform step 45; if it is determined to the external cloud platform To apply for resources, go to Step 49.
资源调度装置可根据该应用的应用服务质量相关信息, 分析该应用各进 程的业务量变化趋势, 并根据分析结果确定是向内部云平台还是向外部云平 台申请调度资源。如果分析结果表明该应用的各进程的业务负荷是长期现象, 则可向内部云平台申请资源。 如果分析结果表明该应用的各进程的业务负荷 是短期现象, 则可向外部云平台申请资源, 由此避免出现内部云平台的物理 资源盲目扩展而导致的资源利用率低的问题。  The resource scheduling device may analyze the traffic volume change trend of each application process according to the application service quality related information of the application, and determine whether to apply for scheduling resources to the internal cloud platform or the external cloud platform according to the analysis result. If the analysis results indicate that the business load of each process of the application is a long-term phenomenon, resources can be applied to the internal cloud platform. If the analysis result indicates that the service load of each process of the application is a short-term phenomenon, resources can be applied to the external cloud platform, thereby avoiding the problem of low resource utilization caused by the blind expansion of the physical resources of the internal cloud platform.
步骤 45: 资源调度装置向内部云平台发送资源申请请求, 用于请求为该 虚拟机集群调度确定的所述资源数。  Step 45: The resource scheduling device sends a resource request request to the internal cloud platform for requesting the determined number of resources for the virtual machine cluster scheduling.
该资源申请请求可包括: 确定的所述资源数、虚拟机集群的标识等信息。 步骤 46: 内部云平台接收所述资源申请请求, 确定是否能够提供确定的 所述资源数的调度, 如果是, 则执行步骤 47; 否则执行步骤 49。  The resource application request may include: determining the number of the resources, the identifier of the virtual machine cluster, and the like. Step 46: The internal cloud platform receives the resource application request, determines whether the determined scheduling of the number of resources can be provided, and if yes, performs step 47; otherwise, performs step 49.
内部云平台根据自身空闲资源数以及资源申请请求申请的资源数, 确定 是否能够提供本次的资源调度。 The internal cloud platform determines the number of idle resources and the number of resources requested by the resource application request. Is it possible to provide this resource scheduling?
如果内部云平台的资源较为充足, 如内部云平台的空闲资源大于或等于 确定的所述资源数, 则内部云平台可提供确定的所述资源数的调度。  If the resources of the internal cloud platform are sufficient, for example, the idle resources of the internal cloud platform are greater than or equal to the determined number of the resources, the internal cloud platform may provide the determined scheduling of the number of resources.
如果内部云平台的资源不足, 如内部云平台的空闲资源小于确定的所述 资源数, 则内部云平台不能提供确定的所述资源数的调度。  If the resources of the internal cloud platform are insufficient, for example, the idle resources of the internal cloud platform are smaller than the determined number of the resources, the internal cloud platform cannot provide the determined scheduling of the number of resources.
步骤 47: 内部云平台在自身空闲资源中分配与确定的所述资源数匹配的 物理资源, 并将分配的物理资源的信息发送给资源调度装置。  Step 47: The internal cloud platform allocates physical resources matching the determined number of the resources in the idle resource, and sends the information of the allocated physical resources to the resource scheduling device.
如果内部云平台确定能够提供确定的所述资源数的调度, 则在内部云平 台的空闲资源中, 分配与确定的所述资源数匹配的物理资源, 并将分配的物 理资源的信息发送给资源调度装置。  If the internal cloud platform determines a schedule that can provide the determined number of the resources, allocate, in an idle resource of the internal cloud platform, a physical resource that matches the determined number of the resources, and send the information of the allocated physical resource to the resource. Dispatching device.
步骤 48: 资源调度装置基于内部云平台分配的物理资源, 根据上述进程 伸缩策略进行进程伸缩处理。  Step 48: The resource scheduling device performs process scaling processing according to the foregoing process scaling policy based on the physical resources allocated by the internal cloud platform.
资源调度装置进程伸缩处理例如: 资源调度装置在虚拟机集群中新增该 应用预设数量的进程, 或者, 资源调度装置增加该应用需要增加资源的一个 或多个进程可支配的内存资源。  The resource scheduling device process scaling processing, for example, the resource scheduling device adds a preset number of processes to the virtual machine cluster, or the resource scheduling device increases the memory resources available to the one or more processes that the application needs to increase resources.
步骤 49: 资源调度装置根据确定的所述资源数, 向外部云平台发送虚拟 机申请请求。  Step 49: The resource scheduling apparatus sends a virtual machine application request to the external cloud platform according to the determined number of the resources.
虚拟机申请请求包括: 虚拟机的规格和数量、 虚拟机需要安装的镜像标 识、 虚拟机对应的虚拟机集群信息、 外部云平台标识等信息。  The virtual machine application request includes: the specification and quantity of the virtual machine, the image identifier that the virtual machine needs to be installed, the virtual machine cluster information corresponding to the virtual machine, and the external cloud platform identifier.
虚拟机需要安装的镜像标识对应的文件, 可通过外部云平台的接口上传 到外部云平台上。  The file corresponding to the image ID that the virtual machine needs to be installed can be uploaded to the external cloud platform through the interface of the external cloud platform.
外部云平台可为私有云平台; 或者, 外部云平台可为公有云平台, 如 The external cloud platform can be a private cloud platform; or the external cloud platform can be a public cloud platform, such as
Amazon EC2、 IBM COD、 惠普企业业务等云平台。 Cloud platforms such as Amazon EC2, IBM COD, and HP Enterprise Business.
资源调度装置具体从哪个外部云平台申请资源, 可由管理员预先配置。 或者, 资源调度装置可根据预定条件自动决策从哪个外部云平台申请资 源, 如根据预先获取的外部云平台能够提供的虚拟机的规格信息, 将能够提 供当前资源调度所需的虚拟机规格相同规格或接近规格的外部云平台, 作为 目标外部云平台。  The resource scheduling device specifically requests from which external cloud platform to apply for resources, which can be pre-configured by the administrator. Alternatively, the resource scheduling device may automatically decide which external cloud platform to apply for the resource according to the predetermined condition, for example, according to the specification information of the virtual machine that can be provided by the external cloud platform acquired in advance, the same specification of the virtual machine specification required for the current resource scheduling can be provided. Or an external cloud platform close to the specification, as a target external cloud platform.
步骤 410: 外部云平台接收虚拟机申请请求, 在外部云平台的物理资源中 根据虚拟机申请请求部署外部虚拟机。 向资源调度装置返回虚拟机信息。 步骤 411: 外部云平台向资源调度装置返回虚拟机信息。 Step 410: The external cloud platform receives the virtual machine application request, and deploys the external virtual machine according to the virtual machine application request in the physical resource of the external cloud platform. The virtual machine information is returned to the resource scheduling device. Step 411: The external cloud platform returns virtual machine information to the resource scheduling device.
虚拟机信息可包括: 外部虚拟机的访问地址等。  The virtual machine information may include: an access address of an external virtual machine, and the like.
步骤 412: 资源调度装置存储外部虚拟机的相关信息。  Step 412: The resource scheduling device stores related information of the external virtual machine.
资源调度装置存储外部虚拟机的相关信息可包括: 外部虚拟机的访问地 址、 外部虚拟机对应的虚拟机集群信息、 外部虚拟机的资源属性等; 其中外 部虚拟机的资源属性可为: 外部云资源。  The resource scheduling device may include: an access address of the external virtual machine, a virtual machine cluster information corresponding to the external virtual machine, a resource attribute of the external virtual machine, and the like; wherein the resource attribute of the external virtual machine may be: an external cloud Resources.
步骤 413: 资源调度装置根据上述进程伸缩策略进行进程伸缩处理, 并在 接收到的虚拟机信息指向的外部虚拟机上, 根据预设进程迁移策略部署该应 用的进程。  Step 413: The resource scheduling device performs process scaling processing according to the foregoing process scaling policy, and deploys the applied process according to the preset process migration policy on the external virtual machine pointed to by the received virtual machine information.
资源调度装置进程伸缩处理例如: 资源调度装置在虚拟机集群中新增该 应用预设数量的进程, 或者, 资源调度装置增加该应用需要增加资源的一个 或多个进程可支配的内存资源。  The resource scheduling device process scaling processing, for example, the resource scheduling device adds a preset number of processes to the virtual machine cluster, or the resource scheduling device increases the memory resources available to the one or more processes that the application needs to increase resources.
预设进程迁移策略例如: 将应用中与其他进程交互频度低于预设门限的 进程, 即第一进程, 从内部云平台部署该应用的虚拟机集群的内部虚拟机, 迁移到外部虚拟机上。 当第一进程迁移到外部虚拟机上之后, 内部云平台部 署该应用的虚拟机集群释放的该第一进程占用的资源, 可用于提供给该应用 的其他进程使用, 以满足该应用服务质量的要求。 此外, 由于第一进程与其 他进程交互的频率较低, 因此, 将第一进程迁移到外部虚拟机, 不会增加太 多进程间的交互, 由此对应用的性能和服务质量的影响较小。  The preset process migration policy is as follows: a process in which the frequency of interaction with other processes is lower than a preset threshold, that is, the first process, the internal virtual machine of the virtual machine cluster of the application is deployed from the internal cloud platform, and the internal virtual machine is migrated to the external virtual machine. on. After the first process is migrated to the external virtual machine, the internal cloud platform deploys the resources occupied by the first process released by the virtual machine cluster of the application, and can be used by other processes provided to the application to meet the service quality of the application. Claim. In addition, since the first process interacts with other processes less frequently, the migration of the first process to the external virtual machine does not increase the interaction between the processes, thereby having less impact on the performance and quality of the application. .
或者, 预设进程迁移策略还可例如: 在外部虚拟机上部署该应用中当前 运行的所有进程, 并将该应用的部分业务负载从虚拟机集群的内部虚拟机迁 移到外部虚拟机。 如此部署之后, 该应用可通过内部虚拟机和外部虚拟机进 行负载分担, 由此保障了该应用的服务质量。  Alternatively, the preset process migration policy may also be: deploying all processes currently running in the application on the external virtual machine, and migrating part of the application's business load from the internal virtual machine of the virtual machine cluster to the external virtual machine. After this deployment, the application can load balance through internal virtual machines and external virtual machines, thus ensuring the service quality of the application.
本实施例在资源调度装置完成本次资源调度之后, 重复执行上述步骤, 可根据对虚拟机集群已部署的应用的实时业务负荷, 以进程为粒度进行资源 的动态调度。 在资源的动态调度过程中, 可根据应用的业务负荷趋势确定向 内部云平台还是向外部云平台调度资源, 提高了资源调度的灵活性。 此外, 当内部云平台的空闲资源无法满足该应用的业务增长需求时, 可向外部云平 台申请资源以进行资源补充, 并采用灵活的进程迁移策略进行外部虚拟机的 进程部署, 由此保障了应用的服务质量。 图 5为本发明实施例四提供的资源调度方法的信令交互图。本实施例是以 图 2和图 3所示的资源调度系统为例进行说明。本实施例一个虚拟机集群为例, 且该虚拟机集群部署有多个应用。 如图 2、 图 3和图 5所示, 本实施例提供的资 源调度方法包括: In this embodiment, after the resource scheduling apparatus completes the current resource scheduling, the foregoing steps are repeatedly performed, and the dynamic scheduling of the resources may be performed according to the real-time service load of the deployed application of the virtual machine cluster. In the dynamic scheduling process of resources, it is possible to determine whether to allocate resources to the internal cloud platform or to the external cloud platform according to the service load trend of the application, thereby improving the flexibility of resource scheduling. In addition, when the idle resources of the internal cloud platform cannot meet the service growth requirements of the application, the external cloud platform can be applied for resources for resource supplementation, and the flexible process migration strategy is used to deploy the external virtual machine process, thereby ensuring the protection. The quality of service applied. FIG. 5 is a signaling interaction diagram of a resource scheduling method according to Embodiment 4 of the present invention. This embodiment is described by taking the resource scheduling system shown in FIG. 2 and FIG. 3 as an example. In this embodiment, a virtual machine cluster is taken as an example, and the virtual machine cluster is deployed with multiple applications. As shown in FIG. 2, FIG. 3 and FIG. 5, the resource scheduling method provided in this embodiment includes:
步骤 51 : 资源调度装置收集虚拟机集群信息和虚拟机集群部署的各应用 的应用服务质量相关的信息。  Step 51: The resource scheduling device collects information about the application service quality of each application deployed by the virtual machine cluster information and the virtual machine cluster.
步骤 52: 资源调度装置根据虚拟机集群中各应用的应用服务质量相关信 息, 分别判断各应用中当前运行的各进程的业务量是否满足预设条件, 如果 满足, 执行步骤 53; 否则, 执行步骤 51。  Step 52: The resource scheduling device determines, according to the application service quality related information of each application in the virtual machine cluster, whether the traffic volume of each process currently running in each application meets the preset condition. If yes, go to step 53; otherwise, perform the step. 51.
步骤 53-步骤 512:步骤 53-步骤 512涉及的应用为该虚拟机集群部署的多个 应用中, 当前运行的各进程的业务量满足预设条件的应用, 其他技术方案与 步骤 43-步骤 412相似, 在此不再赘述。  Step 53 - Step 512: The application involved in the step 53 - 512 is an application in which the traffic of each process currently running meets the preset condition in the application deployed in the virtual machine cluster, and other technical solutions and steps 43 - 412 Similar, it will not be repeated here.
步骤 513 : 资源调度装置在接收到的虚拟机信息指向的外部虚拟机上, 根 据预设进程迁移策略部署该应用的进程。  Step 513: The resource scheduling device deploys the process of the application according to the preset process migration policy on the external virtual machine pointed to by the received virtual machine information.
资源调度装置存储外部虚拟机的相关信息可包括: 外部虚拟机的访问地 址、 外部虚拟机对应的虚拟机集群信息、 外部虚拟机的资源属性等; 其中外 部虚拟机的资源属性可为: 外部云资源。  The resource scheduling device may include: an access address of the external virtual machine, a virtual machine cluster information corresponding to the external virtual machine, a resource attribute of the external virtual machine, and the like; wherein the resource attribute of the external virtual machine may be: an external cloud Resources.
预设进程迁移策略例如: 将应用中与其他进程交互频度低于预设门限的 进程, 即第一进程, 从内部云平台部署该应用的虚拟机集群的内部虚拟机, 迁移到外部虚拟机上。 当第一进程迁移到外部虚拟机上之后, 内部云平台部 署该应用的虚拟机集群释放的该第一进程占用的资源, 可用于提供给该应用 的其他进程使用, 以满足该应用服务质量的要求。 此外, 由于第一进程与其 他进程交互的频率较低, 因此, 将第一进程迁移到外部虚拟机, 不会增加太 多进程间的交互, 由此对应用的性能和服务质量的影响较小。  The preset process migration policy is as follows: a process in which the frequency of interaction with other processes is lower than a preset threshold, that is, the first process, the internal virtual machine of the virtual machine cluster of the application is deployed from the internal cloud platform, and the internal virtual machine is migrated to the external virtual machine. on. After the first process is migrated to the external virtual machine, the internal cloud platform deploys the resources occupied by the first process released by the virtual machine cluster of the application, and can be used by other processes provided to the application to meet the service quality of the application. Claim. In addition, since the first process interacts with other processes less frequently, the migration of the first process to the external virtual machine does not increase the interaction between the processes, thereby having less impact on the performance and quality of the application. .
或者, 预设进程迁移策略还可例如: 在外部虚拟机上部署该应用中当前 运行的所有进程, 并将该应用的部分业务负载从虚拟机集群的内部虚拟机迁 移到外部虚拟机。 如此部署之后, 该应用可通过内部虚拟机和外部虚拟机进 行负载分担, 由此保障了该应用的服务质量。  Alternatively, the preset process migration policy may also be: deploying all processes currently running in the application on the external virtual machine, and migrating part of the application's business load from the internal virtual machine of the virtual machine cluster to the external virtual machine. After this deployment, the application can load balance through internal virtual machines and external virtual machines, thus ensuring the service quality of the application.
或者, 将该虚拟机集群部署的多个应用中一个应用, 如第一应用以及该 应用中当前运行的所有进程, 从虚拟机集群的内部虚拟机全部迁移到外部虚 拟机。 如此部署之后, 虚拟机集群释放的第一应用占用的资源, 可用于为该 虚拟机集群部署的其他应用提供服务, 来保障其他应用的服务质量, 而第一 应用的业务及其服务质量, 可由外部虚拟机提供。 Or, one of the multiple applications deployed in the virtual machine cluster, such as the first application and all processes currently running in the application, all migrate from the internal virtual machine of the virtual machine cluster to the external virtual Planned. After the deployment, the resources occupied by the first application released by the virtual machine cluster can be used to provide services for other applications deployed in the virtual machine cluster to ensure the service quality of other applications, and the service and quality of service of the first application may be External virtual machine is provided.
本实施例可在一个虚拟机集群中部署多个应用的场景下, 对虚拟机集群 已部署的各应用的实时业务负荷, 进行资源的动态调度。 在资源的动态调度 过程中, 可根据某个应用的业务负荷趋势确定向内部云平台还是向外部云平 台调度资源, 提高了资源调度的灵活性。 此外, 当内部云平台的空闲资源无 法满足该应用的业务增长需求时,可向外部云平台申请资源以进行资源补充, 并采用灵活的进程迁移策略进行外部虚拟机的进程部署, 由此保障了该虚拟 机集群部署的多个应用的服务质量。  In this embodiment, the real-time service load of each deployed application of the virtual machine cluster is dynamically scheduled in a scenario where multiple applications are deployed in a virtual machine cluster. In the dynamic scheduling process of resources, it is possible to determine whether to allocate resources to the internal cloud platform or to the external cloud platform according to the traffic load trend of an application, thereby improving the flexibility of resource scheduling. In addition, when the idle resources of the internal cloud platform cannot meet the service growth requirements of the application, the external cloud platform can be applied for resources for resource supplementation, and the flexible process migration strategy is used to deploy the external virtual machine process, thereby ensuring the protection. Quality of service for multiple applications deployed by this virtual machine cluster.
图 6为本发明实施例五提供的资源调度装置的结构示意图。 如图 6所示的 资源调度装置包括: 信息获取模块 61、 资源数确定模块 62、 资源调度申请模 块 63和应用进程迁移模块 64。  FIG. 6 is a schematic structural diagram of a resource scheduling apparatus according to Embodiment 5 of the present invention. The resource scheduling apparatus shown in FIG. 6 includes: an information obtaining module 61, a resource number determining module 62, a resource scheduling request module 63, and an application process migration module 64.
信息获耳 莫块 61可用于获取应用中当前运行的各进程的业务量, 所述应 用部署在内部云平台的虚拟机集群中;  The information acquisition block 61 can be used to obtain the traffic of each process currently running in the application, and the application is deployed in the virtual machine cluster of the internal cloud platform;
资源数确定模块 62可用于在所述应用中当前运行的各进程的业务量满足 预设条件时, 根据预先获取的所述应用的进程伸缩策略, 确定所述虚拟机集 群需要扩展的资源数;  The resource number determining module 62 is configured to determine, according to the pre-obtained process scaling policy of the application, the number of resources that the virtual machine cluster needs to expand, when the traffic of each process that is currently running in the application meets the preset condition;
资源调度申请模块 63可用于在确定向外部云平台申请调度资源时, 根据 确定的所述资源数向外部云平台发送虚拟机申请请求;  The resource scheduling application module 63 may be configured to send a virtual machine application request to the external cloud platform according to the determined number of resources when determining to apply for scheduling resources to the external cloud platform;
应用进程迁移模块 64可用于在接收到所述外部云平台返回的虚拟机信息 之后, 向所述虚拟机信息指向的外部虚拟机部署所述应用的进程。  The application process migration module 64 is configured to deploy the process of the application to an external virtual machine pointed to by the virtual machine information after receiving the virtual machine information returned by the external cloud platform.
可选的, 所述进程伸缩策略包括: 增加所述应用的进程数; 所述虚拟机 集群需要扩展的资源数为: 增加预设数量的进程所需的资源数。 或者, 可选 的, 所述进程伸缩策略包括: 增加所述应用中当前运行的一个或多个进程的 资源数; 所述虚拟机集群需要扩展的资源数为: 为所述应用中当前运行的各 进程所需增加的资源总数。  Optionally, the process scaling policy includes: increasing the number of processes of the application; the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes. Or, optionally, the process scaling policy includes: increasing a number of resources of one or more processes currently running in the application; the number of resources that the virtual machine cluster needs to expand is: being currently running in the application The total amount of resources required for each process.
应用进程迁移模块可根据预设进程迁移策略进行进程迁移部署。 例如: 如果一个虚拟机集群部署有一个或多个应用, 应用进程迁移模块 64具体 可用于根据所述应用的进程间拓朴关系确定第一进程, 并将所述第一进程从 所述虚拟机集群的内部虚拟机迁移到所述外部虚拟机; 所述第一进程为所述 应用中当前运行的、 与其他进程交互频度低于预设频度的进程。 The application process migration module can perform process migration deployment according to the preset process migration policy. For example, if a virtual machine cluster is deployed with one or more applications, the application process migration module 64 is specifically configured to determine the first process according to the inter-process topology relationship of the application, and the first process is The internal virtual machine of the virtual machine cluster is migrated to the external virtual machine; the first process is a process that is currently running in the application and whose frequency of interaction with other processes is lower than a preset frequency.
或者,  Or,
如果一个虚拟机集群部署有一个或多个应用, 应用进程迁移模块 64具体 可用于在所述外部虚拟机上部署所述应用中当前运行的各进程, 并将所述应 用的部分业务负载从所述虚拟机集群的内部虚拟机迁移到所述外部虚拟机。  If a virtual machine cluster is deployed with one or more applications, the application process migration module 64 is specifically configured to deploy each process currently running in the application on the external virtual machine, and load part of the service load of the application. The internal virtual machine of the virtual machine cluster is migrated to the external virtual machine.
如果一个虚拟机集群部署有多个应用, 应用进程迁移模块 64具体可用于 将多个所述应用中第一应用以及所述第一应用中当前运行的各进程, 从所述 虚拟机集群的内部虚拟机迁移到所述外部虚拟机。  If a virtual machine cluster is deployed with multiple applications, the application process migration module 64 is specifically configured to use the first application of the plurality of applications and the processes currently running in the first application from the internal of the virtual machine cluster. The virtual machine is migrated to the external virtual machine.
进一步的, 资源调度装置还可包括: 调度决策模块 65。  Further, the resource scheduling apparatus may further include: a scheduling decision module 65.
调度决策模块 65可用于在所述内部云平台的空闲资源不能提供确定的所 述资源数的调度时, 确定向外部云平台申请调度资源。 或者, 调度决策模块 65可用于分析所述应用中当前运行的各进程的业务量的变化趋势, 并根据分 析结果确定向外部云平台申请调度资源。  The scheduling decision module 65 may be configured to determine to apply for scheduling resources to the external cloud platform when the idle resources of the internal cloud platform cannot provide the determined scheduling of the number of resources. Alternatively, the scheduling decision module 65 may be configured to analyze a trend of the traffic volume of each process currently running in the application, and determine to apply for scheduling resources to the external cloud platform according to the analysis result.
本实施例资源调度装置可根据对虚拟机集群已部署的应用的实时业务负 荷, 以进程为粒度进行资源的动态调度。 在资源的动态调度过程中, 可根据 应用的业务负荷趋势确定向内部云平台还是向外部云平台调度资源, 提高了 资源调度的灵活性。 此外, 当内部云平台的空闲资源无法满足该应用的业务 增长需求时, 可向外部云平台申请资源以进行资源补充, 并采用灵活的进程 迁移策略进行外部虚拟机的进程部署, 由此保障了应用的服务质量。 本实施 例资源调度装置的工作机理, 可参见图 1、 图 4-5对应实施例的相应记载; 该 资源调度装置在混合云模式下资源调度系统的结构, 可参见图 2-3对应实施例 的记载; 在此不再赘述。  In this embodiment, the resource scheduling apparatus can dynamically schedule resources according to the real-time service load of the deployed application of the virtual machine cluster. In the dynamic scheduling process of resources, it is possible to determine whether to allocate resources to the internal cloud platform or to the external cloud platform according to the service load trend of the application, thereby improving the flexibility of resource scheduling. In addition, when the idle resources of the internal cloud platform cannot meet the service growth requirements of the application, the external cloud platform can be applied for resources for resource supplementation, and the flexible process migration strategy is used to deploy the external virtual machine process, thereby ensuring the protection. The quality of service applied. For the working mechanism of the resource scheduling apparatus in this embodiment, refer to the corresponding descriptions of the corresponding embodiments in FIG. 1 and FIG. 4-5. The structure of the resource scheduling system in the hybrid cloud mode of the resource scheduling apparatus can be referred to the corresponding embodiment in FIG. 2-3. Record; no longer repeat here.
本领域普通技术人员可以理解: 附图只是一个实施例的示意图, 附图中 的模块或流程并不一定是实施本发明所必须的。  It will be understood by those of ordinary skill in the art that the drawings are only a schematic representation of one embodiment, and the modules or processes in the drawings are not necessarily required to practice the invention.
本领域普通技术人员可以理解: 实施例中的装置中的模块可以按照实施 例描述分布于实施例的装置中, 也可以进行相应变化位于不同于本实施例的 一个或多个装置中。 上述实施例的模块可以合并为一个模块, 也可以进一步 拆分成多个子模块。  It will be understood by those skilled in the art that the modules in the apparatus in the embodiments may be distributed in the apparatus of the embodiment according to the embodiment, or may be correspondingly changed in one or more apparatuses different from the embodiment. The modules of the above embodiments may be combined into one module, or may be further split into a plurality of sub-modules.
本领域普通技术人员可以理解: 实现上述方法实施例的全部或部分步骤 可以通过程序指令相关的硬件来完成, 前述的程序可以存储于一计算机可读 取存储介质中, 该程序在执行时, 执行包括上述方法实施例的步骤; 而前述 的存储介质包括: ROM、 RAM, 磁碟或者光盘等各种可以存储程序代码的介 质。 One of ordinary skill in the art can understand that all or part of the steps of the above method embodiments are implemented. The foregoing program may be stored in a computer readable storage medium, and when executed, the program includes the steps of the foregoing method embodiment; and the foregoing storage medium includes: ROM, RAM , a variety of media that can store program code, such as a disk or an optical disk.
最后应说明的是: 以上实施例仅用以说明本发明的技术方案, 而非对其 限制; 尽管参照前述实施例对本发明进行了详细的说明, 本领域的普通技术 人员应当理解: 其依然可以对前述实施例所记载的技术方案进行修改, 或者 对其中部分技术特征进行等同替换; 而这些修改或者替换, 并不使相应技术 方案的本质脱离本发明实施例技术方案的精神和范围。  It should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced by the equivalents of the technical solutions of the embodiments of the present invention.

Claims

权 利 要 求 书 Claim
1、 一种资源调度方法, 其特征在于, 包括:  A resource scheduling method, comprising:
获取应用中当前运行的各进程的业务量, 所述应用部署在内部云平台的 虚拟机集群中;  Obtaining the traffic of each process currently running in the application, where the application is deployed in a virtual machine cluster of the internal cloud platform;
在所述应用中当前运行的各进程的业务量满足预设条件时, 根据预先获 取的所述应用的进程伸缩策略, 确定所述虚拟机集群需要扩展的资源数; 在确定向外部云平台申请调度资源时, 根据确定的所述资源数向外部云 平台发送虚拟机申请请求;  When the traffic of each process currently running in the application meets the preset condition, determine the number of resources that the virtual machine cluster needs to expand according to the pre-obtained process scaling policy of the application; and determine to apply to the external cloud platform. When scheduling resources, sending a virtual machine application request to the external cloud platform according to the determined number of resources;
在接收到所述外部云平台返回的虚拟机信息之后, 向所述虚拟机信息指 向的外部虚拟机部署所述应用的进程。  After receiving the virtual machine information returned by the external cloud platform, the process of the application is deployed to an external virtual machine pointed to by the virtual machine information.
2、 根据权利要求 1所述的方法, 其特征在于,  2. The method of claim 1 wherein
所述进程伸缩策略包括: 增加所述应用的进程数; 所述虚拟机集群需要 扩展的资源数为: 增加预设数量的进程所需的资源数;  The process scaling policy includes: increasing the number of processes of the application; the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes;
或者,  Or,
所述进程伸缩策略包括: 增加所述应用中当前运行的一个或多个进程的 资源数; 所述虚拟机集群需要扩展的资源数为: 为所述应用中当前运行的各 进程所需增加的资源总数。  The process scaling policy includes: increasing the number of resources of one or more processes currently running in the application; the number of resources that the virtual machine cluster needs to expand is: required for each process currently running in the application The total number of resources.
3、 根据权利要求 1或 2所述的方法, 其特征在于, 向所述虚拟机信息指向 的外部虚拟机部署所述应用的进程, 包括:  The method according to claim 1 or 2, wherein the process of deploying the application to an external virtual machine pointed to by the virtual machine information comprises:
根据所述应用的进程间拓朴关系确定第一进程, 并将所述第一进程从所 述虚拟机集群的内部虚拟机迁移到所述外部虚拟机; 所述第一进程为所述应 用中当前运行的、 与其他进程交互频度低于预设频度的进程;  Determining a first process according to an inter-process topology relationship of the application, and migrating the first process from an internal virtual machine of the virtual machine cluster to the external virtual machine; the first process is in the application The currently running process that interacts with other processes less frequently than the preset frequency;
或者,  Or,
在所述外部虚拟机上部署所述应用中当前运行的各进程, 并将所述应用 的部分业务负载从所述虚拟机集群的内部虚拟机迁移到所述外部虚拟机。  Deploying each process currently running in the application on the external virtual machine, and migrating part of the service load of the application from the internal virtual machine of the virtual machine cluster to the external virtual machine.
4、 根据权利要求 1或 2所述的方法, 其特征在于, 如果所述虚拟机集群部 署有多个所述应用, 则向所述虚拟机信息指向的外部虚拟机部署所述应用的 进程, 包括:  The method according to claim 1 or 2, wherein if the virtual machine cluster is deployed with a plurality of the applications, the process of the application is deployed to an external virtual machine pointed to by the virtual machine information, Includes:
将多个所述应用中第一应用以及所述第一应用中当前运行的各进程, 从 所述虚拟机集群的内部虚拟机迁移到所述外部虚拟机。 The first application of the plurality of applications and the processes currently running in the first application are migrated from an internal virtual machine of the virtual machine cluster to the external virtual machine.
5、 根据权利要求 1-4任一所述的方法, 其特征在于, 所述确定向外部云 平台申请调度资源, 包括: The method according to any one of claims 1-4, wherein the determining to apply for scheduling resources to the external cloud platform comprises:
在所述内部云平台的空闲资源不能提供确定的所述资源数的调度时, 确 定向外部云平台申请调度资源;  When the idle resource of the internal cloud platform cannot provide the determined scheduling of the number of resources, the external cloud platform is requested to apply for scheduling resources;
或者,  Or,
分析所述应用中当前运行的各进程的业务量的变化趋势, 并根据分析结 果确定向外部云平台申请调度资源。  The trend of the traffic volume of each process currently running in the application is analyzed, and the scheduling resource is requested to be applied to the external cloud platform according to the analysis result.
6、 一种资源调度装置, 其特征在于, 包括:  6. A resource scheduling device, comprising:
信息获耳 莫块, 用于获取应用中当前运行的各进程的业务量, 所述应用 部署在内部云平台的虚拟机集群中;  The information is obtained by using the ear block to obtain the traffic of each process currently running in the application, and the application is deployed in the virtual machine cluster of the internal cloud platform;
资源数确定模块, 用于在所述应用中当前运行的各进程的业务量满足预 设条件时, 根据预先获取的所述应用的进程伸缩策略, 确定所述虚拟机集群 需要扩展的资源数;  a resource number determining module, configured to determine, according to the pre-obtained process scaling policy of the application, the number of resources that the virtual machine cluster needs to expand, when the traffic of each process that is currently running in the application meets a preset condition;
资源调度申请模块, 用于在确定向外部云平台申请调度资源时, 根据确 定的所述资源数向外部云平台发送虚拟机申请请求;  a resource scheduling application module, configured to send a virtual machine application request to the external cloud platform according to the determined number of resources when determining to apply for scheduling resources to the external cloud platform;
应用进程迁移模块, 用于在接收到所述外部云平台返回的虚拟机信息之 后, 向所述虚拟机信息指向的外部虚拟机部署所述应用的进程。  The application process migration module is configured to deploy the process of the application to an external virtual machine pointed to by the virtual machine information after receiving the virtual machine information returned by the external cloud platform.
7、 根据权利要求 6所述的装置, 其特征在于,  7. Apparatus according to claim 6 wherein:
所述进程伸缩策略包括: 增加所述应用的进程数; 所述虚拟机集群需要 扩展的资源数为: 增加预设数量的进程所需的资源数;  The process scaling policy includes: increasing the number of processes of the application; the number of resources that the virtual machine cluster needs to expand is: increasing the number of resources required by the preset number of processes;
或者,  Or,
所述进程伸缩策略包括: 增加所述应用中当前运行的一个或多个进程的 资源数; 所述虚拟机集群需要扩展的资源数为: 为所述应用中当前运行的各 进程所需增加的资源总数。  The process scaling policy includes: increasing the number of resources of one or more processes currently running in the application; the number of resources that the virtual machine cluster needs to expand is: required for each process currently running in the application The total number of resources.
8、 根据权利要求 6或 7所述的装置, 其特征在于,  8. Apparatus according to claim 6 or claim 7 wherein:
所述应用进程迁移模块, 具体用于根据所述应用的进程间拓朴关系确定 第一进程, 并将所述第一进程从所述虚拟机集群的内部虚拟机迁移到所述外 部虚拟机; 所述第一进程为所述应用中当前运行的、 与其他进程交互频度低 于预设频度的进程;  The application process migration module is specifically configured to determine a first process according to an inter-process topology relationship of the application, and migrate the first process from an internal virtual machine of the virtual machine cluster to the external virtual machine; The first process is a process that is currently running in the application and that interacts with other processes less frequently than a preset frequency;
或者, 所述应用进程迁移模块, 具体用于在所述外部虚拟机上部署所述应用中 当前运行的各进程, 并将所述应用的部分业务负载从所述虚拟机集群的内部 虚拟机迁移到所述外部虚拟机。 or, The application process migration module is specifically configured to deploy each process currently running in the application on the external virtual machine, and migrate part of the service load of the application from the internal virtual machine of the virtual machine cluster to the Describe the external virtual machine.
9、 根据权利要求 6或 7所述的装置, 其特征在于, 所述虚拟机集群部署有 多个所述应用;  The device according to claim 6 or 7, wherein the virtual machine cluster is deployed with a plurality of the applications;
所述应用进程迁移模块, 具体用于将多个所述应用中第一应用以及所述 第一应用中当前运行的各进程, 从所述虚拟机集群的内部虚拟机迁移到所述 外部虚拟机。  The application process migration module is configured to migrate the first application of the plurality of applications and each process currently running in the first application from an internal virtual machine of the virtual machine cluster to the external virtual machine. .
10、 根据权利要求 6-9任一所述的装置, 其特征在于, 所述装置还包括: 调度决策模块;  The device according to any one of claims 6-9, wherein the device further comprises: a scheduling decision module;
所述调度决策模块, 用于在所述内部云平台的空闲资源不能提供确定的 所述资源数的调度时, 确定向外部云平台申请调度资源;  The scheduling decision module is configured to: when the idle resource of the internal cloud platform cannot provide the determined scheduling of the number of resources, determine to apply for scheduling resources to the external cloud platform;
或者,  Or,
所述调度决策模块, 用于分析所述应用中当前运行的各进程的业务量的 变化趋势, 并根据分析结果确定向外部云平台申请调度资源。  The scheduling decision module is configured to analyze a trend of the traffic volume of each process currently running in the application, and determine to apply for scheduling resources to the external cloud platform according to the analysis result.
11、 一种资源调度系统, 其特征在于, 包括:  11. A resource scheduling system, comprising:
内部云平台和外部云平台; 以及  Internal cloud platform and external cloud platform;
如权利要求 6-10任一所述的资源调度装置; 所述资源调度装置与所述内 部云平台和所述外部云平台通信连接。  The resource scheduling apparatus according to any one of claims 6 to 10; wherein the resource scheduling apparatus is in communication connection with the internal cloud platform and the external cloud platform.
PCT/CN2011/083472 2011-12-05 2011-12-05 Resource scheduling method, device and system WO2013082742A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2011/083472 WO2013082742A1 (en) 2011-12-05 2011-12-05 Resource scheduling method, device and system
CN201180003668.6A CN103503404A (en) 2011-12-05 2011-12-05 Resource scheduling method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/083472 WO2013082742A1 (en) 2011-12-05 2011-12-05 Resource scheduling method, device and system

Publications (1)

Publication Number Publication Date
WO2013082742A1 true WO2013082742A1 (en) 2013-06-13

Family

ID=48573476

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/083472 WO2013082742A1 (en) 2011-12-05 2011-12-05 Resource scheduling method, device and system

Country Status (2)

Country Link
CN (1) CN103503404A (en)
WO (1) WO2013082742A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105874432A (en) * 2014-12-08 2016-08-17 华为技术有限公司 Resource management method, host, and endpoint
US9679253B2 (en) 2014-11-06 2017-06-13 Copperleaf Technologies Inc. Methods for maintaining infrastructure equipment and related apparatus
WO2022068748A1 (en) * 2020-09-29 2022-04-07 华为云计算技术有限公司 Method, apparatus and system for scheduling computing instance

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108108204A (en) * 2016-11-23 2018-06-01 湖北省楚天云有限公司 The application program collocation method and device of cloud computing platform
CN110730205B (en) * 2019-09-06 2023-06-20 深圳平安通信科技有限公司 Cluster system deployment method, device, computer equipment and storage medium
CN111008064B (en) * 2019-11-29 2021-10-29 北京首都在线科技股份有限公司 Virtual machine resource scheduling method and device, and cluster deployment method and device
CN112685179A (en) * 2020-12-28 2021-04-20 跬云(上海)信息科技有限公司 Resource deployment system and method based on cost on cloud
CN114301987B (en) * 2022-03-07 2022-05-20 天津市城市规划设计研究总院有限公司 Dynamic scheduling method and system for virtualized network resources

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101938416A (en) * 2010-09-01 2011-01-05 华南理工大学 Cloud computing resource scheduling method based on dynamic reconfiguration virtual resources
CN102263823A (en) * 2011-07-25 2011-11-30 中兴通讯股份有限公司 Communication method and communication device based on cloud computing

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7996525B2 (en) * 2008-12-31 2011-08-09 Sap Ag Systems and methods for dynamically provisioning cloud computing resources
CN101894050B (en) * 2010-07-28 2014-04-16 山东中创软件工程股份有限公司 Method, device and system for flexibly scheduling JEE application resources of cloud resource pool

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101938416A (en) * 2010-09-01 2011-01-05 华南理工大学 Cloud computing resource scheduling method based on dynamic reconfiguration virtual resources
CN102263823A (en) * 2011-07-25 2011-11-30 中兴通讯股份有限公司 Communication method and communication device based on cloud computing

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9679253B2 (en) 2014-11-06 2017-06-13 Copperleaf Technologies Inc. Methods for maintaining infrastructure equipment and related apparatus
CN105874432A (en) * 2014-12-08 2016-08-17 华为技术有限公司 Resource management method, host, and endpoint
US20170199767A1 (en) 2014-12-08 2017-07-13 Huawei Technologies Co., Ltd. Resource management method, host, and endpoint
JP2017533509A (en) * 2014-12-08 2017-11-09 華為技術有限公司Huawei Technologies Co.,Ltd. Resource management methods, hosts and endpoints
CN107645407A (en) * 2014-12-08 2018-01-30 华为技术有限公司 A kind of adaptation QoS method and apparatus
US10489207B2 (en) 2014-12-08 2019-11-26 Huawei Technologies Co., Ltd. System for resource management using performance specification and description information of the process
US11379265B2 (en) 2014-12-08 2022-07-05 Huawei Technologies Co., Ltd. Resource management method, host, and endpoint based on performance specification
WO2022068748A1 (en) * 2020-09-29 2022-04-07 华为云计算技术有限公司 Method, apparatus and system for scheduling computing instance

Also Published As

Publication number Publication date
CN103503404A (en) 2014-01-08

Similar Documents

Publication Publication Date Title
WO2013082742A1 (en) Resource scheduling method, device and system
EP3606008B1 (en) Method and device for realizing resource scheduling
CN112153700B (en) Network slice resource management method and equipment
CN108337109B (en) Resource allocation method and device and resource allocation system
CN107222531B (en) Container cloud resource scheduling method
CN102567072B (en) Resource allocation method, resource allocation device and resource allocation system
CN106302074B (en) Migration method and device of virtual network function VNF
JP2018198068A (en) Profile-based sla guarantees under workload migration in distributed cloud
US20150156131A1 (en) Method and system of geographic migration of workloads between private and public clouds
US20160156567A1 (en) Allocation method of a computer resource and computer system
US10993127B2 (en) Network slice instance management method, apparatus, and system
Patel et al. VM provisioning method to improve the profit and SLA violation of cloud service providers
KR20170056350A (en) NFV(Network Function Virtualization) resource requirement verifier
CN111399970B (en) Reserved resource management method, device and storage medium
CN108132827B (en) Network slice resource mapping method, related equipment and system
WO2016095524A1 (en) Resource allocation method and apparatus
CN102497409A (en) Resource management method for cloud computing system
EP3274859B1 (en) Cluster computing service assurance apparatus and method
Ben Jemaa et al. Analytical models for QoS-driven VNF placement and provisioning in wireless carrier cloud
TW201439911A (en) System and method for installing virtual machines
CN102523267A (en) Cloud backup system and method
Pandya et al. Dynamic resource allocation techniques in cloud computing
Cerroni Network performance of multiple virtual machine live migration in cloud federations
WO2018170732A1 (en) Method and device for service deployment under edge cloud architecture
CN102929693B (en) Performance evaluation method and device for servers of whole equipment cabinet

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11876870

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11876870

Country of ref document: EP

Kind code of ref document: A1