千家信息网

OpenStack Nova调度服务学习及其过滤器编写的示例分析

发表于:2025-02-01 作者:千家信息网编辑
千家信息网最后更新 2025年02月01日,这篇文章将为大家详细讲解有关OpenStack Nova调度服务学习及其过滤器编写的示例分析,小编觉得挺实用的,因此分享给大家做个参考,希望大家阅读完这篇文章后可以有所收获。初步分析查看相关进程$ p
千家信息网最后更新 2025年02月01日OpenStack Nova调度服务学习及其过滤器编写的示例分析

这篇文章将为大家详细讲解有关OpenStack Nova调度服务学习及其过滤器编写的示例分析,小编觉得挺实用的,因此分享给大家做个参考,希望大家阅读完这篇文章后可以有所收获。

初步分析

查看相关进程

$ ps -aux | grep nova | awk '{for(i=11;i<=NF;i++) printf "%s ", $i};NF>=11 {print ""}'/usr/bin/python /usr/bin/nova-compute --config-file=/etc/nova/nova.conf --config-file=/etc/nova/nova-compute.conf --log-file=/var/log/nova/nova-compute.log /usr/bin/python /usr/bin/nova-api --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-api.log /usr/bin/python /usr/bin/nova-conductor --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-conductor.log /usr/bin/python /usr/bin/nova-scheduler --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-scheduler.log /usr/bin/python /usr/bin/nova-consoleauth --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-consoleauth.log /usr/bin/python /usr/bin/nova-novncproxy --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-novncproxy.log /usr/bin/python /usr/bin/nova-conductor --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-conductor.log /usr/bin/python /usr/bin/nova-conductor --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-conductor.log /usr/bin/python /usr/bin/nova-api --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-api.log /usr/bin/python /usr/bin/nova-api --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-api.log /usr/bin/python /usr/bin/nova-api --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-api.log /usr/bin/python /usr/bin/nova-api --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-api.log /usr/bin/python2.7 /usr/bin/privsep-helper --config-file /etc/nova/nova.conf --config-file /etc/nova/nova-compute.conf --privsep_context vif_plug_linux_bridge.privsep.vif_plug --privsep_sock_path /tmp/tmpZtOLbU/privsep.sock /usr/bin/python2.7 /usr/bin/privsep-helper --config-file /etc/nova/nova.conf --config-file /etc/nova/nova-compute.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjXCHkt/privsep.sock pluma /usr/lib/python2.7/dist-packages/nova/scheduler/filters/retry_filter.py

查看相关服务

  • 查看所有Nova服务:

$ systemctl list-units | grep nova  nova-api.service                                loaded active running   OpenStack Compute API  nova-compute.service                            loaded active running   OpenStack Compute  nova-conductor.service                          loaded active running   OpenStack Compute Conductor  nova-consoleauth.service                        loaded active running   OpenStack Compute Console  nova-novncproxy.service                         loaded active running   OpenStack Compute novncproxy  nova-scheduler.service                          loaded active running   OpenStack Compute Scheduler
  • 查看服务所属软件包:

$ apt-get install apt-file$ apt-file update$ apt-file search /lib/systemd/system/nova-api.servicenova-api: /lib/systemd/system/nova-api.service$ apt-file search /lib/systemd/system/nova-compute.servicenova-compute: /lib/systemd/system/nova-compute.service$ apt-file search /lib/systemd/system/nova-conductor.servicenova-conductor: /lib/systemd/system/nova-conductor.service$ apt-file search /lib/systemd/system/nova-consoleauth.servicenova-consoleauth: /lib/systemd/system/nova-consoleauth.service$ apt-file search /lib/systemd/system/nova-novncproxy.servicenova-novncproxy: /lib/systemd/system/nova-novncproxy.service$ apt-file search /lib/systemd/system/nova-scheduler.servicenova-scheduler: /lib/systemd/system/nova-scheduler.service
  • 查看Nova调度器服务状态:

$ systemctl status nova-scheduler.service● nova-scheduler.service - OpenStack Compute Scheduler   Loaded: loaded (/lib/systemd/system/nova-scheduler.service; enabled; vendor preset: enabled)   Active: active (running) since 三 2017-12-06 23:23:39 CST; 10h ago  Process: 3150 ExecStartPre=/bin/chown nova:adm /var/log/nova (code=exited, status=0/SUCCESS)  Process: 3076 ExecStartPre=/bin/chown nova:nova /var/lock/nova /var/lib/nova (code=exited, status=0/SUCCESS)  Process: 3016 ExecStartPre=/bin/mkdir -p /var/lock/nova /var/log/nova /var/lib/nova (code=exited, status=0/SUCCESS) Main PID: 3241 (nova-scheduler)   CGroup: /system.slice/nova-scheduler.service           └─3241 /usr/bin/python /usr/bin/nova-scheduler --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-scheduler.12月 07 09:59:13 UbuntuStack nova-scheduler[3241]: 2017-12-07 09:59:13.690 3241 INFO nova.scheduler.host_manager [req-27631738-6333-...
  • 查看Nova调度器服务配置脚本:

$ cat /lib/systemd/system/nova-scheduler.service[Unit]Description=OpenStack Compute SchedulerAfter=postgresql.service mysql.service keystone.service [Service]User=novaGroup=novaType=simpleWorkingDirectory=/var/lib/novaPermissionsStartOnly=trueExecStartPre=/bin/mkdir -p /var/lock/nova /var/log/nova /var/lib/novaExecStartPre=/bin/chown nova:nova /var/lock/nova /var/lib/novaExecStartPre=/bin/chown nova:adm /var/log/novaExecStart=/etc/init.d/nova-scheduler systemd-startRestart=on-failureLimitNOFILE=65535TimeoutStopSec=15[Install]WantedBy=multi-user.target
  • 查看Nove调度器服务init脚本:

$ cat /etc/init.d/nova-scheduler#!/bin/sh### BEGIN INIT INFO# Provides:          nova-scheduler# Required-Start:    $network $local_fs $remote_fs $syslog# Required-Stop:     $remote_fs# Should-Start:      postgresql mysql keystone# Should-Stop:       postgresql mysql keystone# Default-Start:     2 3 4 5# Default-Stop:      0 1 6# Short-Description: Nova Scheduler# Description:       Schedules instances, volumes, etc. for Nova### END INIT INFO# Author: Julien Danjou DESC="OpenStack Compute Scheduler"PROJECT_NAME=novaNAME=nova-scheduler...if [ -z "${DAEMON}" ] ; then        DAEMON=/usr/bin/${NAME}fi...if [ -z "${NO_OPENSTACK_CONFIG_FILE_DAEMON_ARG}" ] ; then    DAEMON_ARGS="--config-file=${CONFIG_FILE} ${DAEMON_ARGS}"fi...do_systemd_start() {        exec $DAEMON $DAEMON_ARGS}...systemd-start)        do_systemd_start;;  ...exit 0
  • 查看Nova调度器启动脚本:

$ cat /usr/bin/nova-scheduler#!/usr/bin/python# PBR Generated from u'console_scripts'import sysfrom nova.cmd.scheduler import mainif __name__ == "__main__":    sys.exit(main())

查看软件包信息

  • 查看系统中Nova相关软件包状态:

$ dpkg -l "*nova*"期望状态=未知(u)/安装(i)/删除(r)/清除(p)/保持(h)| 状态=未安装(n)/已安装(i)/仅存配置(c)/仅解压缩(U)/配置失败(F)/不完全安装(H)/触发器等待(W)/触发器未决(T)|/ 错误?=(无)/须重装(R) (状态,错误:大写=故障)||/ 名称                      版本              体系结构:        描述+++-=========================-=================-=================-=======================================================ii  nova-api                  2:14.0.1-0ubuntu1 all               OpenStack Compute - API frontendhi  nova-common               2:14.0.1-0ubuntu1 all               OpenStack Compute - common filesii  nova-compute              2:14.0.1-0ubuntu1 all               OpenStack Compute - compute node baseun  nova-compute-hypervisor   <无>              <无>              (无可用描述)ii  nova-compute-kvm          2:14.0.1-0ubuntu1 all               OpenStack Compute - compute node (KVM)ii  nova-compute-libvirt      2:14.0.1-0ubuntu1 all               OpenStack Compute - compute node libvirt supportii  nova-conductor            2:14.0.1-0ubuntu1 all               OpenStack Compute - conductor serviceun  nova-console              <无>              <无>              (无可用描述)ii  nova-consoleauth          2:14.0.1-0ubuntu1 all               OpenStack Compute - Console Authenticatorii  nova-novncproxy           2:14.0.1-0ubuntu1 all               OpenStack Compute - NoVNC proxyii  nova-scheduler            2:14.0.1-0ubuntu1 all               OpenStack Compute - virtual machine schedulerhi  python-nova               2:14.0.1-0ubuntu1 all               OpenStack Compute Python librariesii  python-novaclient         2:6.0.0-0ubuntu1~ all               client library for OpenStack Compute API - Python 2.7un  python2.7-nova            <无>              <无>              (无可用描述)
  • 查看Nova的Python源码所属软件包:

$ apt-file search /usr/lib/python2.7/dist-packages/nova* | awk -F '/' '{print $1 $6}' | sort -upython-nova-adminclient: nova_adminclientpython-nova-adminclient: nova_adminclient-0.1.8.egg-infopython-novaclient: novaclientpython-nova-lxd: novapython-nova-lxd: nova_lxdpython-nova-lxd: nova_lxd-13.0.0.egg-infopython-nova-lxd: nova_lxd-13.0.0-nspkg.pthpython-nova-lxd: nova_lxd-13.2.0.egg-infopython-nova-lxd: nova_lxd-13.2.0-nspkg.pthpython-nova-lxd: nova_lxd-13.3.0.egg-infopython-nova-lxd: nova_lxd-13.3.0-nspkg.pthpython-nova-lxd: nova_lxd-14.2.2.egg-infopython-nova: novapython-nova: nova-13.0.0.egg-infopython-nova: nova-13.1.4.egg-infopython-nova: nova-14.0.8.egg-info
  • 查看nova-scheduler软件包依赖和文件列表:

$ apt-cache show nova-schedulerPackage: nova-schedulerSource: novaPriority: extraSection: netInstalled-Size: 56Maintainer: Ubuntu Developers Architecture: allVersion: 2:14.0.8-0ubuntu1~cloud1Depends: nova-common (= 2:14.0.8-0ubuntu1~cloud1), init-system-helpers (>= 1.18~), lsb-base (>= 4.1+Debian11ubuntu7), python:any (>= 2.7~)Supported: 24mFilename: pool/main/n/nova/nova-scheduler_14.0.8-0ubuntu1~cloud1_all.debSize: 6460SHA256: 133a23ea0ab69e08716e117aa5881c7840d0431c29fc0cba9fd7146180460965SHA1: 41649a1311faa52fe539a293670dd58a79fd200bMD5sum: bc448ccba9626103924c086c30012d7eDescription-en: OpenStack Compute - virtual machine scheduler OpenStack is a reliable cloud infrastructure. Its mission is to produce the ubiquitous cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable. . OpenStack Compute, codenamed Nova, is a cloud computing fabric controller. In addition to its "native" API (the OpenStack API), it also supports the Amazon EC2 API. . Nova is intended to be modular and easy to extend and adapt. It supports many different hypervisors (KVM and Xen to name a few), different database backends (SQLite, MySQL, and PostgreSQL, for instance), different types of user databases (LDAP or SQL), etc. . This is the Nova scheduler.Description-md5: 8edec11a409c894d59bffef4d16d21b6Original-Maintainer: Openstack Maintainers ...$ dpkg -L nova-scheduler/./usr/usr/bin/usr/bin/nova-scheduler/usr/share/usr/share/man/usr/share/man/man1/usr/share/man/man1/nova-scheduler.1.gz/usr/share/doc/usr/share/doc/nova-scheduler/usr/share/doc/nova-scheduler/copyright/etc/etc/init.d/etc/init.d/nova-scheduler/etc/init/etc/init/nova-scheduler.conf/lib/lib/systemd/lib/systemd/system/lib/systemd/system/nova-scheduler.service/usr/share/doc/nova-scheduler/changelog.Debian.gz
  • 查看nova-common软件包依赖和文件列表:

$ apt-cache show nova-commonPackage: nova-commonSource: novaPriority: extraSection: netInstalled-Size: 79Maintainer: Ubuntu Developers Architecture: allVersion: 2:14.0.8-0ubuntu1~cloud1Recommends: python-glanceclient, python-keystoneDepends: adduser, python-nova (= 2:14.0.8-0ubuntu1~cloud1), python:any (>= 2.7~)Supported: 24mFilename: pool/main/n/nova/nova-common_14.0.8-0ubuntu1~cloud1_all.deb...$ dpkg -L nova-common/./usr/usr/bin/usr/bin/nova-rootwrap/usr/bin/nova-policy/usr/bin/nova-rootwrap-daemon/usr/bin/nova-manage/usr/share/usr/share/man/usr/share/man/man1/usr/share/man/man1/nova-rootwrap.1.gz/usr/share/man/man1/nova-manage.1.gz/usr/share/doc/usr/share/doc/nova-common/usr/share/doc/nova-common/copyright/etc/etc/nova/etc/nova/policy.json/etc/nova/api-paste.ini/etc/nova/nova.conf/etc/nova/rootwrap.d/etc/nova/rootwrap.conf/etc/nova/logging.conf/etc/logrotate.d/etc/logrotate.d/nova-common/etc/sudoers.d/etc/sudoers.d/nova_sudoers/var/var/log/var/log/nova/var/lib/var/lib/nova/var/lib/nova/CA/var/lib/nova/CA/INTER/var/lib/nova/CA/private/var/lib/nova/CA/newcerts/var/lib/nova/CA/reqs/var/lib/nova/instances/var/lib/nova/buckets/var/lib/nova/keys/var/lib/nova/tmp/var/lib/nova/images/var/lib/nova/networks/usr/share/doc/nova-common/changelog.Debian.gz
  • 查看python-nova软件包依赖和文件列表:

$ apt-cache show python-novaPackage: python-novaSource: novaPriority: extraSection: pythonInstalled-Size: 22286Maintainer: Ubuntu Developers Architecture: allVersion: 2:14.0.8-0ubuntu1~cloud1Suggests: python-ldapProvides: python2.7-novaDepends: alembic (>= 0.8.0), openssh-client, openssl, python-babel (>= 2.3.4), python-boto (>= 2.32.1), python-castellan (>= 0.4.0), python-cinderclient (>= 1:1.6.0), python-cryptography (>= 1.0), python-decorator (>= 3.4.0), python-eventlet (>= 0.18.2), python-glanceclient (>= 1:2.0.0), python-greenlet (>= 0.3.2), python-iso8601 (>= 0.1.11), python-jinja2 (>= 2.8), python-jsonschema (>= 2.0.0), python-keystoneauth2 (>= 2.7.0), python-keystonemiddleware (>= 4.0.0), python-lxml (>= 2.3), python-microversion-parse (>= 0.1.2), python-migrate (>= 0.9.6), python-netaddr (>= 0.7.13), python-netifaces (>= 0.10.4), python-neutronclient (>= 4.2.0), python-os-brick (>= 1.6.1), python-os-vif (>= 1.1.0), python-os-win (>= 0.2.3), python-oslo.cache (>= 1.5.0), python-oslo.concurrency (>= 3.8.0), python-oslo.config (>= 1:3.10.0), python-oslo.context (>= 2.4.0), python-oslo.db (>= 4.1.0), python-oslo.i18n (>= 2.1.0), python-oslo.log (>= 3.16.0), python-oslo.messaging (>= 5.2.0), python-oslo.middleware (>= 3.0.0), python-oslo.policy (>= 1.9.0), python-oslo.privsep (>= 1.9.0), python-oslo.reports (>= 0.6.0), python-oslo.rootwrap (>= 2.0.0), python-oslo.serialization (>= 1.10.0), python-oslo.service (>= 1.10.0), python-oslo.utils (>= 3.11.0), python-oslo.versionedobjects (>= 1.9.1), python-paramiko (>= 1.16.0), python-paste, python-pastedeploy (>= 1.5.0), python-prettytable (>= 0.7), python-psutil (>= 1.1.1), python-pymysql, python-requests (>= 2.10.0), python-rfc3986 (>= 0.2.2), python-routes (>= 1.12.3), python-setuptools (>= 16.0), python-six (>= 1.9.0), python-sqlalchemy (>= 1.0.10), python-stevedore (>= 1.10.0), python-webob (>= 1.2.3), python-pbr, python-pkg-resources, python-sqlalchemy (< 1.1), python:any (< 2.8), python:any (>= 2.7.5-5~)Conflicts: python-cjsonSupported: 24mFilename: pool/main/n/nova/python-nova_14.0.8-0ubuntu1~cloud1_all.debSize: 2573388SHA256: 9656466b5daff7af684cd1032e2e5d72ab415aa82a0f8cadf0106cfe9ea36096SHA1: 67dc9bf0bd71a03d87e87b1082bf1892a635f007MD5sum: 5301e37eacef81b4519a4bcd418ef9beDescription-en: OpenStack Compute Python libraries OpenStack is a reliable cloud infrastructure. Its mission is to produce the ubiquitous cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable. . OpenStack Compute, codenamed Nova, is a cloud computing fabric controller. In addition to its "native" API (the OpenStack API), it also supports the Amazon EC2 API. . Nova is intended to be modular and easy to extend and adapt. It supports many different hypervisors (KVM and Xen to name a few), different database backends (SQLite, MySQL, and PostgreSQL, for instance), different types of user databases (LDAP or SQL), etc. . This package contains the core Python parts of Nova.Description-md5: 9e7471c108af7843da4a920afe750d19Python-Version: 2.7Original-Maintainer: Openstack Maintainers ...$ dpkg -L python-nova/./usr/usr/share/usr/share/apport/usr/share/apport/package-hooks/usr/share/apport/package-hooks/source_nova.py/usr/share/doc/usr/share/doc/python-nova/usr/share/doc/python-nova/changelog.Debian.gz/usr/share/doc/python-nova/copyright/usr/lib/usr/lib/python2.7/usr/lib/python2.7/dist-packages/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/dependency_links.txt/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/top_level.txt/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/not-zip-safe/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/requires.txt/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/pbr.json/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/PKG-INFO/usr/lib/python2.7/dist-packages/nova-14.0.1.egg-info/entry_points.txt/usr/lib/python2.7/dist-packages/nova...

初步分析总结

  • systemd服务启动(/lib/systemd/system/nova-scheduler.service):

ExecStart=/etc/init.d/nova-scheduler systemd-start
  • init服务启动(/lib/systemd/system/nova-scheduler.service):

NAME=nova-schedulerDAEMON=/usr/bin/${NAME}DAEMON_ARGS="--config-file=${CONFIG_FILE} ${DAEMON_ARGS}"exec $DAEMON $DAEMON_ARGS
  • 执行的最终命令为:

/usr/bin/python /usr/bin/nova-scheduler --config-file=/etc/nova/nova.conf --log-file=/var/log/nova/nova-scheduler.log
  • Nova调度器启动源码(/usr/bin/nova-scheduler):

import sysfrom nova.cmd.scheduler import mainif __name__ == "__main__":        sys.exit(main())

虚拟机创建源码分析

虚拟机创建时通过RPC调用nova-scheduler服务的select_destinations方法,获取可用节点列表。

  • conductor/manager.py ComputeTaskManager的build_instances方法创建一个新的虚拟机实例时,使用scheduler的build_request_spec方法构造请求的资源规格,最终使用RPC调用select_destinations方法选择合适的节点。

...from nova.scheduler import utils as scheduler_utils...class ComputeTaskManager(base.Base):...    def build_instances(self, context, instances, image, filter_properties,            admin_password, injected_files, requested_networks,            security_groups, block_device_mapping=None, legacy_bdm=True):        # TODO(ndipanov): Remove block_device_mapping and legacy_bdm in version        #                 2.0 of the RPC API.        # TODO(danms): Remove this in version 2.0 of the RPC API        if (requested_networks and                not isinstance(requested_networks,                               objects.NetworkRequestList)):            requested_networks = objects.NetworkRequestList.from_tuples(                requested_networks)        # TODO(melwitt): Remove this in version 2.0 of the RPC API        flavor = filter_properties.get('instance_type')        if flavor and not isinstance(flavor, objects.Flavor):            # Code downstream may expect extra_specs to be populated since it            # is receiving an object, so lookup the flavor to ensure this.            flavor = objects.Flavor.get_by_id(context, flavor['id'])            filter_properties = dict(filter_properties, instance_type=flavor)        request_spec = {}        try:            # check retry policy. Rather ugly use of instances[0]...            # but if we've exceeded max retries... then we really only            # have a single instance.            scheduler_utils.populate_retry(                filter_properties, instances[0].uuid)            request_spec = scheduler_utils.build_request_spec(                    context, image, instances)            hosts = self._schedule_instances(                    context, request_spec, filter_properties)        except Exception as exc:            updates = {'vm_state': vm_states.ERROR, 'task_state': None}            for instance in instances:                self._set_vm_state_and_notify(                    context, instance.uuid, 'build_instances', updates,                    exc, request_spec)                try:                    # If the BuildRequest stays around then instance show/lists                    # will pull from it rather than the errored instance.                    self._destroy_build_request(context, instance)                except exception.BuildRequestNotFound:                    pass                self._cleanup_allocated_networks(                    context, instance, requested_networks)            return        for (instance, host) in six.moves.zip(instances, hosts):            try:                instance.refresh()            except (exception.InstanceNotFound,                    exception.InstanceInfoCacheNotFound):                LOG.debug('Instance deleted during build', instance=instance)                continue            local_filter_props = copy.deepcopy(filter_properties)            scheduler_utils.populate_filter_properties(local_filter_props,                host)            # The block_device_mapping passed from the api doesn't contain            # instance specific information            bdms = objects.BlockDeviceMappingList.get_by_instance_uuid(                    context, instance.uuid)            # This is populated in scheduler_utils.populate_retry            num_attempts = local_filter_props.get('retry',                                                  {}).get('num_attempts', 1)            if num_attempts <= 1:                # If this is a reschedule the instance is already mapped to                # this cell and the BuildRequest is already deleted so ignore                # the logic below.                inst_mapping = self._populate_instance_mapping(context,                                                               instance,                                                               host)                try:                    self._destroy_build_request(context, instance)                except exception.BuildRequestNotFound:                    # This indicates an instance delete has been requested in                    # the API. Stop the build, cleanup the instance_mapping and                    # potentially the block_device_mappings                    # TODO(alaski): Handle block_device_mapping cleanup                    if inst_mapping:                        inst_mapping.destroy()                    return            self.compute_rpcapi.build_and_run_instance(context,                    instance=instance, host=host['host'], image=image,                    request_spec=request_spec,                    filter_properties=local_filter_props,                    admin_password=admin_password,                    injected_files=injected_files,                    requested_networks=requested_networks,                    security_groups=security_groups,                    block_device_mapping=bdms, node=host['nodename'],                    limits=host['limits'])    def _schedule_instances(self, context, request_spec, filter_properties):        scheduler_utils.setup_instance_group(context, request_spec,                                             filter_properties)        # TODO(sbauza): Hydrate here the object until we modify the        # scheduler.utils methods to directly use the RequestSpec object        spec_obj = objects.RequestSpec.from_primitives(            context, request_spec, filter_properties)        hosts = self.scheduler_client.select_destinations(context, spec_obj)        return hosts...
  • scheduler/client/init.py 加载RPC客户端类。

class SchedulerClient(object):    """Client library for placing calls to the scheduler."""    def __init__(self):        self.queryclient = LazyLoader(importutils.import_class(            'nova.scheduler.client.query.SchedulerQueryClient'))        self.reportclient = LazyLoader(importutils.import_class(            'nova.scheduler.client.report.SchedulerReportClient'))    @utils.retry_select_destinations    def select_destinations(self, context, spec_obj):        return self.queryclient.select_destinations(context, spec_obj)...
  • scheduler/client/query.py 获取RPC调用接口。

from nova.scheduler import rpcapi as scheduler_rpcapiclass SchedulerQueryClient(object):    """Client class for querying to the scheduler."""    def __init__(self):        self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI()    def select_destinations(self, context, spec_obj):        """Returns destinations(s) best suited for this request_spec and        filter_properties.        The result should be a list of dicts with 'host', 'nodename' and        'limits' as keys.        """        return self.scheduler_rpcapi.select_destinations(context, spec_obj)...
  • scheduler/rpcapi.py 执行RPC调用。

class SchedulerAPI(object):...    def select_destinations(self, ctxt, spec_obj):        version = '4.3'        msg_args = {'spec_obj': spec_obj}        if not self.client.can_send_version(version):            del msg_args['spec_obj']            msg_args['request_spec'] = spec_obj.to_legacy_request_spec_dict()            msg_args['filter_properties'                     ] = spec_obj.to_legacy_filter_properties_dict()            version = '4.0'        cctxt = self.client.prepare(version=version)        return cctxt.call(ctxt, 'select_destinations', **msg_args)...

RPC服务启动源码分析

  • cmd/scheduler.py 使用"Service"类创建nova-scheduler服务。

CONF = nova.conf.CONFdef main():    config.parse_args(sys.argv)    logging.setup(CONF, "nova")    utils.monkey_patch()    objects.register_all()    gmr.TextGuruMeditation.setup_autorun(version)    server = service.Service.create(binary='nova-scheduler',                                    topic=CONF.scheduler_topic)    service.serve(server)    service.wait()
  • conf/scheduler.py nova-scheduler的RPC主题默认为"scheduler"。

rpc_sched_topic_opt = cfg.StrOpt("scheduler_topic",        default="scheduler",        help="""This is the message queue topic that the scheduler 'listens' on. It is usedwhen the scheduler service is started up to configure the queue, and wheneveran RPC call to the scheduler is made. There is almost never any reason to everchange this value.* Related options:    None""")...
  • service.py 从"manager_cls = ('%s_manager' %"可以看出,使用"scheduler_manager"参数所指定的类处理RPC服务请求。

...class Service(service.Service):    """Service object for binaries running on hosts.    A service takes a manager and enables rpc by listening to queues based    on topic. It also periodically runs tasks on the manager and reports    its state to the database services table.    """    def __init__(self, host, binary, topic, manager, report_interval=None,                 periodic_enable=None, periodic_fuzzy_delay=None,                 periodic_interval_max=None, db_allowed=True,                 *args, **kwargs):        super(Service, self).__init__()        self.host = host        self.binary = binary        self.topic = topic        self.manager_class_name = manager        self.servicegroup_api = servicegroup.API()        manager_class = importutils.import_class(self.manager_class_name)        self.manager = manager_class(host=self.host, *args, **kwargs)        self.rpcserver = None        self.report_interval = report_interval        self.periodic_enable = periodic_enable        self.periodic_fuzzy_delay = periodic_fuzzy_delay        self.periodic_interval_max = periodic_interval_max        self.saved_args, self.saved_kwargs = args, kwargs        self.backdoor_port = None        self.conductor_api = conductor.API(use_local=db_allowed)        self.conductor_api.wait_until_ready(context.get_admin_context())...    @classmethod    def create(cls, host=None, binary=None, topic=None, manager=None,               report_interval=None, periodic_enable=None,               periodic_fuzzy_delay=None, periodic_interval_max=None,               db_allowed=True):        """Instantiates class and passes back application object.        :param host: defaults to CONF.host        :param binary: defaults to basename of executable        :param topic: defaults to bin_name - 'nova-' part        :param manager: defaults to CONF._manager        :param report_interval: defaults to CONF.report_interval        :param periodic_enable: defaults to CONF.periodic_enable        :param periodic_fuzzy_delay: defaults to CONF.periodic_fuzzy_delay        :param periodic_interval_max: if set, the max time to wait between runs        """        if not host:            host = CONF.host        if not binary:            binary = os.path.basename(sys.argv[0])        if not topic:            topic = binary.rpartition('nova-')[2]        if not manager:            manager_cls = ('%s_manager' %                           binary.rpartition('nova-')[2])            manager = CONF.get(manager_cls, None)        if report_interval is None:            report_interval = CONF.report_interval        if periodic_enable is None:            periodic_enable = CONF.periodic_enable        if periodic_fuzzy_delay is None:            periodic_fuzzy_delay = CONF.periodic_fuzzy_delay        debugger.init()        service_obj = cls(host, binary, topic, manager,                          report_interval=report_interval,                          periodic_enable=periodic_enable,                          periodic_fuzzy_delay=periodic_fuzzy_delay,                          periodic_interval_max=periodic_interval_max,                          db_allowed=db_allowed)        return service_obj...
  • config/service.py "scheduler_manager"参数的默认值为"nova.scheduler.manager.SchedulerManager"。

...service_opts = [...    cfg.StrOpt('scheduler_manager',               default='nova.scheduler.manager.SchedulerManager',               help='DEPRECATED: Full class name for the Manager for '                   'scheduler',               deprecated_for_removal=True),...
  • scheduler/manager.py 设定默认调度驱动为"filter_scheduler"。

class SchedulerManager(manager.Manager):    """Chooses a host to run instances on."""    target = messaging.Target(version='4.3')    _sentinel = object()    def __init__(self, scheduler_driver=None, *args, **kwargs):        if not scheduler_driver:            scheduler_driver = CONF.scheduler_driver        try:            self.driver = driver.DriverManager(                    "nova.scheduler.driver",                    scheduler_driver,                    invoke_on_load=True).driver        # TODO(Yingxin): Change to catch stevedore.exceptions.NoMatches after        # stevedore v1.9.0        except RuntimeError:            # NOTE(Yingxin): Loading full class path is deprecated and should            # be removed in the N release.            try:                self.driver = importutils.import_object(scheduler_driver)                LOG.warning(_LW("DEPRECATED: scheduler_driver uses "                                "classloader to load %(path)s. This legacy "                                "loading style will be removed in the "                                "N release."),                            {'path': scheduler_driver})            except (ImportError, ValueError):                raise RuntimeError(                        _("Cannot load scheduler driver from configuration "                          "%(conf)s."),                        {'conf': scheduler_driver})        super(SchedulerManager, self).__init__(service_name='scheduler',                                               *args, **kwargs)...    @messaging.expected_exceptions(exception.NoValidHost)    def select_destinations(self, ctxt,                            request_spec=None, filter_properties=None,                            spec_obj=_sentinel):        """Returns destinations(s) best suited for this RequestSpec.        The result should be a list of dicts with 'host', 'nodename' and        'limits' as keys.        """        # TODO(sbauza): Change the method signature to only accept a spec_obj        # argument once API v5 is provided.        if spec_obj is self._sentinel:            spec_obj = objects.RequestSpec.from_primitives(ctxt,                                                           request_spec,                                                           filter_properties)        dests = self.driver.select_destinations(ctxt, spec_obj)        return jsonutils.to_primitive(dests)...
  • conf/scheduler.py 默认"scheduler_driver"为"filter_scheduler",最终的RPC请求将会使用filter_scheduler包中的FilterScheduler类来实现。

driver_opt = cfg.StrOpt("scheduler_driver",        default="filter_scheduler",        help="""The class of the driver used by the scheduler. This should be chosen from oneof the entrypoints under the namespace 'nova.scheduler.driver' of file'setup.cfg'. If nothing is specified in this option, the 'filter_scheduler' isused.This option also supports deprecated full Python path to the class to be used.For example, "nova.scheduler.filter_scheduler.FilterScheduler". But note: thissupport will be dropped in the N Release.Other options are:    * 'caching_scheduler' which aggressively caches the system state for better    individual scheduler performance at the risk of more retries when running    multiple schedulers.    * 'chance_scheduler' which simply picks a host at random.    * 'fake_scheduler' which is used for testing.* Related options:    None""")

RPC请求处理源码分析

FilterScheduler.select_destinations选择目标节点的关键步骤如下:

  1. 使用self.host_manager.get_all_host_states获取所有节点状态,

  2. 使用self.host_manager.get_filtered_hosts获取所有过滤后的节点,

  3. 使用self.host_manager.get_weighed_hosts计算可用节点的权重,最后留下权重最高的节点,

  4. 如果有多个则使用random.choice随机选择一个,

  5. 同时使用chosen_host.obj.consume_from_request修改该节点的权重。

  • scheduler/filter_scheduler.py 过滤符合请求的节点。

class FilterScheduler(driver.Scheduler):    """Scheduler that can be used for filtering and weighing."""    def __init__(self, *args, **kwargs):        super(FilterScheduler, self).__init__(*args, **kwargs)        self.options = scheduler_options.SchedulerOptions()        self.notifier = rpc.get_notifier('scheduler')    def select_destinations(self, context, spec_obj):        """Selects a filtered set of hosts and nodes."""        self.notifier.info(            context, 'scheduler.select_destinations.start',            dict(request_spec=spec_obj.to_legacy_request_spec_dict()))        num_instances = spec_obj.num_instances        selected_hosts = self._schedule(context, spec_obj)        # Couldn't fulfill the request_spec        if len(selected_hosts) < num_instances:            # NOTE(Rui Chen): If multiple creates failed, set the updated time            # of selected HostState to None so that these HostStates are            # refreshed according to database in next schedule, and release            # the resource consumed by instance in the process of selecting            # host.            for host in selected_hosts:                host.obj.updated = None            # Log the details but don't put those into the reason since            # we don't want to give away too much information about our            # actual environment.            LOG.debug('There are %(hosts)d hosts available but '                      '%(num_instances)d instances requested to build.',                      {'hosts': len(selected_hosts),                       'num_instances': num_instances})            reason = _('There are not enough hosts available.')            raise exception.NoValidHost(reason=reason)        dests = [dict(host=host.obj.host, nodename=host.obj.nodename,                      limits=host.obj.limits) for host in selected_hosts]        self.notifier.info(            context, 'scheduler.select_destinations.end',            dict(request_spec=spec_obj.to_legacy_request_spec_dict()))        return dests    def _get_configuration_options(self):        """Fetch options dictionary. Broken out for testing."""        return self.options.get_configuration()    def _schedule(self, context, spec_obj):        """Returns a list of hosts that meet the required specs,        ordered by their fitness.        """        elevated = context.elevated()        config_options = self._get_configuration_options()        # Find our local list of acceptable hosts by repeatedly        # filtering and weighing our options. Each time we choose a        # host, we virtually consume resources on it so subsequent        # selections can adjust accordingly.        # Note: remember, we are using an iterator here. So only        # traverse this list once. This can bite you if the hosts        # are being scanned in a filter or weighing function.        hosts = self._get_all_host_states(elevated)        selected_hosts = []        num_instances = spec_obj.num_instances        # NOTE(sbauza): Adding one field for any out-of-tree need        spec_obj.config_options = config_options        for num in range(num_instances):            # Filter local hosts based on requirements ...            hosts = self.host_manager.get_filtered_hosts(hosts,                    spec_obj, index=num)            if not hosts:                # Can't get any more locally.                break            LOG.debug("Filtered %(hosts)s", {'hosts': hosts})            weighed_hosts = self.host_manager.get_weighed_hosts(hosts,                    spec_obj)            LOG.debug("Weighed %(hosts)s", {'hosts': weighed_hosts})            scheduler_host_subset_size = max(1,                                             CONF.scheduler_host_subset_size)            if scheduler_host_subset_size < len(weighed_hosts):                weighed_hosts = weighed_hosts[0:scheduler_host_subset_size]            chosen_host = random.choice(weighed_hosts)            LOG.debug("Selected host: %(host)s", {'host': chosen_host})            selected_hosts.append(chosen_host)            # Now consume the resources so the filter/weights            # will change for the next instance.            chosen_host.obj.consume_from_request(spec_obj)            if spec_obj.instance_group is not None:                spec_obj.instance_group.hosts.append(chosen_host.obj.host)                # hosts has to be not part of the updates when saving                spec_obj.instance_group.obj_reset_changes(['hosts'])        return selected_hosts    def _get_all_host_states(self, context):        """Template method, so a subclass can implement caching."""        return self.host_manager.get_all_host_states(context)...
  • scheduler/driver.py FilterScheduler的父类初始化"host_manager"为"nova.scheduler.host_manager"。

class Scheduler(object):    """The base class that all Scheduler classes should inherit from."""    def __init__(self):        self.host_manager = driver.DriverManager(                "nova.scheduler.host_manager",                CONF.scheduler_host_manager,                invoke_on_load=True).driver        self.servicegroup_api = servicegroup.API()...

获取所有节点状态

FilterScheduler的_get_all_host_states方法调用host_manager.get_all_host_states获取所有主机状态。

  • scheduler/host_manager.py 遍历所有计算节点,使用HostManager类的update方法更新状态,并放在host_state_map缓存中。

...class HostManager(object):...    def host_state_cls(self, host, node, **kwargs):        return HostState(host, node)...    def get_all_host_states(self, context):        """Returns a list of HostStates that represents all the hosts        the HostManager knows about. Also, each of the consumable resources        in HostState are pre-populated and adjusted based on data in the db.        """        service_refs = {service.host: service                        for service in objects.ServiceList.get_by_binary(                            context, 'nova-compute', include_disabled=True)}        # Get resource usage across the available compute nodes:        compute_nodes = objects.ComputeNodeList.get_all(context)        seen_nodes = set()        for compute in compute_nodes:            service = service_refs.get(compute.host)            if not service:                LOG.warning(_LW(                    "No compute service record found for host %(host)s"),                    {'host': compute.host})                continue            host = compute.host            node = compute.hypervisor_hostname            state_key = (host, node)            host_state = self.host_state_map.get(state_key)            if not host_state:                host_state = self.host_state_cls(host, node, compute=compute)                self.host_state_map[state_key] = host_state            # We force to update the aggregates info each time a new request            # comes in, because some changes on the aggregates could have been            # happening after setting this field for the first time            host_state.update(compute,                              dict(service),                              self._get_aggregates_info(host),                              self._get_instance_info(context, compute))            seen_nodes.add(state_key)        # remove compute nodes from host_state_map if they are not active        dead_nodes = set(self.host_state_map.keys()) - seen_nodes        for state_key in dead_nodes:            host, node = state_key            LOG.info(_LI("Removing dead compute node %(host)s:%(node)s "                         "from scheduler"), {'host': host, 'node': node})            del self.host_state_map[state_key]        return six.itervalues(self.host_state_map)

获取过滤后的节点

  • scheduler/host_manager.py 调用nova.scheduler.filters.HostFilterHandler的get_filtered_hosts方法进行节点过滤。

...from nova.scheduler import filters...class HostManager(object):    """Base HostManager class."""    # Can be overridden in a subclass    def host_state_cls(self, host, node, **kwargs):        return HostState(host, node)    def __init__(self):        self.host_state_map = {}        self.filter_handler = filters.HostFilterHandler()        filter_classes = self.filter_handler.get_matching_classes(                CONF.scheduler_available_filters)        self.filter_cls_map = {cls.__name__: cls for cls in filter_classes}        self.filter_obj_map = {}        self.default_filters = self._choose_host_filters(self._load_filters())        self.weight_handler = weights.HostWeightHandler()        weigher_classes = self.weight_handler.get_matching_classes(                CONF.scheduler_weight_classes)        self.weighers = [cls() for cls in weigher_classes]        # Dict of aggregates keyed by their ID        self.aggs_by_id = {}        # Dict of set of aggregate IDs keyed by the name of the host belonging        # to those aggregates        self.host_aggregates_map = collections.defaultdict(set)        self._init_aggregates()        self.tracks_instance_changes = CONF.scheduler_tracks_instance_changes        # Dict of instances and status, keyed by host        self._instance_info = {}        if self.tracks_instance_changes:            self._init_instance_info()...    def get_filtered_hosts(self, hosts, spec_obj, index=0):        """Filter hosts and return only ones passing all filters."""        def _strip_ignore_hosts(host_map, hosts_to_ignore):            ignored_hosts = []            for host in hosts_to_ignore:                for (hostname, nodename) in list(host_map.keys()):                    if host.lower() == hostname.lower():                        del host_map[(hostname, nodename)]                        ignored_hosts.append(host)            ignored_hosts_str = ', '.join(ignored_hosts)            LOG.info(_LI('Host filter ignoring hosts: %s'), ignored_hosts_str)        def _match_forced_hosts(host_map, hosts_to_force):            forced_hosts = []            lowered_hosts_to_force = [host.lower() for host in hosts_to_force]            for (hostname, nodename) in list(host_map.keys()):                if hostname.lower() not in lowered_hosts_to_force:                    del host_map[(hostname, nodename)]                else:                    forced_hosts.append(hostname)            if host_map:                forced_hosts_str = ', '.join(forced_hosts)                msg = _LI('Host filter forcing available hosts to %s')            else:                forced_hosts_str = ', '.join(hosts_to_force)                msg = _LI("No hosts matched due to not matching "                          "'force_hosts' value of '%s'")            LOG.info(msg % forced_hosts_str)        def _match_forced_nodes(host_map, nodes_to_force):            forced_nodes = []            for (hostname, nodename) in list(host_map.keys()):                if nodename not in nodes_to_force:                    del host_map[(hostname, nodename)]                else:                    forced_nodes.append(nodename)            if host_map:                forced_nodes_str = ', '.join(forced_nodes)                msg = _LI('Host filter forcing available nodes to %s')            else:                forced_nodes_str = ', '.join(nodes_to_force)                msg = _LI("No nodes matched due to not matching "                          "'force_nodes' value of '%s'")            LOG.info(msg % forced_nodes_str)        def _get_hosts_matching_request(hosts, requested_destination):            (host, node) = (requested_destination.host,                            requested_destination.node)            requested_nodes = [x for x in hosts                               if x.host == host and x.nodename == node]            if requested_nodes:                LOG.info(_LI('Host filter only checking host %(host)s and '                             'node %(node)s') % {'host': host, 'node': node})            else:                # NOTE(sbauza): The API level should prevent the user from                # providing a wrong destination but let's make sure a wrong                # destination doesn't trample the scheduler still.                LOG.info(_LI('No hosts matched due to not matching requested '                             'destination (%(host)s, %(node)s)'                             ) % {'host': host, 'node': node})            return iter(requested_nodes)        ignore_hosts = spec_obj.ignore_hosts or []        force_hosts = spec_obj.force_hosts or []        force_nodes = spec_obj.force_nodes or []        requested_node = spec_obj.requested_destination        if requested_node is not None:            # NOTE(sbauza): Reduce a potentially long set of hosts as much as            # possible to any requested destination nodes before passing the            # list to the filters            hosts = _get_hosts_matching_request(hosts, requested_node)        if ignore_hosts or force_hosts or force_nodes:            # NOTE(deva): we can't assume "host" is unique because            #             one host may have many nodes.            name_to_cls_map = {(x.host, x.nodename): x for x in hosts}            if ignore_hosts:                _strip_ignore_hosts(name_to_cls_map, ignore_hosts)                if not name_to_cls_map:                    return []            # NOTE(deva): allow force_hosts and force_nodes independently            if force_hosts:                _match_forced_hosts(name_to_cls_map, force_hosts)            if force_nodes:                _match_forced_nodes(name_to_cls_map, force_nodes)            if force_hosts or force_nodes:                # NOTE(deva): Skip filters when forcing host or node                if name_to_cls_map:                    return name_to_cls_map.values()                else:                    return []            hosts = six.itervalues(name_to_cls_map)        return self.filter_handler.get_filtered_objects(self.default_filters,                hosts, spec_obj, index)...
  • scheduler/filters/__init.py HostFilterHandler继承自filters.BaseFilterHandler基类。

class HostFilterHandler(filters.BaseFilterHandler):    def __init__(self):        super(HostFilterHandler, self).__init__(BaseHostFilter)
  • filters.py 遍历每个过滤器并调用其filter_all方法进行所有节点过滤,最终调用过滤器基类的_filter_one方法进行单个节点过滤。

...class BaseFilter(object):    """Base class for all filter classes."""    def _filter_one(self, obj, spec_obj):        """Return True if it passes the filter, False otherwise.        Override this in a subclass.        """        return True    def filter_all(self, filter_obj_list, spec_obj):        """Yield objects that pass the filter.        Can be overridden in a subclass, if you need to base filtering        decisions on all objects.  Otherwise, one can just override        _filter_one() to filter a single object.        """        for obj in filter_obj_list:            if self._filter_one(obj, spec_obj):                yield obj    # Set to true in a subclass if a filter only needs to be run once    # for each request rather than for each instance    run_filter_once_per_request = False    def run_filter_for_index(self, index):        """Return True if the filter needs to be run for the "index-th"        instance in a request.  Only need to override this if a filter        needs anything other than "first only" or "all" behaviour.        """        if self.run_filter_once_per_request and index > 0:            return False        else:            return True...class BaseFilterHandler(loadables.BaseLoader):    """Base class to handle loading filter classes.    This class should be subclassed where one needs to use filters.    """    def get_filtered_objects(self, filters, objs, spec_obj, index=0):        list_objs = list(objs)        LOG.debug("Starting with %d host(s)", len(list_objs))        # Track the hosts as they are removed. The 'full_filter_results' list        # contains the host/nodename info for every host that passes each        # filter, while the 'part_filter_results' list just tracks the number        # removed by each filter, unless the filter returns zero hosts, in        # which case it records the host/nodename for the last batch that was        # removed. Since the full_filter_results can be very large, it is only        # recorded if the LOG level is set to debug.        part_filter_results = []        full_filter_results = []        log_msg = "%(cls_name)s: (start: %(start)s, end: %(end)s)"        for filter_ in filters:            if filter_.run_filter_for_index(index):                cls_name = filter_.__class__.__name__                start_count = len(list_objs)                objs = filter_.filter_all(list_objs, spec_obj)                if objs is None:                    LOG.debug("Filter %s says to stop filtering", cls_name)                    return                list_objs = list(objs)                end_count = len(list_objs)                part_filter_results.append(log_msg % {"cls_name": cls_name,                        "start": start_count, "end": end_count})                if list_objs:                    remaining = [(getattr(obj, "host", obj),                                  getattr(obj, "nodename", ""))                                 for obj in list_objs]                    full_filter_results.append((cls_name, remaining))                else:                    LOG.info(_LI("Filter %s returned 0 hosts"), cls_name)                    full_filter_results.append((cls_name, None))                    break                LOG.debug("Filter %(cls_name)s returned "                          "%(obj_len)d host(s)",                          {'cls_name': cls_name, 'obj_len': len(list_objs)})        if not list_objs:            # Log the filtration history            # NOTE(sbauza): Since the Cells scheduler still provides a legacy            # dictionary for filter_props, and since we agreed on not modifying            # the Cells scheduler to support that because of Cells v2, we            # prefer to define a compatible way to address both types            if isinstance(spec_obj, dict):                rspec = spec_obj.get("request_spec", {})                inst_props = rspec.get("instance_properties", {})                inst_uuid = inst_props.get("uuid", "")            else:                inst_uuid = spec_obj.instance_uuid            msg_dict = {"inst_uuid": inst_uuid,                        "str_results": str(full_filter_results),                       }            full_msg = ("Filtering removed all hosts for the request with "                        "instance ID "                        "'%(inst_uuid)s'. Filter results: %(str_results)s"                       ) % msg_dict            msg_dict["str_results"] = str(part_filter_results)            part_msg = _LI("Filtering removed all hosts for the request with "                           "instance ID "                           "'%(inst_uuid)s'. Filter results: %(str_results)s"                           ) % msg_dict            LOG.debug(full_msg)            LOG.info(part_msg)        return list_objs
  • scheduler/host_manager.py 获取所有过滤器列表。

...CONF = nova.conf.CONF...class HostManager(object):...    def __init__(self):...         self.default_filters = self._choose_host_filters(self._load_filters())...    def _load_filters(self):        return CONF.scheduler_default_filters...    def _choose_host_filters(self, filter_cls_names):        """Since the caller may specify which filters to use we need        to have an authoritative list of what is permissible. This        function checks the filter names against a predefined set        of acceptable filters.        """        if not isinstance(filter_cls_names, (list, tuple)):            filter_cls_names = [filter_cls_names]        good_filters = []        bad_filters = []        for filter_name in filter_cls_names:            if filter_name not in self.filter_obj_map:                if filter_name not in self.filter_cls_map:                    bad_filters.append(filter_name)                    continue                filter_cls = self.filter_cls_map[filter_name]                self.filter_obj_map[filter_name] = filter_cls()            good_filters.append(self.filter_obj_map[filter_name])        if bad_filters:            msg = ", ".join(bad_filters)            raise exception.SchedulerHostFilterNotFound(filter_name=msg)        return good_filters...
  • conf/scheduler.py 默认的过滤器列表。

...host_mgr_default_filt_opt = cfg.ListOpt("scheduler_default_filters",        default=[          "RetryFilter",          "AvailabilityZoneFilter",          "RamFilter",          "DiskFilter",          "ComputeFilter",          "ComputeCapabilitiesFilter",          "ImagePropertiesFilter",          "ServerGroupAntiAffinityFilter",          "ServerGroupAffinityFilter",          ],        help="""This option is the list of filter class names that will be used for filteringhosts. The use of 'default' in the name of this option implies that otherfilters may sometimes be used, but that is not the case. These filters will beapplied in the order they are listed, so place your most restrictive filtersfirst to make the filtering process more efficient.This option is only used by the FilterScheduler and its subclasses; if you usea different scheduler, this option has no effect.* Related options:    All of the filters in this option *must* be present in the    'scheduler_available_filters' option, or a SchedulerHostFilterNotFound    exception will be raised.""")...

获取可用节点权重

  • scheduler/host_manager.py

...from nova.scheduler import weights...class HostManager(object):...    def __init__(self):...        self.weight_handler = weights.HostWeightHandler()...    def get_weighed_hosts(self, hosts, spec_obj):        """Weigh the hosts."""        return self.weight_handler.get_weighed_objects(self.weighers,                hosts, spec_obj)...

虚拟机创建流程总结

nova-api服务

  • /nova/api/openstack/compute/servers.py:Controller create() - 处理用户的http请求;

  • /nova/compute/api.py:API create()->_create_instance()->compute_task_api() - 处理虚拟机create方法;

  • /nova/conductor/init.py:ComputeTaskAPI build_instances() - 根据配置选择本地还是远程调用;

  • /nova/conductor/rpcapi.py:ComputeTaskAPI build_instances() - RPC调用nova-conductor的build_instances方法。

nova-conductor服务

  • /nova/conductor/Manager.py:ComputeTaskManager build_instances() - RPC调用nova-scheduler服务进行节点选择(self.scheduler_client.select_destinations());

  • /nova/compute/rpcapi.py:ComputeAPI build_and_run_instance() - RPC调用nova-compute服务创建并运行虚拟机。

nova-scheduler服务

  • /nova/scheduler/client/init.py:SchedulerClient select_destinations() - nova-scheduler节点选择的RPC客户端;

  • /nova/scheduler/manager.py:SchedulerManager select_destinations() - 使用调度器驱动进行节点选择;

  • /nova/scheduler/filter_scheduler.py:FilterScheduler select_destinations() - 使用过滤器调度驱动进行节点选择;

  • /nova/scheduler/filter_scheduler.py:FilterScheduler _schedule() - 进行节点过滤和称重,选择出合适的节点。

nova-compute服务

  • /nova/compute/manager.py:ComputeManager build_and_run_instance() 构建并运行虚拟机。

主机状态获取源码分析

  • scheduler/host_manager.py

class HostState(object):    """Mutable and immutable information tracked for a host.    This is an attempt to remove the ad-hoc data structures    previously used and lock down access.    """    def __init__(self, host, node):        self.host = host        self.nodename = node        self._lock_name = (host, node)        # Mutable available resources.        # These will change as resources are virtually "consumed".        self.total_usable_ram_mb = 0        self.total_usable_disk_gb = 0        self.disk_mb_used = 0        self.free_ram_mb = 0        self.free_disk_mb = 0        self.vcpus_total = 0        self.vcpus_used = 0        self.pci_stats = None        self.numa_topology = None        # Additional host information from the compute node stats:        self.num_instances = 0        self.num_io_ops = 0        # Other information        self.host_ip = None        self.hypervisor_type = None        self.hypervisor_version = None        self.hypervisor_hostname = None        self.cpu_info = None        self.supported_instances = None        # Resource oversubscription values for the compute host:        self.limits = {}        # Generic metrics from compute nodes        self.metrics = None        # List of aggregates the host belongs to        self.aggregates = []        # Instances on this host        self.instances = {}        # Allocation ratios for this host        self.ram_allocation_ratio = None        self.cpu_allocation_ratio = None        self.disk_allocation_ratio = None        self.updated = None    def update(self, compute=None, service=None, aggregates=None,            inst_dict=None):        """Update all information about a host."""        @utils.synchronized(self._lock_name)        def _locked_update(self, compute, service, aggregates, inst_dict):            # Scheduler API is inherently multi-threaded as every incoming RPC            # message will be dispatched in it's own green thread. So the            # shared host state should be updated in a consistent way to make            # sure its data is valid under concurrent write operations.            if compute is not None:                LOG.debug("Update host state from compute node: %s", compute)                self._update_from_compute_node(compute)            if aggregates is not None:                LOG.debug("Update host state with aggregates: %s", aggregates)                self.aggregates = aggregates            if service is not None:                LOG.debug("Update host state with service dict: %s", service)                self.service = ReadOnlyDict(service)            if inst_dict is not None:                LOG.debug("Update host state with instances: %s", inst_dict)                self.instances = inst_dict        return _locked_update(self, compute, service, aggregates, inst_dict)    def _update_from_compute_node(self, compute):        """Update information about a host from a ComputeNode object."""        if (self.updated and compute.updated_at                and self.updated > compute.updated_at):            return        all_ram_mb = compute.memory_mb        # Assume virtual size is all consumed by instances if use qcow2 disk.        free_gb = compute.free_disk_gb        least_gb = compute.disk_available_least        if least_gb is not None:            if least_gb > free_gb:                # can occur when an instance in database is not on host                LOG.warning(_LW("Host %(hostname)s has more disk space than "                                "database expected "                                "(%(physical)s GB > %(database)s GB)"),                            {'physical': least_gb, 'database': free_gb,                             'hostname': compute.hypervisor_hostname})            free_gb = min(least_gb, free_gb)        free_disk_mb = free_gb * 1024        self.disk_mb_used = compute.local_gb_used * 1024        # NOTE(jogo) free_ram_mb can be negative        self.free_ram_mb = compute.free_ram_mb        self.total_usable_ram_mb = all_ram_mb        self.total_usable_disk_gb = compute.local_gb        self.free_disk_mb = free_disk_mb        self.vcpus_total = compute.vcpus        self.vcpus_used = compute.vcpus_used        self.updated = compute.updated_at        self.numa_topology = compute.numa_topology        self.pci_stats = pci_stats.PciDeviceStats(            compute.pci_device_pools)        # All virt drivers report host_ip        self.host_ip = compute.host_ip        self.hypervisor_type = compute.hypervisor_type        self.hypervisor_version = compute.hypervisor_version        self.hypervisor_hostname = compute.hypervisor_hostname        self.cpu_info = compute.cpu_info        if compute.supported_hv_specs:            self.supported_instances = [spec.to_list() for spec                                        in compute.supported_hv_specs]        else:            self.supported_instances = []        # Don't store stats directly in host_state to make sure these don't        # overwrite any values, or get overwritten themselves. Store in self so        # filters can schedule with them.        self.stats = compute.stats or {}        # Track number of instances on host        self.num_instances = int(self.stats.get('num_instances', 0))        self.num_io_ops = int(self.stats.get('io_workload', 0))        # update metrics        self.metrics = objects.MonitorMetricList.from_json(compute.metrics)        # update allocation ratios given by the ComputeNode object        self.cpu_allocation_ratio = compute.cpu_allocation_ratio        self.ram_allocation_ratio = compute.ram_allocation_ratio        self.disk_allocation_ratio = compute.disk_allocation_ratio    def consume_from_request(self, spec_obj):        """Incrementally update host state from a RequestSpec object."""        @utils.synchronized(self._lock_name)        @set_update_time_on_success        def _locked(self, spec_obj):            # Scheduler API is inherently multi-threaded as every incoming RPC            # message will be dispatched in it's own green thread. So the            # shared host state should be consumed in a consistent way to make            # sure its data is valid under concurrent write operations.            self._locked_consume_from_request(spec_obj)        return _locked(self, spec_obj)    def _locked_consume_from_request(self, spec_obj):        disk_mb = (spec_obj.root_gb +                   spec_obj.ephemeral_gb) * 1024        ram_mb = spec_obj.memory_mb        vcpus = spec_obj.vcpus        self.free_ram_mb -= ram_mb        self.free_disk_mb -= disk_mb        self.vcpus_used += vcpus        # Track number of instances on host        self.num_instances += 1        pci_requests = spec_obj.pci_requests        if pci_requests and self.pci_stats:            pci_requests = pci_requests.requests        else:            pci_requests = None        # Calculate the numa usage        host_numa_topology, _fmt = hardware.host_topology_and_format_from_host(                                self)        instance_numa_topology = spec_obj.numa_topology        spec_obj.numa_topology = hardware.numa_fit_instance_to_host(            host_numa_topology, instance_numa_topology,            limits=self.limits.get('numa_topology'),            pci_requests=pci_requests, pci_stats=self.pci_stats)        if pci_requests:            instance_cells = None            if spec_obj.numa_topology:                instance_cells = spec_obj.numa_topology.cells            self.pci_stats.apply_requests(pci_requests, instance_cells)        # NOTE(sbauza): Yeah, that's crap. We should get rid of all of those        # NUMA helpers because now we're 100% sure that spec_obj.numa_topology        # is an InstanceNUMATopology object. Unfortunately, since        # HostState.host_numa_topology is still limbo between an NUMATopology        # object (when updated by consume_from_request), a ComputeNode object        # (when updated by update_from_compute_node), we need to keep the call        # to get_host_numa_usage_from_instance until it's fixed (and use a        # temporary orphaned Instance object as a proxy)        instance = objects.Instance(numa_topology=spec_obj.numa_topology)        self.numa_topology = hardware.get_host_numa_usage_from_instance(                self, instance)        # NOTE(sbauza): By considering all cases when the scheduler is called        # and when consume_from_request() is run, we can safely say that there        # is always an IO operation because we want to move the instance        self.num_io_ops += 1    def __repr__(self):        return ("(%(host)s, %(node)s) ram: %(free_ram)sMB "                "disk: %(free_disk)sMB io_ops: %(num_io_ops)s "                "instances: %(num_instances)s" %                {'host': self.host, 'node': self.nodename,                 'free_ram': self.free_ram_mb, 'free_disk': self.free_disk_mb,                 'num_io_ops': self.num_io_ops,                 'num_instances': self.num_instances})

资源规格生成源码分析

创建虚拟机时的参数构建

这是在compute/api.py源码中的参数构建,还有一部分在conductor/manager.py的build_instances方法中。

...class API(base.Base):    """API for interacting with the compute manager."""...    def _create_instance(self, context, instance_type,               image_href, kernel_id, ramdisk_id,               min_count, max_count,               display_name, display_description,               key_name, key_data, security_groups,               availability_zone, user_data, metadata, injected_files,               admin_password, access_ip_v4, access_ip_v6,               requested_networks, config_drive,               block_device_mapping, auto_disk_config, filter_properties,               reservation_id=None, legacy_bdm=True, shutdown_terminate=False,               check_server_group_quota=False):        """Verify all the input parameters regardless of the provisioning        strategy being performed and schedule the instance(s) for        creation.        """        # Normalize and setup some parameters        if reservation_id is None:            reservation_id = utils.generate_uid('r')        security_groups = security_groups or ['default']        min_count = min_count or 1        max_count = max_count or min_count        block_device_mapping = block_device_mapping or []        if image_href:            image_id, boot_meta = self._get_image(context, image_href)        else:            image_id = None            boot_meta = self._get_bdm_image_metadata(                context, block_device_mapping, legacy_bdm)        self._check_auto_disk_config(image=boot_meta,                                     auto_disk_config=auto_disk_config)        base_options, max_net_count, key_pair = \                self._validate_and_build_base_options(                    context, instance_type, boot_meta, image_href, image_id,                    kernel_id, ramdisk_id, display_name, display_description,                    key_name, key_data, security_groups, availability_zone,                    user_data, metadata, access_ip_v4, access_ip_v6,                    requested_networks, config_drive, auto_disk_config,                    reservation_id, max_count)        # max_net_count is the maximum number of instances requested by the        # user adjusted for any network quota constraints, including        # consideration of connections to each requested network        if max_net_count < min_count:            raise exception.PortLimitExceeded()        elif max_net_count < max_count:            LOG.info(_LI("max count reduced from %(max_count)d to "                         "%(max_net_count)d due to network port quota"),                        {'max_count': max_count,                         'max_net_count': max_net_count})            max_count = max_net_count        block_device_mapping = self._check_and_transform_bdm(context,            base_options, instance_type, boot_meta, min_count, max_count,            block_device_mapping, legacy_bdm)        # We can't do this check earlier because we need bdms from all sources        # to have been merged in order to get the root bdm.        self._checks_for_create_and_rebuild(context, image_id, boot_meta,                instance_type, metadata, injected_files,                block_device_mapping.root_bdm())        instance_group = self._get_requested_instance_group(context,                                   filter_properties)        instances = self._provision_instances(context, instance_type,                min_count, max_count, base_options, boot_meta, security_groups,                block_device_mapping, shutdown_terminate,                instance_group, check_server_group_quota, filter_properties,                key_pair)        for instance in instances:            self._record_action_start(context, instance,                                      instance_actions.CREATE)        self.compute_task_api.build_instances(context,                instances=instances, image=boot_meta,                filter_properties=filter_properties,                admin_password=admin_password,                injected_files=injected_files,                requested_networks=requested_networks,                security_groups=security_groups,                block_device_mapping=block_device_mapping,                legacy_bdm=False)        return (instances, reservation_id)...

构建基本的参数选项

(compute/api.py)

...    def _validate_and_build_base_options(self, context, instance_type,                                         boot_meta, image_href, image_id,                                         kernel_id, ramdisk_id, display_name,                                         display_description, key_name,                                         key_data, security_groups,                                         availability_zone, user_data,                                         metadata, access_ip_v4, access_ip_v6,                                         requested_networks, config_drive,                                         auto_disk_config, reservation_id,                                         max_count):        """Verify all the input parameters regardless of the provisioning        strategy being performed.        """        if instance_type['disabled']:            raise exception.FlavorNotFound(flavor_id=instance_type['id'])        if user_data:            l = len(user_data)            if l > MAX_USERDATA_SIZE:                # NOTE(mikal): user_data is stored in a text column, and                # the database might silently truncate if its over length.                raise exception.InstanceUserDataTooLarge(                    length=l, maxsize=MAX_USERDATA_SIZE)            try:                base64.decodestring(user_data)            except base64.binascii.Error:                raise exception.InstanceUserDataMalformed()        self._check_requested_secgroups(context, security_groups)        # Note:  max_count is the number of instances requested by the user,        # max_network_count is the maximum number of instances taking into        # account any network quotas        max_network_count = self._check_requested_networks(context,                                     requested_networks, max_count)        kernel_id, ramdisk_id = self._handle_kernel_and_ramdisk(                context, kernel_id, ramdisk_id, boot_meta)        config_drive = self._check_config_drive(config_drive)        if key_data is None and key_name is not None:            key_pair = objects.KeyPair.get_by_name(context,                                                   context.user_id,                                                   key_name)            key_data = key_pair.public_key        else:            key_pair = None        root_device_name = block_device.prepend_dev(                block_device.properties_root_device_name(                    boot_meta.get('properties', {})))        try:            image_meta = objects.ImageMeta.from_dict(boot_meta)        except ValueError as e:            # there must be invalid values in the image meta properties so            # consider this an invalid request            msg = _('Invalid image metadata. Error: %s') % six.text_type(e)            raise exception.InvalidRequest(msg)        numa_topology = hardware.numa_get_constraints(                instance_type, image_meta)        system_metadata = {}        # PCI requests come from two sources: instance flavor and        # requested_networks. The first call in below returns an        # InstancePCIRequests object which is a list of InstancePCIRequest        # objects. The second call in below creates an InstancePCIRequest        # object for each SR-IOV port, and append it to the list in the        # InstancePCIRequests object        pci_request_info = pci_request.get_pci_requests_from_flavor(            instance_type)        self.network_api.create_pci_requests_for_sriov_ports(context,            pci_request_info, requested_networks)        base_options = {            'reservation_id': reservation_id,            'image_ref': image_href,            'kernel_id': kernel_id or '',            'ramdisk_id': ramdisk_id or '',            'power_state': power_state.NOSTATE,            'vm_state': vm_states.BUILDING,            'config_drive': config_drive,            'user_id': context.user_id,            'project_id': context.project_id,            'instance_type_id': instance_type['id'],            'memory_mb': instance_type['memory_mb'],            'vcpus': instance_type['vcpus'],            'root_gb': instance_type['root_gb'],            'ephemeral_gb': instance_type['ephemeral_gb'],            'display_name': display_name,            'display_description': display_description,            'user_data': user_data,            'key_name': key_name,            'key_data': key_data,            'locked': False,            'metadata': metadata or {},            'access_ip_v4': access_ip_v4,            'access_ip_v6': access_ip_v6,            'availability_zone': availability_zone,            'root_device_name': root_device_name,            'progress': 0,            'pci_requests': pci_request_info,            'numa_topology': numa_topology,            'system_metadata': system_metadata}        options_from_image = self._inherit_properties_from_image(                boot_meta, auto_disk_config)        base_options.update(options_from_image)        # return the validated options and maximum number of instances allowed        # by the network quotas        return base_options, max_network_count, key_pair...

构建实例参数

(compute/api.py)

...    def _provision_instances(self, context, instance_type, min_count,            max_count, base_options, boot_meta, security_groups,            block_device_mapping, shutdown_terminate,            instance_group, check_server_group_quota, filter_properties,            key_pair):        # Reserve quotas        num_instances, quotas = self._check_num_instances_quota(                context, instance_type, min_count, max_count)        security_groups = self.security_group_api.populate_security_groups(                security_groups)        self.security_group_api.ensure_default(context)        LOG.debug("Going to run %s instances...", num_instances)        instances = []        instance_mappings = []        build_requests = []        try:            for i in range(num_instances):                # Create a uuid for the instance so we can store the                # RequestSpec before the instance is created.                instance_uuid = str(uuid.uuid4())                # Store the RequestSpec that will be used for scheduling.                req_spec = objects.RequestSpec.from_components(context,                        instance_uuid, boot_meta, instance_type,                        base_options['numa_topology'],                        base_options['pci_requests'], filter_properties,                        instance_group, base_options['availability_zone'])                req_spec.create()                # Create an instance object, but do not store in db yet.                instance = objects.Instance(context=context)                instance.uuid = instance_uuid                instance.update(base_options)                instance.keypairs = objects.KeyPairList(objects=[])                if key_pair:                    instance.keypairs.objects.append(key_pair)                instance = self.create_db_entry_for_new_instance(context,                        instance_type, boot_meta, instance, security_groups,                        block_device_mapping, num_instances, i,                        shutdown_terminate, create_instance=False)                block_device_mapping = (                    self._bdm_validate_set_size_and_instance(context,                        instance, instance_type, block_device_mapping))                build_request = objects.BuildRequest(context,                        instance=instance, instance_uuid=instance.uuid,                        project_id=instance.project_id,                        block_device_mappings=block_device_mapping)                build_request.create()                build_requests.append(build_request)                # Create an instance_mapping.  The null cell_mapping indicates                # that the instance doesn't yet exist in a cell, and lookups                # for it need to instead look for the RequestSpec.                # cell_mapping will be populated after scheduling, with a                # scheduling failure using the cell_mapping for the special                # cell0.                inst_mapping = objects.InstanceMapping(context=context)                inst_mapping.instance_uuid = instance_uuid                inst_mapping.project_id = context.project_id                inst_mapping.cell_mapping = None                inst_mapping.create()                instance_mappings.append(inst_mapping)                # TODO(alaski): Cast to conductor here which will call the                # scheduler and defer instance creation until the scheduler                # has picked a cell/host. Set the instance_mapping to the cell                # that the instance is scheduled to.                # NOTE(alaski): Instance and block device creation are going                # to move to the conductor.                instance.create()                instances.append(instance)                self._create_block_device_mapping(block_device_mapping)                if instance_group:                    if check_server_group_quota:                        count = objects.Quotas.count(context,                                             'server_group_members',                                             instance_group,                                             context.user_id)                        try:                            objects.Quotas.limit_check(context,                                               server_group_members=count + 1)                        except exception.OverQuota:                            msg = _("Quota exceeded, too many servers in "                                    "group")                            raise exception.QuotaError(msg)                    objects.InstanceGroup.add_members(context,                                                      instance_group.uuid,                                                      [instance.uuid])                # send a state update notification for the initial create to                # show it going from non-existent to BUILDING                notifications.send_update_with_states(context, instance, None,                        vm_states.BUILDING, None, None, service="api")        # In the case of any exceptions, attempt DB cleanup and rollback the        # quota reservations.        except Exception:            with excutils.save_and_reraise_exception():                try:                    for instance in instances:                        try:                            instance.destroy()                        except exception.ObjectActionError:                            pass                    for instance_mapping in instance_mappings:                        try:                            instance_mapping.destroy()                        except exception.InstanceMappingNotFound:                            pass                    for build_request in build_requests:                        try:                            build_request.destroy()                        except exception.BuildRequestNotFound:                            pass                finally:                    quotas.rollback()        # Commit the reservations        quotas.commit()        return instances...

构建镜像参数

(compute/api.py)

...    def _get_bdm_image_metadata(self, context, block_device_mapping,                                legacy_bdm=True):        """If we are booting from a volume, we need to get the        volume details from Cinder and make sure we pass the        metadata back accordingly.        """        if not block_device_mapping:            return {}        for bdm in block_device_mapping:            if (legacy_bdm and                    block_device.get_device_letter(                       bdm.get('device_name', '')) != 'a'):                continue            elif not legacy_bdm and bdm.get('boot_index') != 0:                continue            volume_id = bdm.get('volume_id')            snapshot_id = bdm.get('snapshot_id')            if snapshot_id:                # NOTE(alaski): A volume snapshot inherits metadata from the                # originating volume, but the API does not expose metadata                # on the snapshot itself.  So we query the volume for it below.                snapshot = self.volume_api.get_snapshot(context, snapshot_id)                volume_id = snapshot['volume_id']            if bdm.get('image_id'):                try:                    image_id = bdm['image_id']                    image_meta = self.image_api.get(context, image_id)                    return image_meta                except Exception:                    raise exception.InvalidBDMImage(id=image_id)            elif volume_id:                try:                    volume = self.volume_api.get(context, volume_id)                except exception.CinderConnectionFailed:                    raise                except Exception:                    raise exception.InvalidBDMVolume(id=volume_id)                if not volume.get('bootable', True):                    raise exception.InvalidBDMVolumeNotBootable(id=volume_id)                return utils.get_image_metadata_from_volume(volume)        return {}...

组合资源规格参数

由conductor.manager.ComputeTaskManager.build_instances方法调用(scheduler/utils.py )。

...def build_request_spec(ctxt, image, instances, instance_type=None):    """Build a request_spec for the scheduler.    The request_spec assumes that all instances to be scheduled are the same    type.    """    instance = instances[0]    if instance_type is None:        if isinstance(instance, obj_instance.Instance):            instance_type = instance.get_flavor()        else:            instance_type = flavors.extract_flavor(instance)    if isinstance(instance, obj_instance.Instance):        instance = obj_base.obj_to_primitive(instance)        # obj_to_primitive doesn't copy this enough, so be sure        # to detach our metadata blob because we modify it below.        instance['system_metadata'] = dict(instance.get('system_metadata', {}))    if isinstance(instance_type, objects.Flavor):        instance_type = obj_base.obj_to_primitive(instance_type)        # NOTE(danms): Replicate this old behavior because the        # scheduler RPC interface technically expects it to be        # there. Remove this when we bump the scheduler RPC API to        # v5.0        try:            flavors.save_flavor_info(instance.get('system_metadata', {}),                                     instance_type)        except KeyError:            # If the flavor isn't complete (which is legit with a            # flavor object, just don't put it in the request spec            pass    request_spec = {            'image': image or {},            'instance_properties': instance,            'instance_type': instance_type,            'num_instances': len(instances)}    return jsonutils.to_primitive(request_spec)...

构建最终规格参数

在响应RPC调用时,ComputeTaskManager(conductor/manager.py)的_schedule_instances方法和SchedulerManager(scheduler/manager.py)的select_destinations方法都会使用objects.RequestSpec.from_primitives(objects/request_spec.py)方法生成一个新风格的RequestSpec。

  • objects/request_spec.py 生成一个新风格的RequestSpec

...from nova.objects import instance as obj_instance...@base.NovaObjectRegistry.registerclass RequestSpec(base.NovaObject):...    @classmethod    def from_primitives(cls, context, request_spec, filter_properties):        """Returns a new RequestSpec object by hydrating it from legacy dicts.        Deprecated.  A RequestSpec object is created early in the boot process        using the from_components method.  That object will either be passed to        places that require it, or it can be looked up with        get_by_instance_uuid.  This method can be removed when there are no        longer any callers.  Because the method is not remotable it is not tied        to object versioning.        That helper is not intended to leave the legacy dicts kept in the nova        codebase, but is rather just for giving a temporary solution for        populating the Spec object until we get rid of scheduler_utils'        build_request_spec() and the filter_properties hydratation in the        conductor.        :param context: a context object        :param request_spec: An old-style request_spec dictionary        :param filter_properties: An old-style filter_properties dictionary        """        num_instances = request_spec.get('num_instances', 1)        spec = cls(context, num_instances=num_instances)        # Hydrate from request_spec first        image = request_spec.get('image')        spec._image_meta_from_image(image)        instance = request_spec.get('instance_properties')        spec._from_instance(instance)        flavor = request_spec.get('instance_type')        spec._from_flavor(flavor)        # Hydrate now from filter_properties        spec.ignore_hosts = filter_properties.get('ignore_hosts')        spec.force_hosts = filter_properties.get('force_hosts')        spec.force_nodes = filter_properties.get('force_nodes')        retry = filter_properties.get('retry', {})        spec._from_retry(retry)        limits = filter_properties.get('limits', {})        spec._from_limits(limits)        spec._populate_group_info(filter_properties)        scheduler_hints = filter_properties.get('scheduler_hints', {})        spec._from_hints(scheduler_hints)        # NOTE(sbauza): Default the other fields that are not part of the        # original contract        spec.obj_set_defaults()        return spec...    def _image_meta_from_image(self, image):        if isinstance(image, objects.ImageMeta):            self.image = image        elif isinstance(image, dict):            # NOTE(sbauza): Until Nova is fully providing an ImageMeta object            # for getting properties, we still need to hydrate it here            # TODO(sbauza): To be removed once all RequestSpec hydrations are            # done on the conductor side and if the image is an ImageMeta            self.image = objects.ImageMeta.from_dict(image)        else:            self.image = None...    def _from_instance(self, instance):        if isinstance(instance, obj_instance.Instance):            # NOTE(sbauza): Instance should normally be a NovaObject...            getter = getattr        elif isinstance(instance, dict):            # NOTE(sbauza): ... but there are some cases where request_spec            # has an instance key as a dictionary, just because            # select_destinations() is getting a request_spec dict made by            # sched_utils.build_request_spec()            # TODO(sbauza): To be removed once all RequestSpec hydrations are            # done on the conductor side            getter = lambda x, y: x.get(y)        else:            # If the instance is None, there is no reason to set the fields            return        instance_fields = ['numa_topology', 'pci_requests', 'uuid',                           'project_id', 'availability_zone']        for field in instance_fields:            if field == 'uuid':                setattr(self, 'instance_uuid', getter(instance, field))            elif field == 'pci_requests':                self._from_instance_pci_requests(getter(instance, field))            elif field == 'numa_topology':                self._from_instance_numa_topology(getter(instance, field))            else:                setattr(self, field, getter(instance, field))...    def _from_flavor(self, flavor):        if isinstance(flavor, objects.Flavor):            self.flavor = flavor        elif isinstance(flavor, dict):            # NOTE(sbauza): Again, request_spec is primitived by            # sched_utils.build_request_spec() and passed to            # select_destinations() like this            # TODO(sbauza): To be removed once all RequestSpec hydrations are            # done on the conductor side            self.flavor = objects.Flavor(**flavor)...    def _from_retry(self, retry_dict):        self.retry = (SchedulerRetries.from_dict(self._context, retry_dict)                      if retry_dict else None)...    def _from_limits(self, limits_dict):        self.limits = SchedulerLimits.from_dict(limits_dict)...    def _from_hints(self, hints_dict):        if hints_dict is None:            self.scheduler_hints = None            return        self.scheduler_hints = {            hint: value if isinstance(value, list) else [value]            for hint, value in six.iteritems(hints_dict)}...class SchedulerRetries(base.NovaObject):    # Version 1.0: Initial version    # Version 1.1: ComputeNodeList version 1.14    VERSION = '1.1'    fields = {        'num_attempts': fields.IntegerField(),        # NOTE(sbauza): Even if we are only using host/node strings, we need to        # know which compute nodes were tried        'hosts': fields.ObjectField('ComputeNodeList'),    }...class SchedulerLimits(base.NovaObject):    # Version 1.0: Initial version    VERSION = '1.0'    fields = {        'numa_topology': fields.ObjectField('NUMATopologyLimits',                                            nullable=True,                                            default=None),        'vcpu': fields.IntegerField(nullable=True, default=None),        'disk_gb': fields.IntegerField(nullable=True, default=None),        'memory_mb': fields.IntegerField(nullable=True, default=None),    }...
  • objects/image_meta.py 镜像规格

...class ImageMeta(base.NovaObject):...    fields = {        'id': fields.UUIDField(),        'name': fields.StringField(),        'status': fields.StringField(),        'visibility': fields.StringField(),        'protected': fields.FlexibleBooleanField(),        'checksum': fields.StringField(),        'owner': fields.StringField(),        'size': fields.IntegerField(),        'virtual_size': fields.IntegerField(),        'container_format': fields.StringField(),        'disk_format': fields.StringField(),        'created_at': fields.DateTimeField(nullable=True),        'updated_at': fields.DateTimeField(nullable=True),        'tags': fields.ListOfStringsField(),        'direct_url': fields.StringField(),        'min_ram': fields.IntegerField(),        'min_disk': fields.IntegerField(),        'properties': fields.ObjectField('ImageMetaProps'),    }...
  • objects/instance.py 实例规格

...class Instance(base.NovaPersistentObject, base.NovaObject,               base.NovaObjectDictCompat):...    fields = {        'id': fields.IntegerField(),        'user_id': fields.StringField(nullable=True),        'project_id': fields.StringField(nullable=True),        'image_ref': fields.StringField(nullable=True),        'kernel_id': fields.StringField(nullable=True),        'ramdisk_id': fields.StringField(nullable=True),        'hostname': fields.StringField(nullable=True),        'launch_index': fields.IntegerField(nullable=True),        'key_name': fields.StringField(nullable=True),        'key_data': fields.StringField(nullable=True),        'power_state': fields.IntegerField(nullable=True),        'vm_state': fields.StringField(nullable=True),        'task_state': fields.StringField(nullable=True),        'services': fields.ObjectField('ServiceList'),        'memory_mb': fields.IntegerField(nullable=True),        'vcpus': fields.IntegerField(nullable=True),        'root_gb': fields.IntegerField(nullable=True),        'ephemeral_gb': fields.IntegerField(nullable=True),        'ephemeral_key_uuid': fields.UUIDField(nullable=True),        'host': fields.StringField(nullable=True),        'node': fields.StringField(nullable=True),        'instance_type_id': fields.IntegerField(nullable=True),        'user_data': fields.StringField(nullable=True),        'reservation_id': fields.StringField(nullable=True),        'launched_at': fields.DateTimeField(nullable=True),        'terminated_at': fields.DateTimeField(nullable=True),        'availability_zone': fields.StringField(nullable=True),        'display_name': fields.StringField(nullable=True),        'display_description': fields.StringField(nullable=True),        'launched_on': fields.StringField(nullable=True),        # NOTE(jdillaman): locked deprecated in favor of locked_by,        # to be removed in Icehouse        'locked': fields.BooleanField(default=False),        'locked_by': fields.StringField(nullable=True),        'os_type': fields.StringField(nullable=True),        'architecture': fields.StringField(nullable=True),        'vm_mode': fields.StringField(nullable=True),        'uuid': fields.UUIDField(),        'root_device_name': fields.StringField(nullable=True),        'default_ephemeral_device': fields.StringField(nullable=True),        'default_swap_device': fields.StringField(nullable=True),        'config_drive': fields.StringField(nullable=True),        'access_ip_v4': fields.IPV4AddressField(nullable=True),        'access_ip_v6': fields.IPV6AddressField(nullable=True),        'auto_disk_config': fields.BooleanField(default=False),        'progress': fields.IntegerField(nullable=True),        'shutdown_terminate': fields.BooleanField(default=False),        'disable_terminate': fields.BooleanField(default=False),        'cell_name': fields.StringField(nullable=True),        'metadata': fields.DictOfStringsField(),        'system_metadata': fields.DictOfNullableStringsField(),        'info_cache': fields.ObjectField('InstanceInfoCache',                                         nullable=True),        'security_groups': fields.ObjectField('SecurityGroupList'),        'fault': fields.ObjectField('InstanceFault', nullable=True),        'cleaned': fields.BooleanField(default=False),        'pci_devices': fields.ObjectField('PciDeviceList', nullable=True),        'numa_topology': fields.ObjectField('InstanceNUMATopology',                                            nullable=True),        'pci_requests': fields.ObjectField('InstancePCIRequests',                                           nullable=True),        'device_metadata': fields.ObjectField('InstanceDeviceMetadata',                                              nullable=True),        'tags': fields.ObjectField('TagList'),        'flavor': fields.ObjectField('Flavor'),        'old_flavor': fields.ObjectField('Flavor', nullable=True),        'new_flavor': fields.ObjectField('Flavor', nullable=True),        'vcpu_model': fields.ObjectField('VirtCPUModel', nullable=True),        'ec2_ids': fields.ObjectField('EC2Ids'),        'migration_context': fields.ObjectField('MigrationContext',                                                nullable=True),        'keypairs': fields.ObjectField('KeyPairList'),        }...
  • objects/flavor.py 模板规格

...class Flavor(base.NovaPersistentObject, base.NovaObject,             base.NovaObjectDictCompat):...    fields = {        'id': fields.IntegerField(),        'name': fields.StringField(nullable=True),        'memory_mb': fields.IntegerField(),        'vcpus': fields.IntegerField(),        'root_gb': fields.IntegerField(),        'ephemeral_gb': fields.IntegerField(),        'flavorid': fields.StringField(),        'swap': fields.IntegerField(),        'rxtx_factor': fields.FloatField(nullable=True, default=1.0),        'vcpu_weight': fields.IntegerField(nullable=True),        'disabled': fields.BooleanField(),        'is_public': fields.BooleanField(),        'extra_specs': fields.DictOfStringsField(),        'projects': fields.ListOfStringsField(),        }...

实现一个简单的过滤器

过滤器基类

  • filters.py BaseFilter为供外部调用的基类。

class BaseFilter(object):    """Base class for all filter classes."""    def _filter_one(self, obj, spec_obj):        """Return True if it passes the filter, False otherwise.        Override this in a subclass.        """        return True    def filter_all(self, filter_obj_list, spec_obj):        """Yield objects that pass the filter.        Can be overridden in a subclass, if you need to base filtering        decisions on all objects.  Otherwise, one can just override        _filter_one() to filter a single object.        """        for obj in filter_obj_list:            if self._filter_one(obj, spec_obj):                yield obj    # Set to true in a subclass if a filter only needs to be run once    # for each request rather than for each instance    run_filter_once_per_request = False    def run_filter_for_index(self, index):        """Return True if the filter needs to be run for the "index-th"        instance in a request.  Only need to override this if a filter        needs anything other than "first only" or "all" behaviour.        """        if self.run_filter_once_per_request and index > 0:            return False        else:            return True
  • scheduler/filters/init.py BaseHostFilter是过滤器需要派生的基类,重载了_filter_one方法,所有的子类都需要重载host_passes方法来判断节点是否通过过滤。

class BaseHostFilter(filters.BaseFilter):    """Base class for host filters."""    def _filter_one(self, obj, filter_properties):        """Return True if the object passes the filter, otherwise False."""        return self.host_passes(obj, filter_properties)    def host_passes(self, host_state, filter_properties):        """Return True if the HostState passes the filter, otherwise False.        Override this in a subclass.        """        raise NotImplementedError()

过滤器的编写

这个过滤器只是简单的打印参数和状态信息,以及请求规格到日志。

  • 编写过滤器dump_filter:

$ vi /usr/lib/python2.7/dist-packages/nova/scheduler/filters/dump_filter.py
from oslo_log import log as loggingfrom nova.i18n import _LIfrom nova.scheduler import filtersLOG = logging.getLogger(__name__)class DumpFilter(filters.BaseHostFilter):    def host_passes(self, host_state, spec_obj):                LOG.info(_LI("------ Dump Filter ------"))                LOG.info(_LI(" ** Host Status **"))                LOG.info(_LI("host                  %s"), host_state.host)        LOG.info(_LI("nodename              %s"), host_state.nodename)                LOG.info(_LI("total_usable_ram_mb   %s"), host_state.total_usable_ram_mb)        LOG.info(_LI("total_usable_disk_gb  %s"), host_state.total_usable_disk_gb)        LOG.info(_LI("disk_mb_used          %s"), host_state.disk_mb_used)        LOG.info(_LI("free_ram_mb           %s"), host_state.free_ram_mb)        LOG.info(_LI("free_disk_mb          %s"), host_state.free_disk_mb)        LOG.info(_LI("vcpus_total           %s"), host_state.vcpus_total)        LOG.info(_LI("vcpus_used            %s"), host_state.vcpus_used)        LOG.info(_LI("pci_stats             %s"), host_state.pci_stats)        LOG.info(_LI("numa_topology         %s"), host_state.numa_topology)                LOG.info(_LI("num_instances         %s"), host_state.num_instances)        LOG.info(_LI("num_io_ops            %s"), host_state.num_io_ops)                LOG.info(_LI("host_ip               %s"), host_state.host_ip)        LOG.info(_LI("hypervisor_type       %s"), host_state.hypervisor_type)        LOG.info(_LI("hypervisor_version    %s"), host_state.hypervisor_version)        LOG.info(_LI("hypervisor_hostname   %s"), host_state.hypervisor_hostname)        LOG.info(_LI("cpu_info              %s"), host_state.cpu_info)        LOG.info(_LI("supported_instances   %s"), host_state.supported_instances)                LOG.info(_LI("limits                %s"), host_state.limits)        LOG.info(_LI("metrics               %s"), host_state.metrics)        LOG.info(_LI("aggregates            %s"), host_state.aggregates)        LOG.info(_LI("instances             %s"), host_state.instances)                LOG.info(_LI("ram_allocation_ratio  %s"), host_state.ram_allocation_ratio)        LOG.info(_LI("cpu_allocation_ratio  %s"), host_state.cpu_allocation_ratio)        LOG.info(_LI("disk_allocation_ratio %s"), host_state.disk_allocation_ratio)        LOG.info(_LI("updated %s"), host_state.updated)                LOG.info(_LI(" ** Request Spect **"))                LOG.info(_LI("memory_mb            %s"), spec_obj.memory_mb)        LOG.info(_LI("vcpus                %s"), spec_obj.vcpus)              return True
  • 生成pyc文件:

$ pythonPython 2.7.12 (default, Dec  4 2017, 14:50:18) [GCC 5.4.0 20160609] on linux2Type "help", "copyright", "credits" or "license" for more information.>>> import py_compile>>> py_compile.compile("/usr/lib/python2.7/dist-packages/nova/scheduler/filters/dump_filter.py")
  • 修改默认过滤器列表和日志等级:

$ vi /etc/nova/logging.conf[DEFAULT]...scheduler_default_filters = RetryFilter, DumpFilter, AvailabilityZoneFilter, RamFilter, DiskFilter, ComputeFilter, ComputeCapabilitiesFilter, ImagePropertiesFilter, ServerGroupAntiAffinityFilter, ServerGroupAffinityFilter...[logger_root]level = DEBUGhandlers = null[logger_nova]level = DEBUGhandlers = stderrqualname = nova...
  • 停止原有nova-scheduler后台系统服务,并在控制台手动启动nova-scheduler服务:

$ systemctl stop nova-scheduler$ /usr/bin/python /usr/bin/nova-scheduler --config-file=/etc/nova/nova.conf
  • 创建、删除一个虚拟机:

$ . demo-openrc$ openstack server create --flavor m1.nano --image cirros \        --nic net-id=eb2f08c3-dbc4-423e-8206-6b0fb07d94b7 \        --security-group default --key-name mykey test1$ openstack server delete test1
  • 查看nova-scheduler服务输出:

...2017-12-14 10:43:15.670 77206 WARNING oslo_reports.guru_meditation_report [-] Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.2017-12-14 10:43:16.265 77206 INFO nova.service [-] Starting scheduler node (version 14.0.1)2017-12-14 10:43:24.264 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] ------ Dump Filter ------2017-12-14 10:43:24.265 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -]  ** Host Status **2017-12-14 10:43:24.266 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] host                  UbuntuStack2017-12-14 10:43:24.266 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] nodename              ubuntustack2017-12-14 10:43:24.267 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] total_usable_ram_mb   39342017-12-14 10:43:24.267 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] total_usable_disk_gb  182017-12-14 10:43:24.268 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] disk_mb_used          20482017-12-14 10:43:24.273 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] free_ram_mb           32942017-12-14 10:43:24.274 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] free_disk_mb          71682017-12-14 10:43:24.274 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] vcpus_total           22017-12-14 10:43:24.275 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] vcpus_used            22017-12-14 10:43:24.275 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] pci_stats             2017-12-14 10:43:24.276 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] numa_topology         {"nova_object.version": "1.2", "nova_object.changes": ["cells"], "nova_object.name": "NUMATopology", "nova_object.data": {"cells": [{"nova_object.version": "1.2", "nova_object.changes": ["cpu_usage", "memory_usage", "cpuset", "pinned_cpus", "siblings", "memory", "mempages", "id"], "nova_object.name": "NUMACell", "nova_object.data": {"cpu_usage": 0, "memory_usage": 0, "cpuset": [0, 1], "pinned_cpus": [], "siblings": [], "memory": 3934, "mempages": [{"nova_object.version": "1.1", "nova_object.changes": ["total", "reserved", "size_kb", "used"], "nova_object.name": "NUMAPagesTopology", "nova_object.data": {"used": 0, "total": 1007177, "reserved": 0, "size_kb": 4}, "nova_object.namespace": "nova"}, {"nova_object.version": "1.1", "nova_object.changes": ["total", "reserved", "size_kb", "used"], "nova_object.name": "NUMAPagesTopology", "nova_object.data": {"used": 0, "total": 0, "reserved": 0, "size_kb": 2048}, "nova_object.namespace": "nova"}, {"nova_object.version": "1.1", "nova_object.changes": ["total", "reserved", "size_kb", "used"], "nova_object.name": "NUMAPagesTopology", "nova_object.data": {"used": 0, "total": 0, "reserved": 0, "size_kb": 1048576}, "nova_object.namespace": "nova"}], "id": 0}, "nova_object.namespace": "nova"}]}, "nova_object.namespace": "nova"}2017-12-14 10:43:24.281 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] num_instances         22017-12-14 10:43:24.281 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] num_io_ops            02017-12-14 10:43:24.282 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] host_ip               192.168.195.1602017-12-14 10:43:24.283 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] hypervisor_type       QEMU2017-12-14 10:43:24.283 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] hypervisor_version    20050002017-12-14 10:43:24.283 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] hypervisor_hostname   ubuntustack2017-12-14 10:43:24.284 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] cpu_info              {"vendor": "Intel", "model": "Broadwell-noTSX", "arch": "x86_64", "features": ["smap", "avx", "clflush", "sep", "syscall", "vme", "invpcid", "tsc", "fsgsbase", "xsave", "pge", "erms", "cmov", "smep", "pcid", "pat", "lm", "msr", "adx", "3dnowprefetch", "nx", "fxsr", "sse4.1", "pae", "sse4.2", "pclmuldq", "fma", "tsc-deadline", "mmx", "osxsave", "cx8", "mce", "de", "rdtscp", "ht", "pse", "lahf_lm", "abm", "rdseed", "popcnt", "mca", "pdpe1gb", "apic", "sse", "f16c", "mpx", "invtsc", "pni", "aes", "avx2", "sse2", "ss", "hypervisor", "bmi1", "bmi2", "ssse3", "fpu", "cx16", "pse36", "mtrr", "movbe", "rdrand", "x2apic"], "topology": {"cores": 2, "cells": 1, "threads": 1, "sockets": 1}}2017-12-14 10:43:24.284 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] supported_instances   [[u'i686', u'qemu', u'hvm'], [u'x86_64', u'qemu', u'hvm']]2017-12-14 10:43:24.285 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] limits                {}2017-12-14 10:43:24.285 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] metrics               MonitorMetricList(objects=[])2017-12-14 10:43:24.286 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] aggregates            []2017-12-14 10:43:24.292 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] instances             {'aef838f5-8f9d-4ff2-8a34-17bd5ac05a8a': Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone=None,cell_name=None,cleaned=False,config_drive='',created_at=2016-11-29T09:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='selfservice-instance',display_name='selfservice-instance',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=,host='UbuntuStack',hostname='selfservice-instance',id=2,image_ref='e345e8b0-71b7-44e0-b1a1-e168f85a19f6',info_cache=,instance_type_id=1,kernel_id='',key_data='ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDb088fU8458jkAfgBuvCC6fEwlYjM2Chnj3CHKaepskuZ556KKNqyVuVKxc813gagh/bIFu/tN4WMC0DXqR5+v9Sx3IoK2m35LMUe0Lukuii4Ztny3pJp4/zs/lRtOfc9w+ykrocw2yyw14KqGwOkh7QEESr8/CChc5T7d5IqpUWYHObZ2hVr8Z6JxP7wBQKT8wLCiZ8DtSkpNxrIBdZGEO/RaBAa2H1Jumik01Lh/2iXEDsI+ohcnd2trH/k3D7HYhfb2Oz/Da2CQISHenTJVUBaX19I3Eass6VflVYP8msQsPPdQVE5oQsYaNbzblYaLNT79z04Miu4VjeNjTTvb root@UbuntuStack',key_name='mykey',keypairs=,launch_index=0,launched_at=2016-11-29T10:00:29Z,launched_on='UbuntuStack',locked=False,locked_by=None,memory_mb=64,metadata=,migration_context=,new_flavor=,node='ubuntustack',numa_topology=,old_flavor=,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='c7ddc0ecab64419486df0d7f66e8174c',ramdisk_id='',reservation_id='r-s86llflp',root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata=,tags=,task_state=None,terminated_at=None,updated_at=2017-12-06T14:51:10Z,user_data=None,user_id='ffff52bbf1da4c86a3d2b57e977f6b82',uuid=aef838f5-8f9d-4ff2-8a34-17bd5ac05a8a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='stopped'), 'f7279e6b-7c15-421f-8c81-033fc9f70e30': Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone=None,cell_name=None,cleaned=False,config_drive='',created_at=2017-12-06T15:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='test',display_name='test',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=,host='UbuntuStack',hostname='test',id=3,image_ref='e345e8b0-71b7-44e0-b1a1-e168f85a19f6',info_cache=,instance_type_id=1,kernel_id='',key_data='ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDb088fU8458jkAfgBuvCC6fEwlYjM2Chnj3CHKaepskuZ556KKNqyVuVKxc813gagh/bIFu/tN4WMC0DXqR5+v9Sx3IoK2m35LMUe0Lukuii4Ztny3pJp4/zs/lRtOfc9w+ykrocw2yyw14KqGwOkh7QEESr8/CChc5T7d5IqpUWYHObZ2hVr8Z6JxP7wBQKT8wLCiZ8DtSkpNxrIBdZGEO/RaBAa2H1Jumik01Lh/2iXEDsI+ohcnd2trH/k3D7HYhfb2Oz/Da2CQISHenTJVUBaX19I3Eass6VflVYP8msQsPPdQVE5oQsYaNbzblYaLNT79z04Miu4VjeNjTTvb root@UbuntuStack',key_name='mykey',keypairs=,launch_index=0,launched_at=2017-12-06T15:40:45Z,launched_on='UbuntuStack',locked=False,locked_by=None,memory_mb=64,metadata=,migration_context=,new_flavor=,node='ubuntustack',numa_topology=,old_flavor=,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='c7ddc0ecab64419486df0d7f66e8174c',ramdisk_id='',reservation_id='r-d00bhg7u',root_device_name='/dev/vda',root_gb=1,security_groups=,services=,shutdown_terminate=False,system_metadata=,tags=,task_state=None,terminated_at=None,updated_at=2017-12-13T06:50:48Z,user_data=None,user_id='ffff52bbf1da4c86a3d2b57e977f6b82',uuid=f7279e6b-7c15-421f-8c81-033fc9f70e30,vcpu_model=,vcpus=1,vm_mode=None,vm_state='stopped')}2017-12-14 10:43:24.293 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] ram_allocation_ratio  1.52017-12-14 10:43:24.294 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] cpu_allocation_ratio  16.02017-12-14 10:43:24.294 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] disk_allocation_ratio 1.02017-12-14 10:43:24.294 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] updated 2017-12-14 02:43:13+00:002017-12-14 10:43:24.295 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -]  ** Request Spect **2017-12-14 10:43:24.295 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] memory_mb            642017-12-14 10:43:24.296 77206 INFO nova.scheduler.filters.dump_filter [req-6a06ba1d-aeaf-41a8-a922-0402c0be3444 ffff52bbf1da4c86a3d2b57e977f6b82 c7ddc0ecab64419486df0d7f66e8174c - - -] vcpus                1...

关于"OpenStack Nova调度服务学习及其过滤器编写的示例分析"这篇文章就分享到这里了,希望以上内容可以对大家有一定的帮助,使各位可以学到更多知识,如果觉得文章不错,请把它分享出去让更多的人看到。

0