Another Nova spec update

I started chasing down the list of spec freeze exceptions that had been requested, and that resulted in the list of specs for Kilo being updated. That updated list is below, but I’ll do a separate post with the exception requests highlighted soon as well.

API

• Add more detailed network information to the metadata server: review 85673 (approved).
• Add separated policy rule for each v2.1 api: review 127863 (requested a spec exception).
• Add user limits to the limits API (as well as project limits): review 127094.
• Allow all printable characters in resource names: review 126696 (approved).
• Consolidate all console access APIs into one: review 141065 (approved).
• Expose the lock status of an instance as a queryable item: review 127139 (abandoned); review 85928 (approved).
• Extend api to allow specifying vnic_type: review 138808 (requested a spec exception).
• Implement instance tagging: review 127281 (fast tracked, approved).
• Implement the v2.1 API: review 126452 (fast tracked, approved).
• Improve the return codes for the instance lock APIs: review 135506.
• Microversion support: review 127127 (approved).
• Move policy validation to just the API layer: review 127160 (approved).
• Nova Server Count API Extension: review 134279 (fast tracked).
• Provide a policy statement on the goals of our API policies: review 128560 (abandoned).
• Sorting enhancements: review 131868 (fast tracked, approved, implemented).
• Support JSON-Home for API extension discovery: review 130715 (requested a spec exception).
• Support X509 keypairs: review 105034 (approved).

API (EC2)

• Expand support for volume filtering in the EC2 API: review 104450.
• Implement tags for volumes and snapshots with the EC2 API: review 126553 (fast tracked, approved).

Administrative

• Actively hunt for orphan instances and remove them: review 137996 (abandoned); review 138627.
• Add totalSecurityGroupRulesUsed to the quota limits: review 145689.
• Check that a service isn’t running before deleting it: review 131633.
• Enable the nova metadata cache to be a shared resource to improve the hit rate: review 126705 (abandoned).
• Implement a daemon version of rootwrap: review 105404 (requested a spec exception).
• Log request id mappings: review 132819 (fast tracked).
• Monitor the health of hypervisor hosts: review 137768.
• Remove the assumption that there is a single endpoint for services that nova talks to: review 132623.

Block Storage

• Allow direct access to LVM volumes if supported by Cinder: review 127318.
• Cache data from volumes on local disk: review 138292 (abandoned); review 138619.
• Enhance iSCSI volume multipath support: review 134299 (requested a spec exception).
• Failover to alternative iSCSI portals on login failure: review 137468 (requested a spec exception).
• Give additional info in BDM when source type is “blank”: review 140133.
• Implement support for a DRBD driver for Cinder block device access: review 134153 (requested a spec exception).
• Poll volume status: review 142828 (abandoned).
• Refactor ISCSIDriver to support other iSCSI transports besides TCP: review 130721 (approved).
• StorPool volume attachment support: review 115716 (approved, requested a spec exception).
• Support Cinder Volume Multi-attach: review 139580 (approved).
• Support iSCSI live migration for different iSCSI target: review 132323 (approved).

Cells

• Cells Scheduling: review 141486.
• Create an instance mapping database: review 135644 (approved).
• Flexible cell selection: review 140031.
• Implement instance mapping: review 135424 (approved).
• Populate the instance mapping database: review 136490 (requested a spec exception).

Containers Service

• Initial specification: review 114044 (abandoned).

Database

• Develop and implement a profiler for SQL requests: review 142078 (abandoned).
• Enforce instance uuid uniqueness in the SQL database: review 128097 (fast tracked, approved, implemented).
• Nova db purge utility: review 132656.
• Online schema change options: review 102545 (approved).
• Support DB2 as a SQL database: review 141097 (fast tracked, approved).
• Validate database migrations and model’: review 134984 (approved).

Hypervisor: Docker

• Migrate the Docker Driver into Nova: review 128753.

Hypervisor: FreeBSD

• Implement support for FreeBSD networking in nova-network: review 127827.

Hypervisor: Hyper-V

• Allow volumes to be stored on SMB shares instead of just iSCSI: review 102190 (approved, implemented).
• Instance hot resize: review 141219.

Hypervisor: Ironic

• Add config drive support: review 98930 (approved).
• Pass through flavor capabilities to ironic: review 136104 (approved).

Hypervisor: VMWare

• Add ephemeral disk support to the VMware driver: review 126527 (fast tracked, approved).
• Add support for the HTML5 console: review 127283 (requested a spec exception).
• Allow Nova to access a VMWare image store over NFS: review 126866.
• Enable administrators and tenants to take advantage of backend storage policies: review 126547 (fast tracked, approved).
• Enable the mapping of raw cinder devices to instances: review 128697.
• Implement vSAN support: review 128600 (fast tracked, approved).
• Support multiple disks inside a single OVA file: review 128691.
• Support the OVA image format: review 127054 (fast tracked, approved).

Hypervisor: libvirt

• Add Quobyte USP support: review 138372 (abandoned); review 138373 (approved).
• Add VIF_VHOSTUSER vif type: review 138736 (approved).
• Add a Quobyte Volume Driver: review 138375 (abandoned).
• Add finetunable configuration settings for virtio-scsi: review 103797 (abandoned).
• Add large page support: review 129608 (approved).
• Add support for SMBFS as a image storage backend: review 103203 (approved, implemented).
• Allow scheduling of instances such that PCI passthrough devices are co-located on the same NUMA node as other instance resources: review 128344 (fast tracked, approved).
• Allow specification of the device boot order for instances: review 133254.
• Allow the administrator to explicitly set the version of the qemu emulator to use: review 138731 (abandoned).
• Consider PCI offload capabilities when scheduling instances: review 135331.
• Convert to using built in libvirt disk copy mechanisms for cold migrations on non-shared storage: review 126979 (fast tracked).
• Derive hardware policy from libosinfo: review 133945 (approved).
• Implement COW volumes via VMThunder to allow fast boot of large numbers of instances: review 128810 (abandoned); review 128813 (abandoned); review 128830 (abandoned); review 128845 (abandoned); review 129093 (abandoned); review 129108 (abandoned); review 129110 (abandoned); review 129113 (abandoned); review 129116; review 137617.
• Implement configurable policy over where virtual CPUs should be placed on physical CPUs: review 129606 (approved).
• Implement support for Parallels Cloud Server: review 111335 (approved); review 128990 (abandoned).
• Implement support for zkvm as a libvirt hypervisor: review 130447 (approved).
• Improve total network throughput by supporting virtio-net multiqueue: review 128825 (requested a spec exception).
• Improvements to the cinder integration for snapshots: review 134517.
• Quiesce instance disks during snapshot: review 128112; review 131587 (abandoned); review 131597.
• Real time instances: review 139688.
• Stop dm-crypt device when an encrypted instance is suspended or stopped: review 140847 (approved).
• Support SR-IOV interface attach and detach: review 139910 (requested a spec exception).
• Support StorPool as a storage backend: review 137830.
• Support for live block device IO tuning: review 136704.
• Support libvirt storage pools: review 126978 (fast tracked, approved).
• Support live migration with macvtap SR-IOV: review 136077.
• Support quiesce filesystems during snapshot: review 126966 (fast tracked, approved).
• Support using qemu’s built in iSCSI initiator: review 133048 (approved).
• Volume driver for Huawei SDSHypervisor: review 130919.

Instance features

• Allow portions of an instance’s uuid to be configurable: review 130451.
• Allow the resize of ephemeral disks during resize: review 145736.
• Attempt to schedule cinder volumes “close” to instances: review 130851; review 131050 (abandoned); review 131051 (abandoned); review 131151 (abandoned).
• Dynamic server groups: review 130005 (abandoned).
• Improve the performance of unshelve for those using shared storage for instance disks: review 135387 (requested a spec exception).

Internal

• A lock-free quota implementation: review 135296 (approved).
• Automate the documentation of the virtual machine state transition graph: review 94835.
• Fake Libvirt driver for simulating HW testing: review 139927 (abandoned).
• Flatten Aggregate Metadata in the DB: review 134573 (abandoned).
• Flatten Instance Metadata in the DB: review 134945 (abandoned).
• Implement a new code coverage API extension: review 130855.
• Move flavor data out of the system_metadata table in the SQL database: review 126620 (approved).
• Move to polling for cinder operations: review 135367.
• PCI test cases for third party CI: review 141270.
• Transition Nova to using the Glance v2 API: review 84887 (abandoned).
• Transition to using glanceclient instead of our own home grown wrapper: review 133485 (approved).

Internationalization

• Enable lazy translations of strings: review 126717 (fast tracked, approved).

Networking

• Add a new linuxbridge VIF type, macvtap: review 117465 (abandoned).
• Add a plugin mechanism for VIF drivers: review 136827 (abandoned).
• Add support for InfiniBand SR-IOV VIF Driver: review 131729 (requested a spec exception).
• Neutron DNS Using Nova Hostname: review 90150 (abandoned).
• New VIF type to allow routing VM data instead of bridging it: review 130732 (approved, requested a spec exception).
• Nova Plugin for OpenContrail: review 126446 (approved).
• Refactor of the Neutron network adapter to be more maintainable: review 131413.
• Use the Nova hostname in Neutron DNS: review 137669.
• Wrap the Python NeutronClient: review 141108.

Performance

• Dynamically alter the interval nova polls components at based on load and expected time for an operation to complete: review 122705.

Scheduler

• A nested quota driver API: review 129420.
• Add a filter to take into account hypervisor type and version when scheduling: review 137714.
• Add an IOPS weigher: review 127123 (approved, implemented); review 132614.
• Add instance count on the hypervisor as a weight: review 127871 (abandoned).
• Add soft affinity support for server group: review 140017 (approved).
• Allow extra spec to match all values in a list by adding the ALL-IN operator: review 138698 (fast tracked, approved).
• Allow limiting the flavors that can be scheduled on certain host aggregates: review 122530 (abandoned).
• Allow the remove of servers from server groups: review 136487.
• Cache aggregate metadata: review 141846.
• Convert get_available_resources to use an object instead of dict: review 133728 (abandoned).
• Convert the resource tracker to objects: review 128964 (fast tracked, approved).
• Create an object model to represent a request to boot an instance: review 127610 (approved).
• Decouple services and compute nodes in the SQL database: review 126895 (approved).
• Distribute PCI Requests Across Multiple Devices: review 142094.
• Enable adding new scheduler hints to already booted instances: review 134746.
• Fix the race conditions when migration with server-group: review 135527 (abandoned).
• Implement resource objects in the resource tracker: review 127609 (approved, requested a spec exception).
• Improve the ComputeCapabilities filter: review 133534 (requested a spec exception).
• Isolate Scheduler DB for Filters: review 138444 (requested a spec exception).
• Isolate the scheduler’s use of the Nova SQL database: review 89893 (approved).
• Let schedulers reuse filter and weigher objects: review 134506 (abandoned).
• Move select_destinations() to using a request object: review 127612 (approved).
• Persist scheduler hints: review 88983.
• Refactor allocate_for_instance: review 141129.
• Stop direct lookup for host aggregates in the Nova database: review 132065 (abandoned).
• Stop direct lookup for instance groups in the Nova database: review 131553 (abandoned).
• Support scheduling based on more image properties: review 138937.
• Trusted computing support: review 133106.

Scheduling

• Dynamic Management of Server Groups: review 139272.

Security

• Make key manager interface interoperable with Barbican: review 140144 (fast tracked, approved).
• Provide a reference implementation for console proxies that uses TLS: review 126958 (fast tracked, approved).
• Strongly validate the tenant and user for quota consuming requests with keystone: review 92507 (approved).

Service Groups

• Pacemaker service group driver: review 139991.
• Transition service groups to using the new oslo Tooz library: review 138607.