VMmanager roadmap

Bug fixes:

• Fixed an error in adding VxLAN on cluster nodes running CentOS 7.
• Fixed an error that occurred when trying to configure intergration with messengers.
• Fixed links to VxLAN documentation.

New features:

• Added the ability to enable virtual networks in Route Reflector mode on clusters with KVM virtualization and "Switching" network configuration type.
• Added the ability to enable virtual networks in Route Reflector mode on clusters with KVM virtualization and "IP-Fabric" network configuration type.
• Added the ability to change main storage on cluster from the platform interface.
• A notification about license issues has been added.
• Added check of server resources when installing the platform.

Bug fixes:

• Fixed an error in adding VxLAN interface for Debian 11 and Ubuntu 20.04.
• Fixed an error in adding a bridge with IP address transfer.
• Fixed an error in creating a VLAN interface for bond.
• Fixed errors that could occur when adding a node running Ubuntu 20.04 to a cluster with LXD virtualization.

New features:

• Support for Access Control Lists (ACLs) from the platform interface was implemented.
• A form for copying schedules has been added.
• Added format for displaying the list of virtual networks by users in the cluster card.
• Added format for displaying the list of virtual networks by nodes in the cluster card.

Bug fixes:

• Fixed the error due to which the "run script" task did not wait for the guest-agent to start.
• Fixed the error with display of cluster resources.
• Fixed the error preventing removal of an IP range from a virtual network.
• Fixed the error due to which an unprivileged user could allocate IP addresses in a cluster with the "Routing" network type.
• When creating a new network storage, the storage validation with already existing parameters has been added.

Bug fixes:

• Fixed sorting and filtering in lists of IP addresses, IP pools and networks.
• Fixed an error in running scripts on a cluster node.
• Fixed the error in allocation of permissions for "Advanced user" level accounts.
• Fixed the error of forming the list of clusters available for creating virtual networks with "User" level account.

Bug fixes:

• Fixed a security error.

New features:

• Added the ability to create isolated software-defined networks for the user.
• Added the ability to enable virtual networks in Full mesh mode on clusters with KVM virtualization and "Switching" network configuration type.
• It is now possible to add IP addresses from virtual networks to VMs.

Bug fixes:

• Fixed the "Duplicate entry" error, which appeared from time to time when entering from billing systems.
• Fixed the error of creating a backup for a disabled VM with a disk in LVM storage.

New features:

• Added the ability to edit fine settings of a VM without rebooting.
• It is now possible to add and delete IP addresses without rebooting for VMs on cluster nodes with CentOS 8.

Bug fixes:

• Fixed the error which caused incorrect network traffic values for the cluster node to be displayed on the dashboard.
• Confirmation windows now close at the click outside the window.
• Fixed the error due to which the platform's web interface was inaccessible to web browsers released before June 2020.
• Fixed the operation of modal windows for VM selection in a high-availability cluster and creation of backup schedule for clusters with more than 5000 VMs.
• Fixed the problem in firewall configuration for bridges created manually on cluster nodes with CentOS 7.

Bug fixes:

• Fixed erroneous message about insufficient RAM in high-availability cluster.
• Fixed the problem with LXD mounting points freezing.
• Fixed the error that caused a wrong netmask to be stored in the bridge configuration.
• Fixed the error that made it impossible to save the network configuration without specifying a default bridge.

New features:

• Added the possibility to specify the VM disk partition to be enlarged.
• Added the ability to view 100 and 250 rows in the VM table.

Bug fixes:

• Fixed the error that could cause backups for VMs with a disk in LVM storage to be created incorrectly.
• Fixed the error that caused the dashboard not to update the list of the most loaded VMs.
• Migration cancellation is now also available from the VM list and from the VM task queue.
• Fixed the error that caused VMs not to start automatically after restarting all nodes in a HA cluster.

New features:

• The length of generated passwords has been increased to 12 characters.
• Added the ability to change the resources of VMs installed from ISO images.

Bug fixes:

• Fixed the error that made it impossible to create a VM in a cluster with two interfaces if one of the interfaces did not have a pool with free IP addresses.
• Fixed the error of incorrect autofilling of fields on the VM configuration change form.
• Fixed synchronization errors that could cause incorrect data to be displayed in the list of interfaces on a cluster node.
• Fixed errors that occurred when trying to delete a bridge.
• Fixed errors that could occur when creating a bridge.
• Fixed HA cluster stability issues that occurred if one of the Ceph monitors failed.

New features:

• Implemented the ability to select the model for adding IP addresses to VMs.
• Reworked the self-diagnostic widget on the dashboard: added information about system partitions.
• Added the ability to install and operate the platform through a proxy server.
• Added the ability to enable nested containerization for LXD containers.
• Added the ability to create images and backups of VMs in Ceph network storage.
• Added the ability to abort a VM migration from the platform interface.
• Increased the number of simultaneous VM migrations.
• Added graphical display of the network layout on the cluster node.

Bug fixes:

• Fixed the error of connecting to port 16514/TCP when configuring a cluster node.
• On the VM creation form, the display of the amount of actual free space in the storage was added.
• Fixed the error of adding node to cluster with two network interfaces.
• Fixed creation of a VM with a disk in the SAN network storage for cluster nodes with CentOS 8.4.
• Fixed the error that could cause scripts to terminate incorrectly.

New features:

• Added support for Rocky Linux, Oracle Linux, Alma Linux guest operating systems.
• Added the ability to automatically send emails with the results of the script execution.
• Added the "do not configure network automatically" option when adding a node.
• Added the ability to create email templates for scripts.
• Added the ability to export variables and files from the script to an email with execution results.

Bug fixes:

• Fixed the error in the request for a group migration of VMs.
• Fixed the mechanism of recovery from backup for LXD containers.
• Fixed the error that could cause the VNC console to freeze in the browser.
• Disabled support for obsolete versions of TLS 1.0 and 1.1 for nginx. Versions 1.2 and 1.3 are now supported by default.

New features:

• Added the ability to flexibly configure the network on the cluster nodes.
• Added the ability to create bridges and bonds from the platform interface.
• Added the ability to select the VLAN tag for the bridge created.
• Added the ability to add and delete network interfaces on a VM from the platform interface.
• Added the option to select the network interface of a VM when adding an IP address.
• Added the ability to use logical operators and wildcard in filters.

Bug fixes:

• Fixed the error that could occur during live migration of a VM with a disk to an LVM storage.
• Fixed the error that could occur when connecting a node with Ubuntu OS and netplan network configuration.
• Fixed the error that could occur when restoring an LXD container from a backup.

Bug fixes:

• Fixed an error which could occur when resizing a VM disk.

Bug fixes:

• Fixed the error in recreating a VM on nodes with CentOS 8.4 OS and LVM storage.
• Fixed a backup deletion error after an unsuccessful transfer to external storage.
• Fixed the error that made the advanced filter in the lists of VMs and tasks unavailable.
• Fixed saving settings of tables for different users within one session in the browser.
• Fixed cloning of VMs with disks in Ceph network storage.
• Added lvmetad cache update for SAN storage.

New features:

• Added the ability to install the platform on a server with Ubuntu 20.04.
• Added the ability to use the platform server with Ubuntu 20.04 OS as an LXD cluster node.
• Added the possibility to use parameterized scripts from ISPsystem repository.
• Added the ability to integrate with Zabbix and Nagios monitoring systems using parameterized scripts.
• Added support for CentOS 7 OS for ubreakable cluster nodes.
• A search option has been added to the launch form of the script.
• Changed the display of empty lists for clusters and cluster nodes.

Bug fixes:

• Fixed the error of getting monitoring data from imported VMs.
• Increased timeout time for the IPmanager service.
• Fixed display of the number of objects for a group operation in the lists of standard and unbreakable cluster nodes.
• Fixed the error that always blocked launching scripts in the cluster node menu on the dashboard.

Bug fixes:

• Fixed the error with duplication of nftables configuration entries on cluster nodes with Centos 8 and Ubuntu 20.04.
• Fixed the error that occurred during additional configuration of cluster node.
• Fixed errors in the operation of backup scheduler.

New features:

• Added the ability to not occupy service IP addresses in networks for IP-Fabric clusters.
• Added the ability to connect nodes with Ubuntu 20.04 OS and the network configuration configured in Netplan to the LXD cluster.
• Added the ability to configure disk space overselling on cluster nodes for file and ZFS storages.
• A section with information about storages was added to the cluster node card.
• Added columns to the storage table on the cluster card.

Bug fixes:

• Fixed errors in the statistics collection service.

New features:

• Support for operating systems with an EFI loader was implemented.
• Implemented the ability to change the password on a Windows VM.
• Support for PowerShell scripts and launching scripts on a Windows VM has been implemented.
• Added OS, uptime, RAM, CPU and storage usage fields to the compact view of the node table.
• Redesigned the cluster widget interface on the dashboard.
• Added the ability to run multiple scripts on a VM.
• Added the ability to select multiple start scripts when creating or reinstalling a VM.

Bug fixes:

• Validation of the user's email address has been corrected according to RFC 5322.
• Fixed the error that appeared when selecting nodes on the dashboard.
• Fixed the error that appeared when switching between the tabs of primary and secondary VM IP addresses.

Bug fixes:

• Fixed a Service discovery error that could lead to problems with authorization in the platform.

New features:

• Support for Access Control Lists (ACLs) at API level was implemented.

Bug fixes:

• Fixed the error due to which in some cases an invalid default route was added in a cluster with two interfaces on a VM with Debian-based OS.
• Fixed CPU core counting for AMD Ryzen 3000 series.
• Fixed the error that could occur when migrating a VM to a cluster node with a non-standard SSH port.

Bug fixes:

• Fixed an error in additional node configuration in LXD cluster.

New features:

• Added the ability to ignore internal data center traffic in clusters with IP fabric network configuration type.
• Added compact mode for tables of clusters, nodes, tasks, pools, physical networks, and IP addresses in physical network card.
• Implemented the fault tolerance connection error display.

Bug fixes:

• Fixed the display of error message in case of failure when resizing a Windows VM disk.
• Fixed the error which could cause VM traffic statistics to have an understated value.
• Fixed errors in the notification service.
• Node IDs have been added to the monitoring data on the dashboard.
• Multiple selection is now available in the cluster filter in the node and VM tables.
• Fixed the error in displaying the pool selection field in the network settings on the cluster node card.
• Fixed the error that caused the VM disk in the file storage to grow to its maximum size during live migration.
• Fixed the error that caused nftables settings to reset on nodes with CentOS 8.
• Fixed the display of Ceph error message when creating RBD pool.
• Fixed the error in creating a backup of a VM with encrypted disk partitions.

New features:

• Added the ability to activate high availability mode for a cluster with CEPH network storage.
• Added the ability to activate high availability mode for a cluster with SAN network storage.
• Added the option to hide the contents of scripts for VMs.
• Node widget on the dashboard was redesigned.
• Added the ability to create preset values of script parameters for VMs.

Bug fixes:

• Fixed the error in adding and removing IP addresses for an LXD container.
• Fixed the error that occurred when working with the variable for SSHPUBKEYS scripts.
• Fixed an error in the variable for PASS scripts. When reinstalling a VM, the variable had an empty value.
• Now the variable for scripts PASS_CRYPT has an empty value if the password is unknown.
• Fixed the error that caused background tasks to freeze.

New features:

• New options for working with tables were added: go to a specific page, display and hide columns, change column width. In the tables for VMs, IP addresses, and scripts, the option to enable compact view is now available.
• Added the option to migrate and copy images.
• Added the list of backups to the disk space page.
• Added anti-spoofing of MAC addresses in LXD cluster.

Bug fixes:

• Fixed errors in VM status display.
• Fixed display of disabled storages.
• Fixed the error that occurred when migrating a VM from a CentOS 7 node to a CentOS 8 node.

Bug fixes:

• Fixed the error due to which the VM disk size changed after reinstalling Windows OS

New features:

• Added the new SAN storage type for KVM clusters.

Bug fixes:

• Fixed the errror in LXD container network configuration in a cluster with IP fabric network configuration, which occurred when using new versions of LXD software packets.
• Stability of platform backups was increased.
• Stability of statistics collection was increased.
• Timeout for installing and updating software packets when connecting cluster nodes was increased.

Bug fixes:

• Fixed the error in calculation of the number of cores for AMD Zen CPUs.

Bug fixes:

• Fixed the error in adding IP addresses to VMs with Windows OS and VMs installed from ISO images.
• Fixed the error in following the link to the pages of copying and editing node scripts.

New features:

• Information about the location of the backup has been added to the list of backups.
• Added support for Astra Linux "Orel" as a guest OS for VMs.
• Added support for FreeBSD as a guest OS for VMs.
• Editor with code highlighting is now used when creating scripts for a cluster node.

Bug fixes:

• Fixed the error because of which the used resources displayed in monitoring could be greater than available.
• Now when integrating with PowerDNS, the platform creates root NS records for all existing networks.
• Fixed the problem with connecting to LXD container via SSH using login and password.
• Fixed the error in calculation of available storage space when creating a VM.

New features:

• Added the ability to enable ZFS storage overselling for LXD cluster.

Bug fixes:

• Fixed synchronization of virtual machine statuses in LXD clusters.

New features:

• Added the possibility to specify parameters for scripts.
• When creating a virtual machine, the ability to select the node has been added.

Bug fixes:

• LXD version has been updated to 4.11.
• Fixed the error that occurred when creating virtual machines without an operating system.
• Fixed the error of adding a node to an LXD cluster with the "Switching" network configuration.
• Fixed filtering and sorting the list of nodes by storages.
• Fixed an error in monitoring of RAM usage for virtual machines.
• Fixed the error that sometimes made a user have to re-authenticate.
• Podman software is now uninstalled during the platform installation on a CentOS 8 server.
• SElinux service is now disabled during the installation of the platform.
• Increased the timeout for creating a platform backup.
• Now, when creating a virtual machine, the disk overselling settings are taken into account correctly.
• The minimum length of the script name has been reduced to one character.

New features:

• Added the ability to create LXD clusters with "Switching" network configuration.
• Added the ability to connect backup storages to LXD clusters.
• Added the ability to connect a cluster node with the main VLAN interface.

Bug fixes:

• Fixed the error that caused network routes to not load on cluster nodes with the "Routing" network configuration.
• Fixed the error when after deleting a user it was impossible to recreate it.
• In the list of physical networks, spaces between the network address and the netmask were removed

Bug fixes:

• Fixed the error that caused irrelevant virtual machine statuses to be displayed.

Bug fixes:

• Fixed the error in connection of the cluster node with CentOS 7 OS.

New features:

• Added the ability to customize variables for scripts.
• Added the ability to interrupt scripts execution.
• Added adjustable timeout for script execution.
• Added displaying of disk space overselling coefficient for a storage.
• Added displaying storage ID.
• Extended the script editor functionality.

Bug fixes:

• Incorrect displaying of virtual machine status during operating system installation has been fixed.

New features:

• Added the possibility to install the platform using HTTP proxy.

Bug fixes:

• Now the platform cannot be restarted during update.
• Fixed the error of platform installation which occurred at the stage of "Waiting panel up".
• Fixed display of platform locking screen during the update.
• Fixed the error that caused emergency shutdown of the node tracking service, if files with spaces in names were present in the directories with VMs.

New features:

• Added the possibility to connect KVM and LXD repositories of OS templates for VMs.
• Added the possibility to configure DNS servers for VMs in a cluster.

Bug fixes:

• Increased the timeout when creating a platform backup.
• Now the LXD console uses bash shell, top command can now be launched in the console.
• Fixed the error of VM network statistics calculation.
• Added the limit on the string length in filters with text field.

New features:

• Ceph. Added the ability to select a previously created Ceph storage when connecting a Ceph storage to a cluster.
• Now filter parameters are saved for individual tabs.
• Added the possibility to create a user with the role @admin.readonly via API.
• Ceph. Added the ability to select an OSD pool when connecting a Ceph storage to a cluster.
• Ceph. Added user selection when connecting Ceph storage to the cluster.
• Ceph. Added the ability to specify the number of placement groups (PG) when connecting Ceph storage with the creation of a new OSD pool.
• Ceph. Added experimental support for Ceph v15 (Octopus) and cephadm-based installations.
• Added "Customer service" section in the platform settings. You can change phone number and email for contacting admin there.
• Added the ability to occupy subnets in the physical network card, pool and in the "IP addresses" section.

Bug fixes:

• Fixed the error in VNC setup after live VM migration.
• Fixed the error where in some cases the bond interface was not detected when connecting the cluster node.
• Fixed the error 5906 Storage not found when migrating between clusters.
• Fixed the error where nftables settings were reset after rebooting a cluster node with Ubuntu 20.04 OS.
• Fixed the error that occurred when adding an IP address on a VM with two network interfaces.
• Fixed the error which caused leaving a VM disk file on the receiving cluster node when a VM migration was cancelled.
• Now when you create a VM, the time zone set on the cluster is set on it.
• Fixed the error in collecting network usage statistics on VMs.
• Fixed the error of sessions hanging in the monitoring service.
• Fixed the error which prevented creating networks and pools after skipping initial platform setup.
• Fixed the error of displaying metrics of the most loaded VMs on the dashboard.

Bug fixes:

• Fixed the error that caused the main storage on the cluster node to be inactive after a platform update.

New features:

• Added the option to limit the number of VMs per cluster node.
• Added the possibility to use several storages in one cluster.

Bug fixes:

• Fixed antispoofing in LXD cluster.
• Fixed display of IPv6 prefix in IP fabric network settings.
• Fixed the error in connecting a cluster node with CentOS 8 without firewalld installed.
• Fixed the issue with CentOS 8.3 and libvirt 6.0.0 in a cluster with IP fabric configuration type.
• The error was fixed that caused networks to fail being added to bird settings when simultaneously creating multiple VMs in a cluster with the IP fabric configuration type.
• Fixed the error of hostname task for LXD containers.
• Fixed an error in setting the gateway for LXD containers.
• Fixed the error in bird configuration when connecting a node in a cluster with IP fabric configuration type.
• Live migration of VMs between nodes with different libvirt versions is forbidden.
• Fixed the error of tracking separate IP addresses for cluster nodes with "Routing" network configuration type.
• Fixed the error that could cause main menu items to swap places.
• Fixed an error, due to which the "Domain" field on the VM creation form could contain uppercase letters, which made it impossible to create a VM.

Bug fixes:

• Fixed the problem with adding a cluster node running on CentOS 8.

Bug fixes:

• Fixed non-working links to documentation.
• Fixed the error that in some cases caused failure to add networks to bird service.
• Fixed the error due to which transition to the platform from BILLmanager did not work, if the interface languages did not match.

Bug fixes:

• Fixed the error with display of tables in Safari web browser.
• Fixed the error that did not allow to define network settings of the cluster node running on CentOS.

New features:

• The design of the initial platform configuration form has been changed.

Bug fixes:

• Socket.timeout errors are prevented when running scripts on a VM.
• Fixed the error that did not allow adding a public SSH key to VM.
• Fixed the problem with connecting a cluster node running on CentOS, which occurred if the name of the network configuration file was different from the name of the network interface.
• Fixed generation of firewall rules for CentOS 8.

Bug fixes:

• Changed the logic of VNC server configuration, which was preventing migration of the VM.

Bug fixes:

• Fixed the error that did not allow initial configuration for the network type "Routing".
• Fixed the error that did not allow migration due to VNC server settings.
• Fixed the error that occurred when creating a backup of the platform.

New features:

• The LXD version has been updated to 4.8.
• Added the possibility to license the platform by the number of CPUs on the cluster nodes.

Bug fixes:

• Fixed disk extension for virtual machines with CentOS 7.

New features:

• Added the possibility to connect to LXD containers console via web interface.
• When creating or editing a cluster, the ability to allow users to change domain names has been added.
• Added the possibility to delete the operating system template from the cluster node.
• The cluster creation form has been redesigned: it is now created using the configuration wizard.
• Added a cluster card with general settings, storage information and a page with network configurations.
• Added the ability to create comments for BGP sessions in IP fabric.
• The design of monitoring schedules has been changed: the display of values has been improved.

Bug fixes:

• Redesigned network configuration for clusters with IP-fabric.
• Fixed the non-functioning button of the script launch on the cluster node card.
• Fixed the error of filtering operating systems by type (KVM, LXD).
• Stability of background tasks has been improved.

Bug fixes:

• Fixed the internal error of execution results processing for commands sent via SSH.

Bug fixes:

• Fixed the error that occurred during network configuration when connecting a node with CentOS 8 and two network interfaces.
• Fixed the error in nftables setting on nodes with CentOS 8.

Bug fixes:

• Fixed the error that occurred when checking free space on a cluster node during backup creation.
• Fixed the error in applying anti-spoofing settings and TCP connection limits on cluster nodes with CentOS 8.

New features:

• Added a new type of cluster with LXD virtualization using IP fabric network configuration type and ZFS storage.
• Added the ability to delete virtual machines, backups, and images in the disk space partition of the node.

Bug fixes:

• Fixed data loss when writing the backup to LVM storage.
• Fixed errors that occurred when configuring IPv6 for a cluster with IP fabric network type.

Bug fixes:

• Fixed the error of virtual machine creation in case of busy IPv6 network with prefix length up to /48.

Bug fixes:

• Fixed a wrong output of task result

New features:

• Added the filter by date in the history of IP addresses of the physical network.
• Added ability to delete non-empty IP pools and blocks of IP addresses.
• Added the DNSBL connection option to the network management module.

Bug fixes:

• Fixed the error that did not allow reinstalling the operating system on imported virtual machines.
• Fixed calculation of busy IPv6 networks in the list of IP pools.
• Fixed the bug that did not allow changing the password to VNC.
• Fixed the error of saving filters and sorting in IP address lists and history of IP addresses of the physical network.
• Fixed the error that required specifying the IPv6 address on mandatory basis when connecting a node to an IP-Fabric cluster.

Bug fixes:

• Cosmetic fixes in Network Management section.

Bug fixes:

• Fixed a bug with additional IP-addresses allocation through billing systems.
• Fixed a bug with cloning virtual machines created before IP-fabric release.

New features:

• Added display of busy IP addresses in the physical networks table.
• Added comments for physical networks.
• Added the ability to migrate turned off virtual machines without compression.
• Added the option to make ISPsystem scripts available only for administrators.
• The date of backup creation has been added to the backups table.
• Added the history of IP addresses.

Bug fixes:

• Fixed the error that made an unsuccessful password change on active VM considered successful.
• API: Fixed access error in manual user email confirmation.
• Fixed sorting of IP addresses in the networks section.
• Now PTR record changes regardless of IP address status.

Bug fixes:

• Fixed a bug with adding an iBGP session with an IPv6 address for an IP-Fabric network configuration.

New features:

• Utilization of CPU and traffic by the monitoring service has been significantly reduced.
• Added the ability to reserve an IP address from the interface.
• Added list of all reserved IP addresses in IPmanager.
• Added the ability to select a VM distribution policy in a cluster.

Bug fixes:

• Added automatic update of VNC ports after node reboot.
• Fixed a bug with checking the availability of SSH storage when editing the platform backup schedule.
• Added the ability to specify an IPv6 node address for an IP-Fabric cluster.

Bug fixes:

• Fixed a bug with the VM backup task queue.
• Fixed a bug with backing up the platform to remote SSH storage.

Bug fixes:

• Fixed a bug with VM cloning in IP-Fabric cluster.
• Fixed a bug with IPv6 announcement in IP-Fabric cluster.

Bug fixes:

• Fixed a bug in additional node configuration task.
• Fixed a bug occured when creating VM with two network interfaces.

New features:

• Implemented new network configuration "IP-Fabric" based on iBGP.
• Added a possibility to limit TCP connections for VM.
• Added a possibility to create VM without OS installed.
• New visualization of clusters.
• New visualization of the setup form.

Bug fixes:

• Now the information about cluster node resources updates correctly.
• Fixed a bug with VM status after live migration.
• Fixed a bug with language changing for "Advanced user" role.
• Now the task to create a backup when there is not enough disk space will expect previous tasks finishing.

New features:

• New visualization of cluster nodes.

Bug fixes:

• Fixes and improvements to the VM backup mechanism.
• Fixed the bug with bond interface detection when connecting a node.
• Added the ability to connect the platform's backup storage by domain name.
• Fixed a bug with saving parameters when setting up custom configuration on the VM creation form.
• Fixed a bug with displaying VM status after manual editing of XML configuration.
• Improved visualization of VM resource monitoring.

New features:

• Added new feature: platform backup.
• Added a function to get the summary statistics on VM network traffic for a specified period.
• The items in the task list can now be deleted.
• Now in the tasks list you can see IP address of the user who launched it.
• Added cluster info in VM creation form.

Bug fixes:

• Now help button (right top angle) works properly on user level.

Bug fixes:

• Fixed the bug with changing node connection params.
• Fixed the XSRF security error in the alert service.

Bug fixes:

• Minor bugfix.

New features:

• Added ability to send alert to Telegram.
• Now backup storage can be created using domain name.
• Now you can create backup schedules based on VM configuration.
• Now fine-tuning settings can be assigned in VM configurations.
• Added abillity to provide domain name on VM creation.
• Added abillity to assign non-subnet gateway on subnet creation(Can be activated by API).

Bug fixes:

• Fixed statistics collecting error after changing node IP-address.
• Fixed bug on adding CentOS 8 node to cluster with ip allocation tules "to node"
• Network limits moved from cluster settings to VM configurations.

Bug fixes:

• Fixed bug with VM and node scritps.
• Fixed bug with "change resources" button on virtual machine card.

Bug fixes:

• Fixed bug in live VM migration from node under CentOS 8.

Bug fixes:

• Fixed minor bugs in the VM fine-tuning interface.

New features:

• Added the possibility to activate the Windows license via KMS server.
• Now you can connect nodes running on CentOS 8 in VMmanager.
• Added subnet support when using an external DNS server.
• Added "fine tuning" of parameters for VM.

Bug fixes:

• Fixed the error where a normal user sees the administrator's email in the task queue.
• Fixed the error with incorrect name of network interface during VM reinstallation.
• Fixed the error message when creating a VM with a non-existent account.
• When the connection parameters of a node are changed, the VNC address is now changed as well.

Bug fixes:

• Fixed the problem with new container on VMmanger update.

Bug fixes:

• Fixed the error in display of next backup schedule run.

New features:

• Added the possibility to connect storage for backups.
• Added the possibility to create scheduled backups.
• Added the possibility to edit PTR record in the list of IP addresses on the virtual machine dashboard.
• If there are more than 13 nodes, the dashboard will display the top 10 (monitoring and statistics).
• After creation, the virtual machine is displayed in the list in the expanded view
• Added the queue to create an image/backup copy on a single node for load optimization purposes.

Bug fixes:

• Fixed the error that could lead to data damage in case of unsuccessful migration of a VM.
• Fixed the security error when mounting ISO image to a virtual machine.
• Now the number of processors in the virtual machine is set through the cores and not through sockets.
• Fixed the error of unending loading of profile settings in advanced user's client area.
• Fixed the XSRF security error in the plugin service.
• Fixed an error in which a link to a dashboard was available to an ordinary user.

Bug fixes:

• Fix a bug with starting panel if database contains VMs with deprecated states.

Bug fixes:

• Fix a bug with unstable service startup during product update.

New features:

• Added the ability to change IP address and SSH port of the connected node.
• Rewrite a VM status tracking service. Now it is more stable, effective and easier to maintain.

Bug fixes:

• Fixed the error of displaying the IP address in the notification about VM deletion.
• Added tracking of the number of free IP addresses in the node selection algorithm when creating a VM, for a cluster with the rule of IP address assigning "To the node".
• Fixed the error allowing to start VM recovery from a damaged image.
• Fixed the error making it impossible to delete an unavailable VM.
• Locked the row in the table when deleting a user image.
• OS available only to the administrator are not displayed on the VM reinstall form now.
• Role names are now displayed in the user list.
• Comma-separated input is now possible in the IP address input fields.
• Processed the Libvirt connection error.

Bug fixes:

• Enable nf_conntrack kernel module.

New features:

• Add more cleaned VM backup functionality.
• Add possibility to install, setup, and remove VMmanager modules.
• Add PowerDNS integration module.
• Setup net.nf_conntrack_max and net.netfilter.nf_conntrack_max options during node setup, in order to avoid packet loss.

Bug fixes:

• Fix disk size when creating VM from Image.
• Fix SSH-keys menu in client area.
• Task queue is now persistent to panel updates.
• Fix displaying inbound/outbound traffic.
• Disable a button of running script for turned off VM.
• Add a link to IPv6 documentation in VM card.
• Fix a bug with displaying data in statistics charts.

Bug fixes:

• The bug that caused a failed installation of VMmanager is fixed

New features:

• Add possibility to set up alert notifications.
• Add possibility to enable/disable ISO-images per cluster.
• Add IOPS-statistic chart to VM and Node pages.

Bug fixes:

• Fix data updating inside tooltips.
• Fix a bug of displaying 'VM creation prohibited' status.
• Fix a bug of updating breadcrumbs after modifying VM or Node name.
• Fix a bug of displaying deleted VM scripts.
• Fix a bug of group deleting user images with inappropriate access rights.
• It is now impossible to create a cluster if there are no IP pools.
• Fix 'Only administrator' OS option to restrict installing and reinstalling OS for non-privileged users.
• Open firewall port after installing node with non-standard ssh port.
• Optimize vmwatch service starting process.
• Fix NVMe-disk IOPS calculation.
• Fix units of measurement for disk in VM history.
• Filter out 'Only administrator' OS in VM creation form for non-privileged users.

Bug fixes:

• Fix VM creation from image to allocate an ip address.

Bug fixes:

• Fixed a bug with entering a rescue mode.
• Added a redirect processing for some ISO-image URLs.

New features:

• Added a possibility to reinstall VM from ISO-image.
• API: it is now possible to set disk overselling.
• Added a possibility to recover VM in clusters with CEPH storage, in case of node crash. 

Bug fixes:

• Recovered arping utility to update ARP-tables of routers when setting an IP-address for VM.
• Fixed how date is shown in filter of VM stat page.
• Fixed a bug of deselecting rows on list update.
• Fixed a bug with triggering of forbidden actions when using group operations in VM list and Script list.
• Fixed a bug that prevents to delete an Image in Image list.
• Fixed a node sorting in dashboard.
• Fixed a text formatting in "Output" tab of Task card in Task list.
• Fixed proportions in indicator of VM number in Node card.

Bug fixes:

• Fixed the bug with initial synchronization of PTR records with PowerDNS server when IPv6 subnets are in use.

Bug fixes:

• Fixed the bug with node deletion after all virtual machines have been migrated.
• Fixed the bug with Cyrillic domain validation in New user invitation form.
• Fixed the error of opening an incorrect list page after resetting the filters.
• Fixed the error allowing an advanced or simple user to perform any operations with virtual machine stopped by administrator.
• The task widget on the dashboard displays all the tasks in the queue, regardless of their creation date.

New features:

• Added the ability to integrate with PowerDNS.
• Added the ability to search for nodes on the script launch form.

Bug fixes:

• Fixed the network configuration for Debian 8 and CentOS 6 in clusters with "to node" IP assigning rule.
• Fixed the calculation formula for cpu usage in virtual machine statistics.

Bug fixes:

• Import is adjusted to clusters with "To node" IP allocation rules.
• Added a possibility to set a specific ip-address for a VM in a cluster with "To node" IP allocation rules.

New features:

• Added automatic extension of libvirt certificates on the node
• Added the possibility of automatic and manual execution of Shell and Ansible scripts on cluster nodes.
• The ability to move the virtual machine from an unavailable node in a cluster with network storage.
• Added the possibility to indicate Windows license keys.
• Improved operation of NoVNC console. Now it works faster, consumes fewer resources, checks authentication, and hides password from the address bar.

Bug fixes:

• Fixed the error of installing the statistics collection daemon on a node with a non-standard ssh port.
• Fixed the error that caused the VM re-installation form to contain the OS disabled for the cluster.
• Fixed the errors of entering VMmanager from an integrated BILLmanager under an arbitrary administrator's account.
• Fixed the error of default gateway configuration when adding a cluster node.
• Fixed the user password recovery error.

New features:

• A new cluster setting that allows to add nodes with two network interfaces and connect them to the primary and secondary networks was added. Virtual machines created in that cluster could be connected to both networks.
• Passwords are no longer displayed in the task parameters.

Bug fixes:

• Fixed the bug that occured when adding bond network interface.
• Fixed the bug with negative tasks duration.

Bug fixes:

• Fixed the bug that had made impossible for @advanced_user to create VM.

Bug fixes:

• Fixed user access rights to cluster list.

Bug fixes:

• Fixed the bug with enabling/disabling technical support access.

New features:

• More steps are added into RAM slider in "Change resources" and "VM creation" from.

Bug fixes:

• Fixed the bug with newlines in IP adding field.
• Fixed the bug with VM creation in cluster without linked operating systems.
• Dashboard widget with platform information is completed with server monitoring.
• Link to CEPH documentation is added in Cluster creation form.
• Fixed a message with ssl/tls in email settings.
• CSRF/XSRF guard is implemented.

Bug fixes:

• Fixed the bug with VM rescue mode.

Bug fixes:

• Fixed the bug that occured when adding a node in an LVM-cluster created before v3.7.
• Fixed the bug that occured when deleting an SSH-key.

Bug fixes:

• Fixed the bug: unable to enter VMmanager panel from BILLmanager.
• Fixed the password change bug.
• Fixed the user invitation bug.

New features:

• Added the Ceph RBD network storage support.

Bug fixes:

• Fixed the bug that occurred when transfering the VM image between nodes.

Bug fixes:

• Fixed the bug that occurred when starting the virtual machine migration.

New features:

• Nodes from OVH Datacenter are now supported.
• Slider behaviour is improved in all forms.
• Release date and installation date is now displayed in "Settings" menu.
• Added option "Technical support access" in "Settings" menu.
• "Cluster type" is renamed to "IP allocation rules".
• It is now possible to set comment for cluster.
• OS icons are now displayed in cluster list.
• Docker log rotation is set up.
• Request id info is now displayed in task logs.
• It is now possible to resize disk of Windows VM.

Bug fixes:

• Fixed the bug when taskmanager is manually restarted.

Bug fixes:

• Fixed live-demo monitoring.

Bug fixes:

• After login redirect bug fixed.

Bug fixes:

• Fixed the bug in VM migration task.

New features:

• VM reinstallation interrupts its active tasks.
• Added possibility to set timeout for VM creation and VM reinstallation tasks. By default it is equal to 1 hour.
• VM deletion interrupts its active tasks.

Bug fixes:

• Added a new mechanism to validate IP range against IP networks.
• Fixed the bug: user could view pages without permission.

New features:

• Now we show last five changelog items.

Bug fixes:

• Fixed the bug: virtual machines on LVM storage were created with problems.

Bug fixes:

• Fixed the bug: BILLmanager 5 could not order additional ip for virtual machine in Hetzner cluster.

New features:

• In the billing system, you can now set space limits for images.
• Recovery mode function added for virtual machines.
• Introduced support of IPv6 for Hetzner clusters.

Bug fixes:

• Fixed floating bug that reset the VNC password.
• Fixed the bug that caused delay of the Windows installation process on the last step.
• Fixed VM network interface configuration without IPv4.
• Modified cluster widget on the Dashboard.

Bug fixes:

• Fixed data update bug in the list of users.
• Fixed user list filter.

Bug fixes:

• Fixed nodewatch service bug that occurred during VMmanager update.
• Fixed the bug with deleting a snapshot that might occur when creating a live image of the VM with dot in name.
• Fixed statistics collection bug.

New features:

• It is now possible to create images without stopping a virtual machine.
• Launched top module for VM monitoring cluster node.
• Optimized statistics collection per virtual machine.
• Added monitoring panel based on Grafana with pre-defined graphs and diagrams.
• Added Admin Dashboard for infrastructure status monitoring. It contains widgets displaying real-time information by nodes and virtual machines, as well as failed operations. To open the Dashboard click on the VMmanager logo.
• Switch to Grafana by clicking the button on the Dashboard.

Bug fixes:

• Fixed mouse cursor bug in VNC console on Windows.
• Images from VM are now created correctly.
• VM installation and reinstallation notifications are now sent correctly.

Bug fixes:

• Panel could not send VM creation and reinstallation emails.

Bug fixes:

• Disk space information for LVM nodes is now displayed correctly.
• Fixed name servers settings for Ubuntu 18.04.
• Fixed statistics service settings during VM deletion.
• API: it is now possible to pass an empty list of IP pools when creating virtual machine.
• Fixed the bug that occurred when adding IPv6 with advanced user permissions.
• Bugfix: the Change log was displayed only in English.
• Fixed floating bug that might occur when adding SSL certificate.

Bug fixes:

• Fixed the bug appearing while Windows installation.
• Fixed the bug: only panel owner could change user role.

New features:

• User role management.

New features:

• Introduced experimental support of IPv6.

Bug fixes:

• Email sending timeout reduced to 15 seconds.

New features:

• SSL certificate view and edit options added to the "Settings" section.
• Description of the "Unblock" operation added to user list.
• Improved user invitation mechanism.
• Control panel's domain edit function added to "Settings" section.

Bug fixes:

• Improved license expiration notification mechanism
• Fixed the bug: the button Back to ... was not displayed when user was trying to log in as owner.
• Single queue for creation, reinstallation, and cloning tasks of virtual machine added to cluster node.
• Improved user list layout. Added new user invitation notification.
• Fixed the bug: the button "Create image" was not displayed in the list of images on virtual machine card.
• Modified the way how pop-up hints are displayed in the list of tasks.
• Improved the way how the Change log is displayed.

Bug fixes:

• RAM consumption statistics is now calculated correcly
• Fixed the bug: virtual machines running Windows were created with default disk size
• A single queue for all migrations
• Correct sender in the user invitation emails

New features:

• The system now disables SELinux on cluster nodes and asks to reboot the system to apply changes.

Bug fixes:

• Admin email is now displayed correctly in VM history
• Fixed deletion of virtual machines in Hetzner cluster
• Fixed the bug that occurred when adding an IP address on the preliminary configuration form of the Hetzner cluster

New features:

• Changelog added to "VM6 settings" section.
• Monitoring. The system now handles network errors and re-connection to virtual machines and nodes
• VMmanager 6 update function added to "VM6 settings" section.
• It is now possible to reset mail settings
• It is now possible to disable VM status notifications
• It is now possible to re-send the user invitation email
• It is now possible to delete a corrupted node (it will be deleted only from the database)

Bug fixes:

• The "Report bug" button is no longer available on User level.
• Fixed dimension of scales on statistical graphics
• Fixed incorrect data in monitoring window and list of VM tasks.
• Monitoring. Fixed traffic calculation during VM reboot.
• Monitoring. Occupied RAM on CentOS 6 is now calculated correctly
• It is no longer possible to create VM with its disk size less than the minimum value specified for selected OS template or image.
• Fixed routing to Hetzner for several networks
• Fixed IP assignment when restoring from image.

Bug fixes:

• Fixed VM uptime display.

Bug fixes:

• The system now checks that filter parameters are up-to-date

Bug fixes:

• Localization fixes.

New features:

• Added cluster node statistics.
• Added Hetzner cluster type.

Bug fixes:

• Fixed filters by OS and statuses in VM list.

New features:

• Added incoming and outgoing traffic statistics for virtual machines

Bug fixes:

• Fixed conversion of units of measure. This bug occurred when calculating interface throughput capacity.

Bug fixes:

• Fixed a number of bugs in the VM resources modification mechanism

Bug fixes:

• Disk space is now displayed correctly on the cluster node

New features:

• Introduced support of VM storages

New features:

• It is now possible to limit VM interface throughput capacity.
• Panel update function added to web-interface.

Bug fixes:

• Fixed a number of preliminary setup bugs

Bug fixes:

• Fixed Nginx configuration

New features:

• Added text area for IP addresses.
• The system now checks that an IP address belongs to the network

Bug fixes:

• Added license download mechanism.