It’s no surprise that NVMe speed is impressive: A blue-ribbon consortium of storage and server vendors developed NVMe as a high-performance interface specification that accelerates NAND SSDs using the PCIe bus.
NVMe’s logical device interface takes advantage of SSD’s low latency and parallelism to improve IOPs and throughput and reduce latency. This is not the first time vendors used PCIe to speed up SSDs, but it is the first standardized approach.
NVMe stands for non-volatile memory express, and protocol provides high bandwidth and low latency with flash-specific improvements. It supports current NAND flash and will scale to support future high-performance devices that depend on persistent memory technologies.
In the market for the best SSDs? See our list of the best and fastest SSDs.
How fast are NVMe performance and throughput? Clearly enough to get the attention of the data storage industry.
NVMe’s technology allows its multitasking speed to be far faster than related formats.
In the NVMe vs SATA speed comparison, SATA does have some advantages over NVMe. It’s widely deployed, and its SSD speeds are fast enough for many applications. There is no need to immediately rip and replace SATA, although customers might want to upgrade to SAS or NVMe during technology refreshes.
Vendors are still developing for SATA. Samsung developed a consumer level SATA SSD interface with tested reads up 3500 MB/s and writing speeds up to 2500 MB/s. Although customers won’t be adding these devices to the data center, they will accelerate consumer devices.
What SATA does not do well is the upper performance levels of high transactional applications. For these, NVMe performance is your better choice. If your storage platform offers a high-demand application that requires NVMe’s high SSD transfer rate, it is well worth the cost.
NVMe SSDs display throughputs at the rate of 32 GBps (gigabytes per second). Half a million IOPs are common and higher-end drives range up to 10 million IOPs. Despite these high speeds, latency rates generally stay below 20 microseconds and some at half that number. By legacy standards, these numbers are deeply impressive.
The NVMe spec is delivered in standard-sized PCIe expansion cards, or a 2.5” form factor with a four-lane PCIe interface going through a U.2 connector. The most popular choice for its easy deployment, U.2 connects SSDs to a host and works with PCIe, SAS or SATA. NVMe U.2 drives often feature four PCIe lanes, two SAS lanes and one SATA lane for broad interface support in the 2.5” form factor.
The M.2 mini-board specification for PCIe, SATA or USB form factors is also growing in popularity for consumer-level NVMe usage. M.2 boards come in several sizes including the smallest available PCIe footprint.
Storage capacity on NVMe disks starts at consumer-sized 450GB and rises to 11 TB and up for the data center.
· SSD parallelism. The architecture exploits SSD parallelism to reduce IO overhead. HDDs, and tape for that matter, are sensitive to access patterns. Sequential data enables faster performance while random data slows down data access. SSDs run in parallel so random or sequential data have little effect on SSD performance.
· Updated bus. Hybrid flash arrays often bottlenecked since the SSD tiers were capable of more speed than the HDD storage interfaces could support. IT compensated to a point with multicore processors and a lot of RAM. But it is more efficient and less expensive to deploy NVMe that is engineered to take advantage of SSD speeds.
· Performance enhancements. Additional enhancements include the ability to support a single queue capacity of 64K, and to process about 64K of these long queues at the same time. Along with latency reduction, this accelerates performance for busy servers processing simultaneous requests.
· RDMA. NVMe employs remote direct memory access (RDMA) using the PCIe bus. This enables the interface to map IO commands and responses to host shared memory, which frees CPU resources. NVMe also streamlines its command set, issuing less than half of the CPU instructions as SATA or SAS. (10 admin commands are required and 5 are optional; 3 IO commands are required and 8 are optional.)
· Additional advanced features. NVMe supports features such as security container commands, power management and command enhancements. A host memory buffer helps to support client and mobile NVMe.
· Controller Memory Buffer. The NVMe buffer enables the host to formulate commands in controller memory instead of depending on fetch commands through the PCIe. NVMe passes memory blocks instead of SCSI commands, which is results in lower latency. NVMe also arbitrates priority commands by observing service level agreement parameters.
· Reservations. NVMe supports multi-host reservations in Windows Clusters that coordinate host access by managing shared namespaces.
An example of NVMe speeds: the Samsung unit boasts impressive read write times.
However, for all its performance benefits NVMe speed is dependent on direct attachment to an individual host. A storage controller is a necessity for shared storage, and manages capacity provisioning, some data protection, physical addressing and protocol translations. But add a storage controller and NVMe slows down, defeating the justification for its high cost.
NVMe over Fabrics (NVMe-oF) is a way of solving the problem. The spec enables NVMe message-based commands to transfer data over Ethernet, Fibre Channel (FC) or InfiniBand fabrics without going through slow storage controllers. Storage admins can take NVMe SSD out of the server and connect it over the fabric. Remote SSD storage services operate at the speed of memory to memory transfer with extremely low latency.
The spec uses RDMA for InfiniBand, Converged Ethernet, and Internet Wide Area. It uses a second method to transport across Fibre Channel.
Nothing is perfect, including NVMe speed.
Life sciences, financial services and energy companies all depend on extremely fast HPC with high performance and low latency. Life sciences and energy leverage NVMe speed for fast complex calculations since it virtually eliminates processor wait times when reading from storage. Financial services use NVMe as secondary memory to accelerate extremely high numbers of transactions. In life sciences, industry testing displays 6x performance improvement over SATA. The industry pays for it – about a 50% price increase – but total ROI is very favorable.
OLTP relational databases and big data also benefit from high performance reads. In databases, DBAs can use SSD cache to pin metadata, data and indexes without slowing it down. Queries speed up considerably for much improved database performance. Big data’s intensive workloads no longer encounter storage bottlenecks, which lets business analysts make real-time decision with immediately available data. And since NVMe is not limited to a specific type of workload, it accelerates performance for other applications.
And in a less known usage case, NVMe lets admins optimize virtualized environments by increasing the number of VMs the virtualized network can support. VMware and Hyper-V admins are often forced to optimize VM performance by partitioning the network by workload, latency or IOPs. This adds to expense and management complexity. NVMe is purpose-built to manage clusters and optimize performance across workloads. This enables admins to boost network speed and performance and dispense with complex partitions. This is not a cheap proposition, but by applying NVMe to critical VMs – and keeping a close watch on falling prices — admins can easily justify the added expense of NVMe.
Enterprise Storage Forum offers practical information on data storage and protection from several different perspectives: hardware, software, on-premises services and cloud services. It also includes storage security and deep looks into various storage technologies, including object storage and modern parallel file systems. ESF is an ideal website for enterprise storage admins, CTOs and storage architects to reference in order to stay informed about the latest products, services and trends in the storage industry.
Advertise with TechnologyAdvice on Enterprise Storage Forum and our other IT-focused platforms.
Property of TechnologyAdvice.
© 2021 TechnologyAdvice. All Rights Reserved
Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.