Q
Evaluate Weigh the pros and cons of technologies, products and projects you are considering.

How do RDMA storage systems improve latency reduction?

RDMA technology can help speed up I/O in storage environments by bypassing copy processes in the software stack when data is called up from a system's memory.

Remote Direct Memory Access technology enables more direct movement of data in and out of a server. The technology...

can be implemented for networking and storage applications. RDMA storage systems bypass normal system software network stack components such as a cache or operating system, as well as the multiple buffer copy operations they normally perform. This reduces overall CPU utilization and improves the latency of the host software stack, since fewer instructions are used to complete a data transfer. Some RDMA adapters may even have offload functions built into them.

RDMA storage networking protocols include iSCSI block protocols, and NFS or SMB (formerly known as CIFS) file protocols. RDMA can improve storage latency and reduce the CPU utilization of the host server performing I/O requests. This allows a higher rate of I/O requests to be sustained or a smaller server to perform the same rate of I/O requests. This can make RDMA storage networking valuable in environments that can tolerate very little latency such as supercomputing environments and some database workloads.

InfiniBand uses RDMA natively. RDMA can be added to Ethernet by using special adapters. With the addition of faster gigabit Ethernet speeds in 2016, RDMA over Ethernet may be useful to further reduce overhead.

Standard network connection vs. RDMA connection
At left is a standard network connection. At right is an RDMA connection. The initiator and the target must use the same type of RDMA technology -- RDMA over Converged Ethernet or InfiniBand, for example.

Technologies that use RDMA include:

  • ISCSI Extensions for RDMA (Ethernet only).
  • Internet Wide-Area RDMA Protocol. This runs on top of standard TCP/IP (Ethernet only).
  • NFS over RDMA: Linux RDMA transport for NFS (Ethernet or InfiniBand).
  • RDMA over Converged Ethernet: Requires a data center bridging switch that provides a lossless fabric (Ethernet only).
  • SMB Direct: Windows Server feature for file servers that takes advantage of RDMA-capable network adapters (Ethernet or InfiniBand)
  • SCSI RDMA Protocol (InfiniBand only).

In the future, RDMA storage technology may be enabled for scale-out file systems, scale-out distributed SANs or other applications.

Next Steps

Fibre Channel tops storage networking choices for storage users

How RDMA provides advantages to virtualized environments

Considerations for making the right Ethernet switch choice

This was last published in April 2016

Dig Deeper on Enterprise storage, planning and management

PRO+

Content

Find more PRO+ content and other member only offers, here.

Have a question for an expert?

Please add a title for your question

Get answers from a TechTarget expert on whatever's puzzling you.

You will be able to add details on the next page.

Join the conversation

1 comment

Send me notifications when other members comment.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Please create a username to comment.

Which RDMA protocol technology do you use and why?
Cancel

-ADS BY GOOGLE

SearchSolidStateStorage

SearchConvergedInfrastructure

SearchCloudStorage

SearchDisasterRecovery

SearchDataBackup

Close