The NetDev conference wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
Day 2 / Track 1 / Talk 1
Talk – Nuts-n-Bolts: NVMe over TCP/IP
Speakers: Roy Shterman
Report by: Kiran Patil 

The NVMe Technical working Group has developed the standard and protocol spec for NVMe over Fabrics. Fabrics could be RDMA, Ethernet (TCP/IP), FC. The session talks about NVMe over Fabric as protocol, queueing model, reactor thread (which actually does IP processing). General idea was, how to access remote NVMe disk over network using various fabrics. This session also described fabric agnostic protocol and their salient features such as data integrity and TLS. TCP/IP being ubiquitous in every data center and this protocol (NVMe over TCP/IP) demonstrates how to use it to access remote flashed storage media such as NVMe.  

This session also covered open-source implementation of NVMe over TCP which has been accepted for upstream. One of the important aspect of NVMe over TCP/IP was mapping of storage IO queues (submission and completion queues) and how they nicely mapped with network IO queues (transmit and receive), which enabled scalability of storage traffic using network IO queues. Essentially in other words, network IO queues are increasing to keep up with multi-core and likewise storage queues are also increasing with flashed storage devices such as NVMe. Hence this protocol enabled the best use of both queueing model (network and storage).

Site: https://www.netdevconf.info/0x13/session.html?nvme-over-tcpip