User Tools

Site Tools


Action disabled: register
0x13:reports:d2t1t02-performance-study-of-nvme-tcp-and-nvme-roce-on-linux

Day 2 / Track 1 / Talk 2 Talk – Nuts-n-Bolts: Performance Study of NVMe/TCP and NVMe/RoCE on Linux Speakers: Roy Shterman Report by: Kiran Patil

This session covered the reasons this performance study was conducted. There is an open-source implementation for both - NVMe/RoCE and NVMe/TCP. Not every data center will have RoCE devices, but there will also be Ethernet devices. As it was known, RoCE devices are faster w.r.t. latency because of RDMA IO model but how it compared with ubiquitous Ethernet (TCP/IP). This talk went over performance study and comparison of both the implementation (NVMe/RoCE and NVMe/TCP). Due to inherent nature of kernel TCP/IP layer, NVMe over TCP has higher latency compared to NVMe/RoCE (no surprised there).

This session also covered the third implementation of NVMe/SPDK (Storage over DPDK - user space). This comparative study proved that using in-kernel NVMe/TCP implementation - user can get 1M IOPS with reasonable latency (max. latency is 1.5 ms) and also showed traffic scaling when 8 cores were used.

Site: https://www.netdevconf.info/0x13/session.html?talk-nvme-tcp-roce

0x13/reports/d2t1t02-performance-study-of-nvme-tcp-and-nvme-roce-on-linux.txt · Last modified: 2019/09/28 17:04 by 127.0.0.1

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki