请教 Windows iperf3 10GbE 测速跑不满的问题

V2EX = way to explore

V2EX 是一个关于分享和探索的地方

现在注册

已注册用户请登录

这是一个创建于 739 天前的主题，其中的信息可能已经有所发展或是发生改变。

问题

无论哪边是 Server ，iperf3 测速 单线程 跑不满 10Gbps ，仅有不到 5Gbps ，需要至少四个线程 -P4 才能跑出接近的数值。单线程测速时，Server/Client 并没有任何一个 CPU Core 吃满 100%。

想请教一下可能是什么问题？

有搜到说 Windows 上的 iperf3 因为 cygwin 所以性能有问题，但是手边没有可以连上 10GbE 的 Linux/macOS 设备，所以没法确认。

~
❯ iperf3 -c 192.168.2.22
Connecting to host 192.168.2.22, port 5201
[  4] local 192.168.2.11 port 52865 connected to 192.168.2.22 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   525 MBytes  4.40 Gbits/sec
[  4]   1.00-2.00   sec   527 MBytes  4.42 Gbits/sec
[  4]   2.00-3.00   sec   527 MBytes  4.42 Gbits/sec
[  4]   3.00-4.00   sec   543 MBytes  4.55 Gbits/sec
[  4]   4.00-5.00   sec   536 MBytes  4.50 Gbits/sec
[  4]   5.00-6.00   sec   532 MBytes  4.46 Gbits/sec
[  4]   6.00-7.00   sec   542 MBytes  4.55 Gbits/sec
[  4]   7.00-8.00   sec   548 MBytes  4.60 Gbits/sec
[  4]   8.00-9.00   sec   546 MBytes  4.58 Gbits/sec
[  4]   9.00-10.00  sec   546 MBytes  4.58 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  5.25 GBytes  4.51 Gbits/sec                  sender
[  4]   0.00-10.00  sec  5.25 GBytes  4.51 Gbits/sec                  receiver

~ took 10s
❯ iperf3 -c 192.168.2.22 -P 4
Connecting to host 192.168.2.22, port 5201
[  4] local 192.168.2.11 port 53184 connected to 192.168.2.22 port 5201
[  6] local 192.168.2.11 port 53185 connected to 192.168.2.22 port 5201
[  8] local 192.168.2.11 port 53186 connected to 192.168.2.22 port 5201
[ 10] local 192.168.2.11 port 53187 connected to 192.168.2.22 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   196 MBytes  1.65 Gbits/sec
[  6]   0.00-1.00   sec   189 MBytes  1.58 Gbits/sec
[  8]   0.00-1.00   sec   255 MBytes  2.14 Gbits/sec
[ 10]   0.00-1.00   sec   286 MBytes  2.40 Gbits/sec
[SUM]   0.00-1.00   sec   926 MBytes  7.76 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   247 MBytes  2.07 Gbits/sec
[  6]   1.00-2.00   sec   248 MBytes  2.08 Gbits/sec
[  8]   1.00-2.00   sec   273 MBytes  2.29 Gbits/sec
[ 10]   1.00-2.00   sec   298 MBytes  2.50 Gbits/sec
[SUM]   1.00-2.00   sec  1.04 GBytes  8.94 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   278 MBytes  2.33 Gbits/sec
[  6]   2.00-3.00   sec   264 MBytes  2.22 Gbits/sec
[  8]   2.00-3.00   sec   278 MBytes  2.33 Gbits/sec
[ 10]   2.00-3.00   sec   299 MBytes  2.51 Gbits/sec
[SUM]   2.00-3.00   sec  1.09 GBytes  9.39 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   282 MBytes  2.36 Gbits/sec
[  6]   3.00-4.00   sec   257 MBytes  2.15 Gbits/sec
[  8]   3.00-4.00   sec   279 MBytes  2.34 Gbits/sec
[ 10]   3.00-4.00   sec   301 MBytes  2.53 Gbits/sec
[SUM]   3.00-4.00   sec  1.09 GBytes  9.39 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   268 MBytes  2.25 Gbits/sec
[  6]   4.00-5.00   sec   248 MBytes  2.08 Gbits/sec
[  8]   4.00-5.00   sec   302 MBytes  2.54 Gbits/sec
[ 10]   4.00-5.00   sec   301 MBytes  2.52 Gbits/sec
[SUM]   4.00-5.00   sec  1.09 GBytes  9.39 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   282 MBytes  2.36 Gbits/sec
[  6]   5.00-6.00   sec   284 MBytes  2.38 Gbits/sec
[  8]   5.00-6.00   sec   271 MBytes  2.27 Gbits/sec
[ 10]   5.00-6.00   sec   285 MBytes  2.39 Gbits/sec
[SUM]   5.00-6.00   sec  1.10 GBytes  9.41 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   290 MBytes  2.44 Gbits/sec
[  6]   6.00-7.00   sec   263 MBytes  2.21 Gbits/sec
[  8]   6.00-7.00   sec   281 MBytes  2.36 Gbits/sec
[ 10]   6.00-7.00   sec   286 MBytes  2.40 Gbits/sec
[SUM]   6.00-7.00   sec  1.09 GBytes  9.41 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   280 MBytes  2.35 Gbits/sec
[  6]   7.00-8.00   sec   279 MBytes  2.34 Gbits/sec
[  8]   7.00-8.00   sec   272 MBytes  2.28 Gbits/sec
[ 10]   7.00-8.00   sec   288 MBytes  2.42 Gbits/sec
[SUM]   7.00-8.00   sec  1.09 GBytes  9.39 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   288 MBytes  2.42 Gbits/sec
[  6]   8.00-9.00   sec   268 MBytes  2.24 Gbits/sec
[  8]   8.00-9.00   sec   280 MBytes  2.35 Gbits/sec
[ 10]   8.00-9.00   sec   284 MBytes  2.38 Gbits/sec
[SUM]   8.00-9.00   sec  1.09 GBytes  9.39 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   276 MBytes  2.32 Gbits/sec
[  6]   9.00-10.00  sec   281 MBytes  2.36 Gbits/sec
[  8]   9.00-10.00  sec   280 MBytes  2.35 Gbits/sec
[ 10]   9.00-10.00  sec   284 MBytes  2.38 Gbits/sec
[SUM]   9.00-10.00  sec  1.09 GBytes  9.40 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  2.63 GBytes  2.26 Gbits/sec                  sender
[  4]   0.00-10.00  sec  2.63 GBytes  2.26 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  2.52 GBytes  2.16 Gbits/sec                  sender
[  6]   0.00-10.00  sec  2.52 GBytes  2.16 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  2.71 GBytes  2.33 Gbits/sec                  sender
[  8]   0.00-10.00  sec  2.71 GBytes  2.33 Gbits/sec                  receiver
[ 10]   0.00-10.00  sec  2.84 GBytes  2.44 Gbits/sec                  sender
[ 10]   0.00-10.00  sec  2.84 GBytes  2.44 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  10.7 GBytes  9.19 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  10.7 GBytes  9.19 Gbits/sec                  receiver

参与测速的设备

Windows 11 22H2 22621.963

CPU: 5900X
NIC: Intel X520 DA1 on PCIe Gen 2 * 4 (Max * 8)
NIC Driver: Intel 官网最新的驱动手动安装

Arch Linux 6.0.12-arch1-1

CPU: 3900X
NIC: Intel X520 DA1 on PCIe Gen 2 * 4 (Max * 8)
NIC Driver: ixgbe

Switch

QNAP QSW-M408S

第 1 条附言 · 2022-12-16 10:46:49 +08:00

更新：在原本的 Windows 机器上用 Live ISO 跑 Linux 测速单线程可以跑满，9.4Gbps 。

Windows ，iperf3 on Windows 或者 Intel 的 Windows 驱动，必有一个背锅。

6 条回复 • 2022-12-16 21:10:14 +08:00

cnbatch

2022-12-16 00:14:04 +08:00

今年上半年也有人遇到类似的问题，后来发现是火绒导致的：
https://www.v2ex.com/t/844789

或许可以按照这个思路排查下已安装的软件

vibbow

2022-12-16 02:09:17 +08:00

建议用 smb 复制文件测速，很容易就跑满。

jim9606

2022-12-16 03:16:12 +08:00 via Android

防病毒类软件试试暂时关闭？
可以试试微软出的（疑似弃坑的） ethr ，用 go 实现的可能没兼容层问题。

lentrody

2022-12-16 08:54:14 +08:00 via Android

用 iperf2

unidentifiedme

2022-12-16 20:06:37 +08:00

@cnbatch @jim9606 我没有安装任何安全软件，仅有 Windows Defender 。卸载了其他可能和网络相关的 Tailscale 和网易 UU 加速器，并重启。测速结果仍然是一样的，不到 5Gbps 。

@vibbow 我测试了 SMB ，大概能跑到 700MBps ，也不满。没开 Jumbo Packet 。

vibbow

2022-12-16 21:10:14 +08:00

@unidentifiedme 我交换机是 Juniper EX4300-48P

Windows 上用的 AQC107 ，使用万兆光转电模块连交换机
对端是 QNAP TS-532X （ ARM 架构 NAS)，使用 DAC 线连交换机

用 SMB 协议传文件，也没开巨帧，轻轻松松跑满万兆的。