KVM網絡性能測試(2)

測試結論

  • kvm使用virtio虛擬網卡,網絡小包處理能力損失了3/4。

測試過程

測試場景

  • 本文接 KVM網絡性能測試(1)
  • 一樣是16臺服務器:一樣是15臺用做壓測客戶端,一樣1臺被測試。
  • 一樣是用工具 Ngrinder ,一樣是測試 Tengine 的狀態頁面。
  • 不一樣的是,此次咱們用的品牌機、萬兆網卡,併發用戶數加大了。
  • 用相同的測試方法:
  1. 測試物理機的網絡性能(24C/32G)
tps = 227,115.4
mtt = 78.18
錯誤率 = 0.00% # 硬是不出錯
虛擬用戶 = 18000
  1. 分別測試1臺虛擬機的網絡性能(12C/8G、12C/8G)
tps = 49,650.8 、 49,724.9
mtt = 53.63 、 51.52
錯誤率 = 9.15% 、 9.19%
虛擬用 戶= 18000 、18000
  1. 提升1臺虛擬機的配置再測試(24C/8G、24C/8G)
tps = 37,318.6 、 37,380.5
mtt = 84.69 、 86.55
錯誤率 = 11.42% 、 11.33%
虛擬用戶 = 18000 、18000
  1. 同時測試2臺虛擬機的網絡性能(12C/8G + 12C/8G)
tps = 53,280.6
mtt = 98.13
錯誤率 = 7.14%
虛擬用戶 = 18000

此時宿主機資源並未徹底耗盡:
宿主機資源使用
其上兩臺虛擬機的資源也未耗盡,但st%的佔用表示有資源爭搶:
虛擬機資源爭搶nginx

測試結果

  • 25萬tps時:pps/in = 1,237 k , pps/out = 742 k
    測試結果
  • 宿主機 TPS超22萬,虛擬機最高不到 6萬。性能損失了3/4!
    網絡封包數量
  • 測試結果使人震驚,因而不敢相信地又跑了一次物理機測試,然而結果重現、還硬不報錯。

測試環境

  • 宿主機爲戴爾M620,CPU=24核、內存=32G、硬盤=240G-ssd。
  • 壓測機器爲15臺同配置物理機,CPU=4核、內存=32G、硬盤=240G-ssd。
# libvirtd --version
libvirtd (libvirt) 1.2.9
# nginx -v
Tengine version: Tengine/2.1.1 (nginx/1.6.2)
# kvm --version
QEMU emulator version 2.1.2 (Debian 1:2.1+dfsg-12+deb8u4), Copyright (c) 2003-2008 Fabrice Bellard
Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz * 24
Jessie-8.2 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u3 (2015-08-04) x86_64 
Ethernet controller: Broadcom Corporation NetXtreme II BCM57810 10 Gigabit Ethernet
  • 虛擬機的配置 virsh dumpxml kvm-net-perfmon:
<domain type='kvm' id='7'>
  <name>kvm-net-perfmon</name>
  <memory unit='KiB'>16777216</memory>
  <currentMemory unit='KiB'>8388608</currentMemory>
  <vcpu placement='static'>12</vcpu>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-i440fx-2.1'>hvm</type>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
  </features>
  <cpu mode='host-passthrough'>
    <topology sockets='1' cores='12' threads='1'/>
  </cpu>
  <clock offset='utc'/>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/bin/kvm</emulator>
    <disk type='network' device='disk'>
      <driver name='qemu' type='raw'/>
      <auth username='higkoo'>
        <secret type='ceph' uuid='666a519f-afae-0d6f-2233-99c88888ceb3'/>
      </auth>
      <source protocol='rbd' name='libvirt-pool/1018-kvm-net-perfmon'>
        <host name='192.168.31.116' port='2233'/>
        <host name='192.168.31.101' port='2233'/>
        <host name='192.168.31.132' port='2233'/>
        <host name='192.168.31.118' port='2233'/>
        <host name='192.168.31.102' port='2233'/>
      </source>
      <backingStore/>
      <target dev='vda' bus='virtio'/>
      <iotune>
        <total_iops_sec>800</total_iops_sec>
      </iotune>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </disk>
    <controller type='usb' index='0'>
      <alias name='usb0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'>
      <alias name='pci.0'/>
    </controller>
    <interface type='bridge'>
      <mac address='11:22:33:00:c6:a8'/>
      <source bridge='br100'/>
      <target dev='vnet1'/>
      <model type='virtio'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </interface>
    <serial type='pty'>
      <source path='/dev/pts/1'/>
      <target port='0'/>
      <alias name='serial0'/>
    </serial>
    <console type='pty' tty='/dev/pts/1'>
      <source path='/dev/pts/1'/>
      <target type='serial' port='0'/>
      <alias name='serial0'/>
    </console>
    <input type='tablet' bus='usb'>
      <alias name='input0'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <graphics type='vnc' port='2333' autoport='yes' listen='0.0.0.0'>
      <listen type='address' address='0.0.0.0'/>
    </graphics>
    <video>
      <model type='cirrus' vram='9216' heads='1'/>
      <alias name='video0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </video>
    <memballoon model='virtio'>
      <alias name='balloon0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </memballoon>
  </devices>
</domain>
相關文章
相關標籤/搜索