OpenBSD vmx driver performance on VMware 5.5 and 6.0

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

OpenBSD vmx driver performance on VMware 5.5 and 6.0

Henrik Lund Kramshøj-3
Hi All

We have OpenBSD running in VMware 5.5 for about 2 years and recently
6.0. So over multiple OpenBSD releases.

It is stable and works, and we can use both em and vmx driver, but only
get around 1.5 - 2.0 Gbit/s

Example between two VMware ESXi 6.0 servers connected with dual 10G
connections across Juniper EX switch

root@skyfw-osl1-02:root# iperf -s
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  4] local 185.161.127.28 port 5001 connected with 185.161.127.29 port 8188
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-60.0 sec  13.1 GBytes  1.87 Gbits/sec

client command: iperf -t 60 -i 5 -c

What are other people getting from OpenBSD network drivers in VMware?

Note: we also use OpenBSD as firewalls/gateways inside VMware and the
performance is also less than expected for that.
Note: same environment get almost full 10G wire speed from Ubuntu
14.04/16.04 etc.

We are very interested in getting this performance up, so any ideas are
welcome.

Best regards

Henrik


--
Best regards/Mvh

Henrik
--
Henrik Lund Kramshøj, cand.scient CISSP
Network Security Engineer, PatientSky Danmark ApS
[hidden email] +45 2678 1919

Reply | Threaded
Open this post in threaded view
|

Re: OpenBSD vmx driver performance on VMware 5.5 and 6.0

Steven Shockley
On 10/7/2016 6:41 AM, Henrik Lund Kramshøj wrote:

> It is stable and works, and we can use both em and vmx driver, but only
> get around 1.5 - 2.0 Gbit/s

I'm still on ESXi 5.1 in the lab and only have one host, but this seemed
interesting enough to run some benchmarks.

VM host: ESXi 5.1, Dell R610, one port used for VMs
minecraft: OpenBSD 6.0, em
symon: OpenBSD 6.0, vmx
cerberus: OpenBSD 5.8, bnx1, Dell R210-2, one port used for network
storage: CentOS 7, E1000e, SuperMicro X8DT6, two ports in LACP
librenms: OpenBSD 6.0, vmx
Cisco 3750-E switch (no 10 GB used)

server client speed notes
librenms minecraft 289 MB/sec
librenms storage 791 MB/sec
storage librenms 521 MB/sec start 937, ended 231
storage librenms 933 MB/sec
storage cerberus 925 MB/sec
cerberus librenms 468 MB/sec Start 882, then ~200,
                                                then back to ~800
cerberus librenms 923 MB/sec
cerberus storage 817 MB/sec
cerberus symon 925 MB/sec
symon cerberus 287 MB/sec
symon cerberus 478 MB/sec Varied ~300 t0 ~700
symon storage 817 MB/sec
symon minecraft 867 MB/sec Varied 472 to 1210
minecraft symon 1250 MB/sec

In my case, it appears vmx performance varies widely, and em performance
is generally good.  Let me know if you want any other combinations tested.