[Xen-users] Xen and networking.

To:	xen-users@xxxxxxxxxxxxxxxxxxx
Subject:	[Xen-users] Xen and networking.
From:	tmac <tmacmd@xxxxxxxxx>
Date:	Fri, 28 Dec 2007 15:28:07 -0500
Delivery-date:	Fri, 28 Dec 2007 12:28:37 -0800
Dkim-signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; bh=Y0gp4AUfE5H4l/MvjWs4pRN4ArbHaRZgsMD4Ar9NA/s=; b=n4NXYtWjK2mPMIofGgkJeUrTsSqGVQnfzJFI2yqdSgsHIv71FQf9cJXPWtJh6bmZJptVJE45x+lp8Ld5piykDMaDoOup5XIlBQvACdc85fRRxtlr7Zf/qZz9ErhkdNfS9Zr9bClcQC6oI1/BIT4nnErFB3bKsNvCv0fJGnRbj5Y=
Domainkey-signature:	a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=Y6qFmxui8+9iTJMUXocBVWCg4R5ap5mxLGnHdCNb+VPJ0T2y4HP6P2ydkjarnsnAVOFnduNp0ulRpvOUCSVpqGC9QSH48MWC/qVGTKUNpVOcVegs3ocjS1qc3MjIEwFVa4r/d5AeV6rC+lw8P7PQGKRWjNILjZwbmLUn3xyxN+Q=
Envelope-to:	www-data@xxxxxxxxxxxxxxxxxx
List-help:	<mailto:xen-users-request@lists.xensource.com?subject=help>
List-id:	Xen user discussion <xen-users.lists.xensource.com>
List-post:	<mailto:xen-users@lists.xensource.com>
List-subscribe:	<http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe:	<http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
Sender:	xen-users-bounces@xxxxxxxxxxxxxxxxxxx

I have a beefy machine
(Intel dual-quad core, 16GB memory 2 x GigE)

I have loaded RHEL5.1-xen on the hardware and have created two logical systems:
4 cpus, 7.5 GB memory 1 x Gige

Following RHEL guidelines, I have it set up so that eth0->xenbr0 and
eth1->xenbr1
Each of the two RHEL5.1 guests uses one of the interfaces and this is
verified at the
switch by seeing the unique MAC addresses.

If I do a crude test from one guest over nfs,
dd if=/dev/zero of=/nfs/test bs=32768 count=32768

This yields almost always 95-100MB/sec

When I run two simultaneously, I cannot seem to get above 25MB/sec from each.
It starts off with a large burst like each can do 100MB/sec, but then
in a couple
of seconds, tapers off to the 15-40MB/sec until the dd finishes.

Things I have tried (installed on the host and the guests)

 net.core.rmem_max = 16777216
 net.core.wmem_max = 16777216
 net.ipv4.tcp_rmem = 4096 87380 16777216
 net.ipv4.tcp_wmem = 4096 65536 16777216

 net.ipv4.tcp_no_metrics_save = 1
 net.ipv4.tcp_moderate_rcvbuf = 1
 # recommended to increase this for 1000 BT or higher
 net.core.netdev_max_backlog = 2500
 sysctl -w net.ipv4.tcp_congestion_control=cubic

Any ideas?


-- 
--tmac

RedHat Certified Engineer #804006984323821 (RHEL4)
RedHat Certified Engineer #805007643429572 (RHEL5)

Principal Consultant, RABA Technologies

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users