Xen 
 
Home About Xen.org Xen Xen Summit Wiki Mailing List Bug Tracker Xen Downloads
 
   
 

xen-devel

Re: [Xen-devel] xend / xenstored performance & scalability issues

To: Keir Fraser <Keir.Fraser@xxxxxxxxxxxx>
Subject: Re: [Xen-devel] xend / xenstored performance & scalability issues
From: "Daniel P. Berrange" <berrange@xxxxxxxxxx>
Date: Thu, 12 Oct 2006 15:46:17 +0100
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Thu, 12 Oct 2006 07:47:28 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <C15410C8.26E0%Keir.Fraser@xxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <20061012141638.GA6878@xxxxxxxxxx> <C15410C8.26E0%Keir.Fraser@xxxxxxxxxxxx>
Reply-to: "Daniel P. Berrange" <berrange@xxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mutt/1.4.1i
On Thu, Oct 12, 2006 at 03:33:28PM +0100, Keir Fraser wrote:
> On 12/10/06 15:16, "Daniel P. Berrange" <berrange@xxxxxxxxxx> wrote:
> 
> >   1. Why the need for xenstored to be doing any of this I/O in the first
> > place?
> >      If the DB needs to be kept on disk at all, it really needs to have a 
> > much
> >      saner update/transactional model to only update bits which actually
> > change,
> >      rather than re-creating the entire DB on every transaction.
> >      But it strikes me that the DB could potentially be kept entirely in
> > memory
> >      removing the disk I/O completely. Sure yyou wouldn't be able to restart
> >      the daemon then, but even today you can't restart xenstored & expect
> > things
> >      to still be working.
> 
> We plan to keep transactional state in memory, and commit to tdb only on
> transaction completion. In which case you'll be able to achieve what you
> describe above by keeping the tdb file in a ramdisk. I suspect that'll turn
> out to be unnecessary and once we keep a persistent handle on a single tdb
> file and only update what has changed, we'll find the buffer cache will work
> quite nicely.

Agreed,that sounds like it ought to be able to significantly reduce overhead
without neccessarily needing to go to a purely memory backed storage.

Regards,
Dan.
-- 
|=- Red Hat, Engineering, Emerging Technologies, Boston.  +1 978 392 2496 -=|
|=-           Perl modules: http://search.cpan.org/~danberr/              -=|
|=-               Projects: http://freshmeat.net/~danielpb/               -=|
|=-  GnuPG: 7D3B9505   F3C9 553F A1DA 4AC2 5648 23C1 B3DF F742 7D3B 9505  -=| 

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel