[ZODB-Dev] Re: ZODB Benchmarks

[Roché Compaan]

On Fri, 2007-11-02 at 16:00 +0000, Laurence Rowe wrote:
> Matt Hamilton wrote:
> > David Binger <dbinger <at> mems-exchange.org> writes:
> > 
> >>
> >> On Nov 2, 2007, at 6:20 AM, Lennart Regebro wrote:
> >>
> >>> Lots of people don't do nightly packs, I'm pretty sure such a process
> >>> needs to be completely automatic. The question is weather doing it in
> >>> a separate process in the background, or ever X transactions, or every
> >>> X seconds, or something.
> >> Okay, perhaps the trigger should be the depth of the small-bucket tree.
> > 
> > That may just end up causing delays periodically in transactions... ie delays
> > that the user sees, as opposed to doing it via another thread or something.  But
> > then as only one thread would be doing this at a time it might not be too bad.
> > 
> > -Matt
> 
> ClockServer sections can now be specified in zope.conf. If you specify 
> them with a period of say 10 mins (or even 2) then the queue should 
> never get too large, and the linear search time is not a problem as n is 
> small.
> 
> Essentially you end up with a solution very similar to QueueCatalog but 
> with the queue being searchable.
> 
> The pain is then in modifying all of the indexes to search the queue in 
> addition to their standard data structures.

I don't think that you need to modify the indexes at all. You simply
pass the query arguments to the queue in the exact same way that you
apply the arguments to individual indexes.

I think with a little enhancement to QueueCatalog one should be able to
pull this off.

-- 
Roché Compaan
Upfront Systems                   http://www.upfrontsystems.co.za