[ZODB-Dev] Storage Benchmarks

[Barry A. Warsaw]

>>>>> "TD" == Toby Dickenson <tdickenson@geminidataloggers.com> writes:

    TD> Im most familiar with BerkeleyStorage Full, where the memory
    TD> usage issues come from using a python dictionary with one
    TD> element per object in the database.... obviously not a
    TD> scalable strategy.

The current Full.pack() implementation is geared toward
lock-friendliness while packing; i.e. other work can proceed while
packing is taking place.  We could do pack more efficient memory-wise
if we didn't have this constraint, but then pack will make the
database inaccessible for a long time.

It's possible that the (although doubtful) that pack can be sped up
if we're successful in implementing the blob limitation workaround.
It's certainly worth revisiting.

-Barry