[Zope-CMF] storing in ZODB vs filesystem

alan runyan alan runyan" <runyaga@runyaga.com
Sat, 24 Aug 2002 12:39:09 -0500


There are reported ZODB's that are tens of gigabytes.  I think some guys
from blue dynamics were going to see populate the ZODB w/ several hundred
gigabytes to see the repercussions of the initial loading of data.

If you are going to go down the road of Filesystem but stay inside the ZOPE
system the most likely thing to look at is Shanes AdaptedStorage (?)
in CVS.  I'm not sure on how well baked it is...  There is also
Toby Dickersons amazing DirectoryStorage that can be found at sourceforge.

~runyaga

> > That would involve a lot of document upload.
> > Can some one advice me on whether its wise to store all the documents 
> > as zope does
> > by default into the database or store the file on to some place in the 
> > file system.
> 
> 
> Do the easiest thing first, and then if that is to slow, change your 
> approach. Right now you are trying to solve a problem you don't have.
> 
> > I have a feeling that storing all the documents in the database might 
> > slow down the database!
> 
> 
> There are several projects with a database size in the Gigabyte range.
> 
> But if you are in doubt about the systems ability to handle a lot of 
> files, why don't you just write a script that fills the database with a 
> lot of files and see how it reacts? Beware that you got to write them 
> one at a time as the Zodb needs to make a commit once in a while to be 
> efficient..
> 
> 
> regards Max M
> 
>     "klaatu verata niktu"
> 
> 
> 
> 
> _______________________________________________
> Zope-CMF maillist  -  Zope-CMF@zope.org
> http://lists.zope.org/mailman/listinfo/zope-cmf
> 
> See http://collector.zope.org/CMF for bug reports and feature requests
>