<div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="gmail_quote">That is after having run the 'preloading'. It seems that when the query takes forever, the non-ghost-size is slowly increasing (~100 objects/second) while the 'size' stays the same. Once the query is done after having taken a few minutes, each subsequent run is instant and the ngsize doesn't grow. My naive question is: it has plenty of RAM, why does it not just load everything into the RAM? <br>
</div></blockquote><div><br></div><div>It's actually not <i>that </i>slow - I didn't realize that everything seems to stop while it's asking for cacheDetailSize. It seems to load about 10000 objects/minute, most of these being <span style="white-space:pre-wrap">IFTreeSet/IFSet. This seems a bit slow... if the index db has 750k objects in it, then it would take 75 minutes, at this rate, to read through it all, meaning an extensive query would really take way too long... </span></div>
<div><span style="white-space:pre-wrap"><br></span></div><div><span style="white-space:pre-wrap">Also my ZEO server is running locally, anyway, so the local socket transfer speed shouldn't really be much slower than loading from the persistent cache, should it? Either way it ends up loading from disk.</span></div>
<div><span style="white-space:pre-wrap"><br></span></div><div><span style="white-space:pre-wrap">I don't quite understand why the zeoserver doesn't have any sort of caching... </span><span style="white-space:pre-wrap">hence my earlier thoughts of a memcachedb server to load all this in RAM and to just run forever. Why would it not be a win in my situation? </span></div>
<div><span style="white-space:pre-wrap"><br></span></div><div><span style="white-space:pre-wrap">I'm pretty new to zodb so perhaps I don't understand a lot of the design decisions very well and thus how best to take advantage of zodb, but I'm willing to learn.</span></div>
<div><span style="white-space:pre-wrap"><br></span></div><div><span style="white-space:pre-wrap">- Claudiu</span></div></div>