I was having this same issue. Persistent caching helped a little bit but not<div>too much. I didn't end up implementing this but ultimately the best thing to do</div><div>seemed to be to have a different server with a different zodb that only</div>
<div>handles indexing. That way it will never restart and lose its cache. The downside</div><div>is you have to figure out a way to communicate between the two servers. </div><div>Maybe a clean way would be to use the multiprocessing module somehow.</div>
<div><div><br><div class="gmail_quote">On Thu, Mar 7, 2013 at 1:54 PM, Roché Compaan <span dir="ltr"><<a href="mailto:roche@upfrontsystems.co.za" target="_blank">roche@upfrontsystems.co.za</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
We have a setup that is running just fine when the caches are warm but<br>
it takes several minutes after a restart before the cache warms up.<br>
As per usual, big catalog indexes seem to be the problem.<br>
<br>
I was wondering about two things. Firstly, in 2011 in this thread<br>
<a href="https://mail.zope.org/pipermail/zodb-dev/2011-October/014398.html" target="_blank">https://mail.zope.org/pipermail/zodb-dev/2011-October/014398.html</a><br>
about zeo.memcache, Shane said that he could adapt the caching code in<br>
RelStorage for ZEO. Shane do you still plan to do this? Do you think<br>
an instance can restart without having to reload most objects into the<br>
cache?<br>
<br>
Secondly, I was wondering to what extent using persistent caches can<br>
improve cache warm up time and if persistent caches are usable or not,<br>
given that at various times in the past, it was recommended that one<br>
try and avoid them.<br>
<br>
--<br>
Roché Compaan<br>
Upfront Systems <a href="http://www.upfrontsystems.co.za" target="_blank">http://www.upfrontsystems.co.za</a><br>
_______________________________________________<br>
For more information about ZODB, see <a href="http://zodb.org/" target="_blank">http://zodb.org/</a><br>
<br>
ZODB-Dev mailing list - <a href="mailto:ZODB-Dev@zope.org">ZODB-Dev@zope.org</a><br>
<a href="https://mail.zope.org/mailman/listinfo/zodb-dev" target="_blank">https://mail.zope.org/mailman/listinfo/zodb-dev</a><br>
</blockquote></div><br></div></div>