[ZODB-Dev] Re: [Zope3-dev] Re: Community opinion about search+filter

Adam Groszer agroszer at gmail.com
Sun Mar 25 03:01:46 EDT 2007


Hello Martijn,

I think that would give a great GSOC project.
The subject is well contained, knownledge might be ported from RDB
and/or AdvancedQuery.

Thursday, March 15, 2007, 7:04:03 PM, you wrote:

MF> Hello,

MF> Adam Groszer wrote:
>> I'd like to ask your opinion, your experiences about searching and
>> filtering in quite large object DBs.
>> We need to add search and filter functions to our current app, where
>> the user might be able to create quite _sophisticated_ filter criterias.
>> (The app is a pure Z3 app, subject is document management)
>> 
>> Currently we're looking at something based on catalog/indexes.
>> As I checked the most comfortable solution would be based on
>> hurry.query.
>> Some questions arose:
>> - Is it necessary/worth adding indexes on all attributes?
>> - How does the index perform on modification and retrieval?
>> 
>> The biggest problem is that this will be our first try, so we're
>> missing experiences and are a bit puzzled about the right solution.
>> Certain is that moving to RDB is not an option.

MF> I think one of the main limitations of the current catalog (and 
MF> hurry.query) is efficient support for sorting and batching the query 
MF> results. The Zope 3 catalog returns all matching results, which can then
MF> be sorted and batched. This will stop being scalable for large 
MF> collections. A relational database is able to do this internally, and is
MF> potentially able to use optimizations there.

MF> It would be very nice if someone could look into expanding hurry.query
MF> and/or the catalog to support these cases. It would be interesting to 
MF> look at what Dieter Maurer has done with AdvancedQuery in Zope 2 in this
MF> regard as well.

MF> Regards,

MF> Martijn


MF> _______________________________________________
MF> Zope3-dev mailing list
MF> Zope3-dev at zope.org
MF> Unsub:
MF> http://mail.zope.org/mailman/options/zope3-dev/agroszer%40gmail.com



-- 
Best regards,
 Groszer Adam
--
Quote of the day:
Evil is only good perverted. 
- Henry Wadsworth Longfellow 



More information about the ZODB-Dev mailing list