[Zope] Library for huge text indexes ..

Jean Jordaan jean@upfrontsystems.co.za
Wed, 29 May 2002 16:56:01 +0200


Just spotted this and wondered if it might be of interest to people
working on Zope's indexing capacity .. 

http://www.gnu.org/software/mifluz/description.en.html

The purpose of GNU mifluz is to provide a C++ library to build and 
query a full text inverted index. It is dynamically updatable, 
scalable (up to 1Tb indexes), uses a controlled amount of memory, 
shares index files and memory cache among processes or threads and 
compresses index files to 50% of the raw data. The structure of the 
index is configurable at runtime and allows inclusion of relevance 
ranking information. The query functions do not require to load all 
the occurences of a searched term. They consume very few resources 
and many searches can be run in parallel. 

-- 
Jean Jordaan
Upfront Systems                         http://www.upfrontsystems.co.za