[Checkins] [zopefoundation/Products.ZCTextIndex] 232ee1: Merged TextIndexDS9-branch into trunk.

GitHub noreply at github.com
Tue Feb 26 14:15:27 UTC 2013


  Branch: refs/heads/zope2
  Home:   https://github.com/zopefoundation/Products.ZCTextIndex
  Commit: 232ee1ad34d2ea50c9cb0b327493278f12a95ef6
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/232ee1ad34d2ea50c9cb0b327493278f12a95ef6
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    A HTMLSplitter.py
    A IIndex.py
    A ILexicon.py
    A INBest.py
    A IPipelineElement.py
    A IQueryParser.py
    A ISplitter.py
    A Index.py
    A Lexicon.py
    A NBest.py
    A OkapiIndex.py
    A ParseTree.py
    A QueryParser.py
    A RiceCode.py
    A Setup
    A StopDict.py
    A WidCode.py
    A ZCTextIndex.py
    A __init__.py
    A dtml/addLexicon.dtml
    A dtml/addZCTextIndex.dtml
    A dtml/manageZCTextIndex.dtml
    A stopper.c
    A tests/__init__.py
    A tests/hs-tool.py
    A tests/indexhtml.py
    A tests/mailtest.py
    A tests/mhindex.py
    A tests/testIndex.py
    A tests/testLexicon.py
    A tests/testNBest.py
    A tests/testQueryEngine.py
    A tests/testQueryParser.py
    A tests/testZCTextIndex.py
    A tests/wordstats.py

  Log Message:
  -----------
  Merged TextIndexDS9-branch into trunk.


  Commit: 8c92fcc2479e8f76b4718e7d1a481fa7326082e7
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/8c92fcc2479e8f76b4718e7d1a481fa7326082e7
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M WidCode.py

  Log Message:
  -----------
  There's no point in encoding the number of continuation bytes in the
first byte -- we always find the end of a particular encoded number by
searching for the next byte with the high bit set.  This simplifies
the encoding and gives us more space for small encodings: 128 values
can now be encoded in 1 byte, and 16K in 2 bytes.


  Commit: c39676a63a740bf09d2b7a9b73b563b4b299e66d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c39676a63a740bf09d2b7a9b73b563b4b299e66d
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M OkapiIndex.py

  Log Message:
  -----------
  Fix _union() -- it wasn't getting what it expected from pop_smallest()
inside the while loop either.


  Commit: cf9981dbd4cb77f6c8f2eefd9f5f93fd2a89e0a7
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/cf9981dbd4cb77f6c8f2eefd9f5f93fd2a89e0a7
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    A tests/testStopper.py

  Log Message:
  -----------
  Add test cases for the C version of StopWordRemover.


  Commit: 2c33691adb9886c7b9baba4ff2517cdab0491707
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/2c33691adb9886c7b9baba4ff2517cdab0491707
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M WidCode.py

  Log Message:
  -----------
  Remove an obsolete comment.


  Commit: f16cc3bdbaee1fecc2a29b1ed5a3b3ce0bbfd23e
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f16cc3bdbaee1fecc2a29b1ed5a3b3ce0bbfd23e
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M Index.py
    M Lexicon.py
    M ZCTextIndex.py
    M __init__.py
    M dtml/addLexicon.dtml
    M dtml/addZCTextIndex.dtml

  Log Message:
  -----------
  Integration with Zope complete. ZCTextIndex is now a bonafide Plug-in index.

Some additional plug-in index APIs were added to ZCTextIndex and support APIs added to Index and Lexicon.

_apply_index does not use NBest since ZCatalog has an incompatible strategy for finding the top results. NBest might be abstracted from this product for general consumption in application code.


  Commit: 9a3f200e6d538abdd59f2bdcf0f6c3d999946f05
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/9a3f200e6d538abdd59f2bdcf0f6c3d999946f05
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Removed nbest query option, since it is not supported.


  Commit: 91c65cc6a72e1f3b3474ccc804536c2a85d93159
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/91c65cc6a72e1f3b3474ccc804536c2a85d93159
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M __init__.py
    A www/index.gif
    A www/lexicon.gif

  Log Message:
  -----------
  Added ZMI icons for index and lexicon objects.


  Commit: 69b341a96bd031f987ac8fad80b008c9d33d562e
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/69b341a96bd031f987ac8fad80b008c9d33d562e
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Added clear method to comply with plug-in index API.


  Commit: cd7b323e70bc19bd759d1e88b819c50d47352041
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/cd7b323e70bc19bd759d1e88b819c50d47352041
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  Add a comment about some of the data structures.


  Commit: c6c9bfbf4b554866f7d0a319d849cfaf3e3dc6d5
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c6c9bfbf4b554866f7d0a319d849cfaf3e3dc6d5
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Some cosmetic changes

Re-order imports so that all Zope imports go together and are separate
from all the ZCTextIndex imports.

Reformat _apply_index() doc string to use std Python style, which is
one-line summary followed by paragraphs of text that start at the same
offset as the function name.

Do comparison of None using is instead of ==.


  Commit: 2d00ddeebddcaa7244fcafea0c63f27df9d925e6
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/2d00ddeebddcaa7244fcafea0c63f27df9d925e6
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M HTMLSplitter.py

  Log Message:
  -----------
  Use underscore for internal methods


  Commit: 62a9e30be901361adcdeb684b7209c65086448bb
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/62a9e30be901361adcdeb684b7209c65086448bb
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M NBest.py

  Log Message:
  -----------
  Consistently use a single leading underscore for instance variable
names.


  Commit: 5d10ac73f2df7c74e96b59706aff3488c99c8789
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5d10ac73f2df7c74e96b59706aff3488c99c8789
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  Coding convention update: avoid use of "__" prefix for instance vars.


  Commit: f2a2191502d6021ecbea3f5e57e129498a9db245
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f2a2191502d6021ecbea3f5e57e129498a9db245
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M ZCTextIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Make OkapiIndex the default index.

ZCTextIndex has grown a new argument with a default value that can be
used to specify an Index class to use.  The default is OkapiIndex.Index.

There is a little kludge to make the test succeed.
testZCTestIndex.IndexTests uses the Index.Index tests instead of
OkapiIndex.Index.  Tim will probably fix this.


  Commit: 40c74fddd9548041f3623abf0ffa7cdca2c37666
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/40c74fddd9548041f3623abf0ffa7cdca2c37666
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M HTMLSplitter.py

  Log Message:
  -----------
  Remove _ in call to a string's split() method.

A little overzealous in the last checkin.


  Commit: d0e498dcbd240d4c161feb46ca9c20af7188e841
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d0e498dcbd240d4c161feb46ca9c20af7188e841
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    A tests/python.txt

  Log Message:
  -----------
  add some examples of what google and ultraseek return for queries of
www.python.org.

next step is to add queries using ZCTextIndex


  Commit: 6aadf5a11421ecc327feaaca76c126257d17f44b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6aadf5a11421ecc327feaaca76c126257d17f44b
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    A SetOps.py
    A tests/testSetOps.py

  Log Message:
  -----------
  Squash bug duplication by moving the clever mass-union and mass-
intersection gimmicks into their own functions with their own test suite.

This turned up two bugs:

1. The mass weighted union gimmick was incorrect when passed a list with
   a single mapping.  In that case, it neglected to multiply the mapping
   by the given weight.

2. The underlying weighted{Intersection, Union} code does something crazy
   if you pass it weights less than 0.  I had vaguely hoped to be able
   to subtract scores by passing 1 and -1 as weights, but this doesn't
   work.  It's hard to say exactly what it does then.  The line
       weightedUnion(IIBTree(), mapping, 1, -2)
   seems to return a mapping with the same keys, but *all* of whose
   values are -2, regardless of the original mapping's values.


  Commit: 81933dbd082609999fa85c105c24bd0b9847c078
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/81933dbd082609999fa85c105c24bd0b9847c078
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M Index.py
    M OkapiIndex.py

  Log Message:
  -----------
  Use the new SetOps for mass union/intersection.


  Commit: f4dca1c2ba69defe2e5b0917ec94d5251f04b5c9
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f4dca1c2ba69defe2e5b0917ec94d5251f04b5c9
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M ParseTree.py

  Log Message:
  -----------
  Use the new SetOps for mass union/intersection.


  Commit: ea65603b7aa644b9342964f356b95160a82b0909
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ea65603b7aa644b9342964f356b95160a82b0909
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M tests/testSetOps.py

  Log Message:
  -----------
  Simplified testPairs() a tad.


  Commit: a858091db534b95982269f1c570ae1c0e2485b58
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a858091db534b95982269f1c570ae1c0e2485b58
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M OkapiIndex.py

  Log Message:
  -----------
  This no longer needs NBest.


  Commit: 693f3895ba769ed7e44fa491b9b9081304dc7d41
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/693f3895ba769ed7e44fa491b9b9081304dc7d41
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M tests/testSetOps.py

  Log Message:
  -----------
  New testMany() -- a meatier test of the mass set ops.


  Commit: bb5119b93cea996e1814cc5f87bfabcd2fd4dab2
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/bb5119b93cea996e1814cc5f87bfabcd2fd4dab2
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M HTMLSplitter.py
    M Lexicon.py
    M RiceCode.py
    M ZCTextIndex.py
    M tests/hs-tool.py
    M tests/indexhtml.py
    M tests/testQueryParser.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Whitespace normalization.


  Commit: 9526a1ba81ee8d0656b4f1a6ddd3f9e1fa3fe527
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/9526a1ba81ee8d0656b4f1a6ddd3f9e1fa3fe527
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-14 (Tue, 14 May 2002)

  Changed paths:
    M OkapiIndex.py

  Log Message:
  -----------
  More comments and small cleanups & rearrangements.  No semantic changes
(unless I erred ...).


  Commit: 22eb625a6739a00973afb2d5ba8ba92b9fdb9971
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/22eb625a6739a00973afb2d5ba8ba92b9fdb9971
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  Keep some statistics about indexing: total number of bytes and words
indexed (where the bytes are counted before entry into the pipeline,
and the words are counted after the pipeline is done).  To get the
numbers, use the _nbytes and _nwords instance variables directly.


  Commit: 670622b9e2a160a244c0b0bd5ec5b07aef2e3235
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/670622b9e2a160a244c0b0bd5ec5b07aef2e3235
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Report Lexicon statistics after bulk indexing.


  Commit: 4e9ee958e3f22c814c398882876823d2499e1a15
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/4e9ee958e3f22c814c398882876823d2499e1a15
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M OkapiIndex.py
    M ZCTextIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Okapi index now works w/zope.

Removed QueryParser as a persistent attribute of the ZCTextIndex so that
it doesn't need to be persistent (It stores no state).

Updated tests. Functionally tested in Zope.


  Commit: eb857f02eac5da26b573e391e5ed938a1c2b98b9
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/eb857f02eac5da26b573e391e5ed938a1c2b98b9
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M ZCTextIndex.py
    M tests/indexhtml.py
    M tests/mailtest.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Change query() method of ZCTextIndex to return nbest, num.

Otherwise, there's no way to report the total number of matches from
which the nbest were selected.

I changed all the functional tests that I knew how to fix, but not the
mhindex stuff.  All unit tests pass.


  Commit: 00afc0599f9f1367b05302cf17e7d9cad5b279b1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/00afc0599f9f1367b05302cf17e7d9cad5b279b1
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    A tests/queryhtml.py

  Log Message:
  -----------
  Add a test script that runs a bunch of queries with AND and OR.

It prints the the results and a summary of the times for the last 10
of 11 trials.


  Commit: a1156e754d74a2a38f06abde9232ea8e765e41e3
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a1156e754d74a2a38f06abde9232ea8e765e41e3
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  clear():  was ignoring the index_factory passed to the constructor,
reinitializing to the global Index even if that wasn't how the object
was constructed.


  Commit: 5ec865948167927404caa2e573e96e4bd4a3a6e9
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5ec865948167927404caa2e573e96e4bd4a3a6e9
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M Index.py

  Log Message:
  -----------
  Changed module docstring to make clear that this is a cosine index.


  Commit: 78d526a0a8049e8c6b89efa129b2120abcff7bc8
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/78d526a0a8049e8c6b89efa129b2120abcff7bc8
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M OkapiIndex.py
    M tests/testIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  testIndex.py now runs exactly the same tests on both the cosine indexer
and the Okapi indexer.  testZCTextIndex was, and remains, strongly tied
to the cosine indexer.


  Commit: d944180cf6ceafc14e9d33c9ee6f84ac13257cd1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d944180cf6ceafc14e9d33c9ee6f84ac13257cd1
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M tests/testIndex.py

  Log Message:
  -----------
  Both check_docid_known() instance:  assert that the value associated
with the docid is greater than 0 too.


  Commit: d55ba9e43e54b35252714c4c5d745c3ed8c9a819
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d55ba9e43e54b35252714c4c5d745c3ed8c9a819
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M tests/queryhtml.py

  Log Message:
  -----------
  Whitespace normalization.


  Commit: b643ff9d9c622a70be6d3dd2fef4dfd02fdd0b00
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/b643ff9d9c622a70be6d3dd2fef4dfd02fdd0b00
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Run the Query tests on the Okapi indexer as well as the cosine indexer.


  Commit: 227082fe0cd49411a1686fb9f9e1f0a4f5029b71
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/227082fe0cd49411a1686fb9f9e1f0a4f5029b71
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Fairly massive rearrangement to allow the Okapi indexer to reuse
testStopWords().  That isn't the real point.  The real point is to
fiddle the scaffolding enough to make it possible to run a white box
test of the Okapi indexer too.  That isn't here yet.


  Commit: 22707768933918696c3079e0ab3e48e8eebd52e2
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/22707768933918696c3079e0ab3e48e8eebd52e2
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-15 (Wed, 15 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Added some rather good white-box and black-box tests for Okapi
internals.


  Commit: 0eea0682c5c16b66238bba5fc0d3b32e424092e8
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/0eea0682c5c16b66238bba5fc0d3b32e424092e8
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Move query() and numObjects() above comment about pluggable index API.


  Commit: cd46f42b8920d09efa1234287b4a8b0075eb19ae
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/cd46f42b8920d09efa1234287b4a8b0075eb19ae
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    A CosineIndex.py
    R Index.py
    M tests/testIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Renamed Index.py to CosineIndex.py


  Commit: 7e6cdfff9ebafa6171e8b63d2c4783cdacc93f8b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/7e6cdfff9ebafa6171e8b63d2c4783cdacc93f8b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py
    M OkapiIndex.py
    M tests/mhindex.py
    M tests/testIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Renamed Index.py to CosineIndex.py


  Commit: 0c561da72fe37a1ee4fc591c48df6d2e162091ce
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/0c561da72fe37a1ee4fc591c48df6d2e162091ce
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M ZCTextIndex.py
    M tests/mhindex.py

  Log Message:
  -----------
  Rename the Index classes to OkapiIndex and CosineIndex, respectively.


  Commit: f94baf28c2b50c95a66a9709aa2f948fa0901ba0
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f94baf28c2b50c95a66a9709aa2f948fa0901ba0
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py
    M Lexicon.py
    M OkapiIndex.py
    M SetOps.py
    M ZCTextIndex.py
    M tests/mhindex.py
    M tests/testLexicon.py

  Log Message:
  -----------
  Fix queries of the form 'extension module C'.


  Commit: c02fceecb2ba3abd64e450b6c615e6a51fa707a5
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c02fceecb2ba3abd64e450b6c615e6a51fa707a5
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py

  Log Message:
  -----------
  Try to handle the case where a wid has no wordinfo.

This case can arise when the last occurence of a word is removed, or
when a lexicon is shared across multiple indexes.

XXX Not sure this code is correct, but it might be and the tests pass.
If it's wrong, we need more tests.


  Commit: a69f7ace7571a946239b90826a81e3effcb93a5c
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a69f7ace7571a946239b90826a81e3effcb93a5c
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M tests/indexhtml.py

  Log Message:
  -----------
  Add some options to make indexhtml work with TextIndex


  Commit: 294f0de2bc983d572685b4da196824bf7205c57a
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/294f0de2bc983d572685b4da196824bf7205c57a
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M tests/queryhtml.py

  Log Message:
  -----------
  Produce HTML output instead of text output


  Commit: 5ff679ed92a08c6eec584003c9a09f3f4aa13edb
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5ff679ed92a08c6eec584003c9a09f3f4aa13edb
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Add an incorrect test of reindexing.

If we update a document and reindex it, ZCTextIndex is currently
broken.  The test passes py virtue of calling unindex_object() after
each update, then calling index_object() again.  We need to fix our
code, and then remove the calls to unindex_object() from the test.

XXX This code causes OkapiIndex to fail because it doesn't expect to
have no wordinfo for a wid.  I tried to fix this in CosineIndex, but I
want to Tim think more about it and try to fix OkapiIndex.


  Commit: 48deb36fcba9e4bb6ca01c6aee3eeec270f2a845
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/48deb36fcba9e4bb6ca01c6aee3eeec270f2a845
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  Comment the special status of wid 0.

globToWordIds():  This was building a list of words and then throwing
it away without referencing it.  Deleted the code.


  Commit: 0eb555490b54173e34530c7cf0b5c75080f99031
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/0eb555490b54173e34530c7cf0b5c75080f99031
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M OkapiIndex.py

  Log Message:
  -----------
  wid 0 isn't the only kind of OOV word possible, so change the search
logic to deal with all cases.  All the tests pass again.


  Commit: 3a345e19d2eea8748baa2d3a308b1b193f9939dc
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3a345e19d2eea8748baa2d3a308b1b193f9939dc
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    A BaseIndex.py
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  A tiny start at introducing a base class for the cosine and Okapi
indexers.

CAUTION:  I'm sure I don't understand how persistency needs to be spelled.
Is it enough to say just that the base class derives from Persistent, or
does that need to be duplicated (or done instead exclusively) in the
derived classes?

Is there a point to keeping "import ZODB" in the derived-class files?  Is
there a point to keeping it anywhere <wink>?


  Commit: e7a32f7040832831261e247e32c5dfc70ad53811
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/e7a32f7040832831261e247e32c5dfc70ad53811
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Pushed the subclassing far enough to be useful.  More is needed, but
I need a break.


  Commit: 53f93fe53bcf7182faca4f84466cb94720ee0499
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/53f93fe53bcf7182faca4f84466cb94720ee0499
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M OkapiIndex.py
    M tests/testIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  _get_undoinfo:  Got rid of this everywhere.  It was just a synonym for
get_words, and in calling contexts nothing but a list of wids could
possibly make sense.


  Commit: 46df9cce9875f7e7f21c4cd48fd1803d91e2813d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/46df9cce9875f7e7f21c4cd48fd1803d91e2813d
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M OkapiIndex.py
    M tests/testIndex.py

  Log Message:
  -----------
  Refactor/combine _docweight/_doclen.


  Commit: 3f6f48f3f9223677b9b53ec3317051dc1eb3116a
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3f6f48f3f9223677b9b53ec3317051dc1eb3116a
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py

  Log Message:
  -----------
  Some simplifications unique to the cosine index.


  Commit: 5e1a40ffca7e81cc34920b262e698f79c7d9bb57
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5e1a40ffca7e81cc34920b262e698f79c7d9bb57
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  These guys no longer use Persistence directly.


  Commit: e61b9d9fd23a1f2d0e1580d54141e535442fc910
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/e61b9d9fd23a1f2d0e1580d54141e535442fc910
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Compute inverse doc frequency the same way everywhere.


  Commit: 5d2064ddb5346a83ce8430c5c50567a1d9bc9bef
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5d2064ddb5346a83ce8430c5c50567a1d9bc9bef
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py
    M OkapiIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Compute scaled_int the same way everywhere.


  Commit: 467d5bbfdae860f79b1e647b0371d08fa82e1e35
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/467d5bbfdae860f79b1e647b0371d08fa82e1e35
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M IIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Combine _{add,del}wordinfo; make length() part of IIndex.


  Commit: 95f047aa710a6019d989777351a76689336b2540
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/95f047aa710a6019d989777351a76689336b2540
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M IIndex.py

  Log Message:
  -----------
  Documented that .search() has changed.


  Commit: 8da62047ccc4025cb9e081e362802f78ee4ec2d9
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/8da62047ccc4025cb9e081e362802f78ee4ec2d9
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M IIndex.py

  Log Message:
  -----------
  More docstring corrections.


  Commit: bce86b14cb4c3b9dfd0feb6f8d78a3f40326eb8d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/bce86b14cb4c3b9dfd0feb6f8d78a3f40326eb8d
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Changed something -- it can't be very important, because I already forgot.


  Commit: a5bf07e9067debf5030367956e4a1884778d68d8
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a5bf07e9067debf5030367956e4a1884778d68d8
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M IIndex.py

  Log Message:
  -----------
  Added get_words() to the interface.


  Commit: d919d0549dcef3ac8c212bc87de585d2dcee53bc
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d919d0549dcef3ac8c212bc87de585d2dcee53bc
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Factor out the code for unindexing a doc.  OkapiIndex has very little
code left in it!


  Commit: 27eb632e9f297b4b99a9efb0e3b20a256f8e9851
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/27eb632e9f297b4b99a9efb0e3b20a256f8e9851
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Remove unused imports.


  Commit: ce702761a269592f9d87acd6272c4bf7942d9d81
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ce702761a269592f9d87acd6272c4bf7942d9d81
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M CosineIndex.py

  Log Message:
  -----------
  Got rid of _add_undoinfo; it's clearer to do the one-liner inline.


  Commit: 94bbe5c3528b97c24fdd0d1342d0ca37647f6b14
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/94bbe5c3528b97c24fdd0d1342d0ca37647f6b14
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-16 (Thu, 16 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Factor out most of the code for indexing a doc.  The cosine index may
take longer to construct now; both indexers' _get_frequencies routines
were fiddled to return the same kind of stuff again, and I had
previously fiddled the cosine indexer's _get_frequencies to do something
weirder but (probably) faster than this.


  Commit: 0307d2679bdac254d45c7a687d23dcdd0650b837
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/0307d2679bdac254d45c7a687d23dcdd0650b837
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Moved a comment that got disconnected from its class.


  Commit: 73c279bb8764209a7dd4e7cc03b8303a81db82b7
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/73c279bb8764209a7dd4e7cc03b8303a81db82b7
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  testDocUpdate():  Thanks to stop-word removal, there weren't actually
*any* words in common across the versions.  Helped Will along by adding
a pragmatic comment to his "knocking indeed" rant.  Reworked to use
the inscrutable magic of dict.setdefault.


  Commit: c276f2bf70713536de6b7295a504a30a068f36c5
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c276f2bf70713536de6b7295a504a30a068f36c5
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Put an XXX on the important line.


  Commit: c70e654ecb34f76fecb21de3e1d6604e2b2f3269
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c70e654ecb34f76fecb21de3e1d6604e2b2f3269
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Remove more needless imports.


  Commit: 6e7888bd0c902edf6bfb475e559302098be65613
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6e7888bd0c902edf6bfb475e559302098be65613
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M BaseIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Implement correct (albeit inefficient) reindexing, and stop cheating
in the reindexing text.


  Commit: 6621f7162f10d69b968455fbc6f71c8fd55f630f
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6621f7162f10d69b968455fbc6f71c8fd55f630f
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  search_glob():  nuke the OOV wids (if any) before calling _search_wids.
It's possible to get OOV wids here due to words the lexicon knows
about that the index has no current instances of.


  Commit: 61fa4de6959228d2164f68a53c0513583a596410
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/61fa4de6959228d2164f68a53c0513583a596410
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M CosineIndex.py
    M OkapiIndex.py

  Log Message:
  -----------
  Remove redundant imports of ZODB.
A ZODB import is only redundant if it is not used and does not
precede an import from Persistence.


  Commit: 6d9ac115330e7dd82e4dbe32c5a04fe9c215a3f1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6d9ac115330e7dd82e4dbe32c5a04fe9c215a3f1
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Two changes and a question posing as a comment.

In unindex_doc() call _del_wordinfo() for each unique wid in the doc,
not for each wid.  Before we had WidCode and phrase searching,
_docwords stored a list of the unique wids.  The unindex code wasn't
updated when _docwords started storing all the wids, even duplicates.

Replace the try/except around __getitem__ in _add_wordinfo() with a
.get() call.

Add XXX comment about the purpose of the try/except(s) in
_del_wordinfo().  I suspect they only existed because _del_wordinfo()
was called repeatedly when a wid existed more than once.


  Commit: ee4915a187fe062eb426cbff0540e56370539a53
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ee4915a187fe062eb426cbff0540e56370539a53
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M CosineIndex.py

  Log Message:
  -----------
  Shorten comment so it fits on line.


  Commit: 18c5396b558872054a396bbdcd6a7a32ddf37e85
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/18c5396b558872054a396bbdcd6a7a32ddf37e85
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/indexhtml.py

  Log Message:
  -----------
  Make sure stop words are used with old TextIndex.

I think that the default Lexicon for TextIndex does not use a stop
word list.  For the comparison with ZCTextIndex, explicitly pass the
default stop word dict from TextIndex to the lexicon.


  Commit: 5f17295a1ae41b8794ba6de5a85177c306c9567a
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5f17295a1ae41b8794ba6de5a85177c306c9567a
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Implement unique using an IITreeSet as suggested by Tim.


  Commit: 9be9123d5f3d15272f40904858322c7b993d6dd6
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/9be9123d5f3d15272f40904858322c7b993d6dd6
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Improve OOV explanation, based on Guido's feedback.


  Commit: 77d01dbfe2377232691505549996bc7a6897425a
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/77d01dbfe2377232691505549996bc7a6897425a
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  _del_wordinfo():  Simplify.  It's the caller's responsibility to ensure that
the index knows about the doc and the wid.

_del_wordinfo and _add_wordinfo:  s/map/doc2score/g.  map is a builtin
function, and it's needlessly confusing to name a vrbl that too.


  Commit: 8bfe9b7c0b0e28d84eb31e4ece2573a956dc9a1b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/8bfe9b7c0b0e28d84eb31e4ece2573a956dc9a1b
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/indexhtml.py

  Log Message:
  -----------
  Add a little splitter that behaves pretty much like HTMLWordSplitter,
but works with a TextIndex Lexicon.


  Commit: 2e56b82b91c5fa7bc13754da38fc322e7bf09609
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/2e56b82b91c5fa7bc13754da38fc322e7bf09609
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M BaseIndex.py
    M OkapiIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Reindex docs touching as few docid->w(docid, w) maps as possible.


  Commit: 3a6a1ce63543733b36cdca6cb9990f093a16e534
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3a6a1ce63543733b36cdca6cb9990f093a16e534
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/queryhtml.py

  Log Message:
  -----------
  If -T is passed (query with old TextIndex), try as best as possible to
do the same query and work as ZCTextIndex would do.

Produce a result set, pump it into NBest, and extract the 10 best.


  Commit: 769a6cbd5c5b041b29923b8f3d41d82e144bde71
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/769a6cbd5c5b041b29923b8f3d41d82e144bde71
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Added a number of tests to trigger search-can-return-None bugs.  The three
tests that currently fail are currently commented out.

Key question:  If someone does a search on a stopword, and nothing else is
in the query, what do we want to do?  Return all docs in a random order?
Return no docs?  Raise an exception?

Second question:  What if someone does a query on

    rare_word AND NOT stop_word

?


  Commit: f53341c9d0b8844b513bb149d9fb0d1d30df1ad8
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f53341c9d0b8844b513bb149d9fb0d1d30df1ad8
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Added more little OOV query tests.


  Commit: 90e2fb9823819f467115886c6b4a63e58ac1e346
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/90e2fb9823819f467115886c6b4a63e58ac1e346
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  testDocUpdate():  assert that the common and unique wordsets aren't
empty.


  Commit: 3deedb76ce9eff4fdbde190e812487b4ddcb71b2
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3deedb76ce9eff4fdbde190e812487b4ddcb71b2
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M tests/indexhtml.py

  Log Message:
  -----------
  Use the same stop list for both indexes.


  Commit: 18f21df57aeeb9686fb155a70048cc8e944b164e
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/18f21df57aeeb9686fb155a70048cc8e944b164e
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-17 (Fri, 17 May 2002)

  Changed paths:
    M ParseTree.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Special-case None search() results in AND, AND NOT, and OR contexts, and
uncomment the test cases that were failing in these contexts.

Read it and weep <wink>:  In an AND context, None is treated like the
universal set, which jibes with the convenient fiction that stop words
appear in every doc.  However, in AND NOT and OR contexts, None is
treated like the empty set, which doesn't jibe with anything except that
we want

    real_word AND NOT stop_word

and

    real_word OR stop_word

to act like

    real_word

If we treated None as if it were the universal set, these results would
be (respectively) the empty set and the universal set instead.

At a higher level, we *are* consistent with the notion that a query with
a stop word acts the same as if the clause with the stop word weren't
present.  That's what really drives this schizophrenic (context-dependent)
treatment of None.


  Commit: b4e9fd6d07cddf796679070a7323cc724e9d35d5
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/b4e9fd6d07cddf796679070a7323cc724e9d35d5
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-18 (Sat, 18 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Display total pack time at the end.


  Commit: 091641b350c95cf55a81bc26b643c0d522295554
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/091641b350c95cf55a81bc26b643c0d522295554
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-18 (Sat, 18 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Pack at the end even if the # of msgs isn't an exact multiple of
PACK_INTERVAL.


  Commit: 00546ea424ab29be9e8b08074a2d8ec686672d62
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/00546ea424ab29be9e8b08074a2d8ec686672d62
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-18 (Sat, 18 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Revert braindead change to final pack (it was my change, so it's OK for
me to call it braindead <wink>).


  Commit: 687e3564784c2e59e541cebffdcfdabffadfac25
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/687e3564784c2e59e541cebffdcfdabffadfac25
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-18 (Sat, 18 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Restore CONTEXT to its original value.


  Commit: 63cfa322a0c359bb2d404145658726c68b88722a
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/63cfa322a0c359bb2d404145658726c68b88722a
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-18 (Sat, 18 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Rearrange the Okapi reindexing tests to make it easier to figure out what
went wrong if they fail.


  Commit: c74b0aff084d17434b39ae62147c331526bfcdd1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c74b0aff084d17434b39ae62147c331526bfcdd1
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-19 (Sun, 19 May 2002)

  Changed paths:
    M QueryParser.py
    M ZCTextIndex.py
    M tests/mhindex.py
    M tests/testQueryEngine.py
    M tests/testQueryParser.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  QueryParser refactoring step 1: add the lexicon to the constructor args.


  Commit: 215f48f09ba6bd58cf1672c8561fc938bf5f443c
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/215f48f09ba6bd58cf1672c8561fc938bf5f443c
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-19 (Sun, 19 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Beef up the reindexing tests to check that they actually fail before the
original doc text gets restored.


  Commit: dc5dad88799bbea03abc0606d922bf7e109ac800
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/dc5dad88799bbea03abc0606d922bf7e109ac800
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-19 (Sun, 19 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Oops!  Call the right routine (typo in code just checked in).


  Commit: 3700aeb301645f00695c410de1c636ae2c51c7d6
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3700aeb301645f00695c410de1c636ae2c51c7d6
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-19 (Sun, 19 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Gave it a "-c NNN" context argument (how many leading lines of result
msgs to display).  Changed the module docstring to separate the index-
generation args from the query args.


  Commit: 1c807f2e6c5f5630369dec07c7eb2075e9653f12
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/1c807f2e6c5f5630369dec07c7eb2075e9653f12
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-19 (Sun, 19 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Show index and pack times in minutes instead of seconds.  Show timestamps
for start and end of run.  Show elapsed wall-clock time in minutes.


  Commit: 88d095a8666885bd94d830b5d8fa0699a1658e63
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/88d095a8666885bd94d830b5d8fa0699a1658e63
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-19 (Sun, 19 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  For queries, show the total number of results as well as the nbest number;
display the search time in milliseconds too.


  Commit: fce24bd21619ffb6e64cd57c591518800186a52b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/fce24bd21619ffb6e64cd57c591518800186a52b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M ILexicon.py
    M IPipelineElement.py
    M IQueryParser.py
    M Lexicon.py
    M ParseTree.py
    M QueryParser.py
    M tests/testQueryParser.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Refactor the query parser to rely on the lexicon for parsing terms.

ILexicon.py:

  - Added parseTerms() and isGlob().

  - Added get_word(), get_wid() (get_word() is old; get_wid() for symmetry).

  - Reflowed some text.

IQueryParser.py:

  - Expanded docs for parseQuery().

  - Added getIgnored() and parseQueryEx().

IPipelineElement.py:

  - Added processGlob().

Lexicon.py:

  - Added parseTerms() and isGlob().

  - Added get_wid().

  - Some pipeline elements now support processGlob().

ParseTree.py:

  - Clarified the error message for calling executeQuery() on a
    NotNode.

QueryParser.py (lots of changes):

  - Change private names __tokens etc. into protected _tokens etc.

  - Add getIgnored() and parseQueryEx() methods.

  - The atom parser now uses the lexicon's parseTerms() and isGlob()
    methods.

  - Query parts that consist only of stopwords (as determined by the
    lexicon), or of stopwords and negated terms, yield None instead of
    a parse tree node; the ignored term is added to self._ignored.
    None is ignored when combining terms for AND/OR/NOT operators, and
    when an operator has no non-None operands, the operator itself
    returns None.  When this None percolates all the way to the top,
    the parser raises a ParseError exception.

tests/testQueryParser.py:

  - Changed test expressions of the form "a AND b AND c" to "aa AND bb
    AND cc" so that the terms won't be considered stopwords.

  - The test for "and/" can only work for the base class.

tests/testZCTextIndex.py:

  - Added copyright notice.

  - Refactor testStopWords() to have two helpers, one for success, one
    for failures.

  - Change testStopWords() to require parser failure for those queries
    that have only stopwords or stopwords plus negated terms.

  - Improve compareSet() to sort the sets of keys, and use a more
    direct way of extracting the keys.  This wasn't strictly needed
    (nothing fails without this), but the old approach of copying the
    keys into a dict in a loop depends on the dict hashing to always
    return keys in the same order.


  Commit: e6d2a512795f25aba3609810a4554bb600733593
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/e6d2a512795f25aba3609810a4554bb600733593
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M IIndex.py
    M INBest.py
    M IQueryParser.py
    M NBest.py
    M OkapiIndex.py
    M ParseTree.py
    M QueryParser.py
    M SetOps.py
    M __init__.py
    M tests/__init__.py
    M tests/testIndex.py
    M tests/testNBest.py
    M tests/testQueryEngine.py
    M tests/testQueryParser.py
    M tests/testSetOps.py

  Log Message:
  -----------
  Limit copyright to 2002; none of this code existed last year.


  Commit: 49dccce6e4d017f5cf74ef304cbaa57d57df5207
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/49dccce6e4d017f5cf74ef304cbaa57d57df5207
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M QueryParser.py

  Log Message:
  -----------
  Fix unintended recursion in parseQueryEx().  (Unittests are coming up!
:-)


  Commit: a1ab7a314ab0375bfc66e1453889ca836558ea4f
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a1ab7a314ab0375bfc66e1453889ca836558ea4f
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M QueryParser.py
    M tests/testQueryParser.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  QueryParser.py:

- Rephrased the description of the grammar, pointing out that the
  lexicon decides on globbing syntax.

- Refactored term and atom parsing (moving atom parsing into a
  separate method).  The previously checked-in version accidentally
  accepted some invalid forms like ``foo AND -bar''; this is fixed.

tests/testQueryParser.py:

- Each test is now in a separate method; this produces more output
  (alas) but makes pinpointing the errors much simpler.

- Added some tests catching ``foo AND -bar'' and similar.

- Added an explicit test class for the handling of stopwords.  The
  "and/" test no longer has to check self.__class__.

- Some refactoring of the TestQueryParser class; the utility methods
  are now in a base class TestQueryParserBase, in a different order;
  compareParseTrees() now shows the parse tree it got when raising an
  exception.  The parser is now self.parser instead of self.p (see
  below).

tests/testZCTextIndex.py:

- setUp() no longer needs to assign to self.p; the parser is
  consistently called self.parser now.


  Commit: 56d0b5a48290071017472bd2721407da2075e1d6
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/56d0b5a48290071017472bd2721407da2075e1d6
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M RiceCode.py

  Log Message:
  -----------
  Add Zope Copyright notice.
Fix typo in docstring.


  Commit: ce68b046148544086bf26a3a710f0a308476d9a7
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ce68b046148544086bf26a3a710f0a308476d9a7
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M HTMLSplitter.py
    M StopDict.py
    M WidCode.py
    M stopper.c

  Log Message:
  -----------
  Add Zope Copyright notice.


  Commit: 9467a2beecb12ff7ec26b006641e6aa18f5877bc
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/9467a2beecb12ff7ec26b006641e6aa18f5877bc
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  index_object(): don't die if obj doesn't have an attribute named
_fieldname; simply return 0 in this case.


  Commit: 5e924243494bb04c07708eeb5392d3f890b0acdf
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5e924243494bb04c07708eeb5392d3f890b0acdf
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  _apply_index(): return None when the query string is empty.

I'm unclear whether this is really the right thing, but at least this
prevents crashes when nothing is entered in the search box.


  Commit: 1a725ee3d4d796071a218cc552393c1a47e5ed1b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/1a725ee3d4d796071a218cc552393c1a47e5ed1b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M dtml/addLexicon.dtml

  Log Message:
  -----------
  Always have a splitter.  (We'll change this to a choice of splitters
once we have more than one on the menu.)


  Commit: 05bc9db5653fd002a3152c2a7b52fdfbc87a1abb
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/05bc9db5653fd002a3152c2a7b52fdfbc87a1abb
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  setUp(): assign the lexicon to self.lexicon directly rather than
creating it anonymously and then pulling it out of the zc_index
object.


  Commit: bd71f892e4d8a9599855d4adacfbc54848e60027
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/bd71f892e4d8a9599855d4adacfbc54848e60027
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-20 (Mon, 20 May 2002)

  Changed paths:
    M OkapiIndex.py
    M Setup
    A okascore.c

  Log Message:
  -----------
  Since I did the work to write the inner Okapi scoring loop in C, may as
well check it in.  This yields an overall 133% speedup on a "hot" search
for 'python' in my python-dev archive (a word that appears in all but
2 documents).  For those who read the email, turned out it was a
significant speedup to iterate over an IIBTree's items rather than to
materialize the items into an explicit list first.

This is now within 20% of simply doing "IIBucket(the_IIBTree)" (i.e.,
no arithmetic at all), so there's no significant possibility remaining
for speeding the inner score loop.


  Commit: 8be99afcde9348032c59a8c41fb173cfc8124989
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/8be99afcde9348032c59a8c41fb173cfc8124989
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  globToWordIds() shouldn't make assumptions about the pipeline.  It
still only supports a trailing *, so the pipeline should honor that;
added a comment to the Splitter class referring to globToWordIds().


  Commit: 58f0430fb5aa55b50222e6142c446170afd4c16d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/58f0430fb5aa55b50222e6142c446170afd4c16d
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  I figured out what numObjects() is for -- it is used by ZCatalog's
Index management screen.  Ditto for clear().  So group them together
and adjust the comment.  (So is manage_main, but since it's a DTML
method, it can stay in its separate UI group.)


  Commit: 6c372bb257cd4eba21a70e066b7509bf8088f17b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6c372bb257cd4eba21a70e066b7509bf8088f17b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  length() is used by ZCTextIndex.numWords() -- it is supposed to return
the number of words in the index (at least to return a number
comparable to the number displayed under "# objects" by TextIndex).


  Commit: fd58a774d33357444a6eac0d400253ccd677e73e
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/fd58a774d33357444a6eac0d400253ccd677e73e
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M okascore.c

  Log Message:
  -----------
  PyInt_FromLong() can fail, so check the return for NULL.


  Commit: d4456fba0b396b0d4404c9655af2d04d95e4761e
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d4456fba0b396b0d4404c9655af2d04d95e4761e
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M okascore.c

  Log Message:
  -----------
  Since every score is of the form (tf * idf * 1024. + .5), and idf is
loop-invariant, save a little time by multiplying idf by 1024. outside
the loop.


  Commit: cfd61ecbd213c2360f27258176951f537de1b440
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/cfd61ecbd213c2360f27258176951f537de1b440
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Normalize import statement formatting.


  Commit: 273fcb74cc88a7984e3215de9b6f0115e211999b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/273fcb74cc88a7984e3215de9b6f0115e211999b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Normalize import statement formatting.
Verify that ZCTextIndex implements the PluggableIndexInterface.


  Commit: 09d46d21a9266a8560ec13493a80e8e6a2982ead
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/09d46d21a9266a8560ec13493a80e8e6a2982ead
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Normalize import statement formatting.
Remove redundant import.
Ensure that ZCTextIndex implements the PluggableIndexInterface by
adding an unimplemented uniqueValues() method.


  Commit: 5d5e178347826e5eac33b88291a4da864b00cb35
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5d5e178347826e5eac33b88291a4da864b00cb35
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-21 (Tue, 21 May 2002)

  Changed paths:
    M okascore.c

  Log Message:
  -----------
  Just improved the comment at the top.


  Commit: 039ad577474bd7c6f159b8e594f4bb5744c8dbd9
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/039ad577474bd7c6f159b8e594f4bb5744c8dbd9
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M Lexicon.py
    M stopper.c
    M tests/testStopper.py

  Log Message:
  -----------
  Simplify the "stopper" helper module -- just define a simple function
instead of an extension type, and let StopWordRemover be a Python class
that uses the helper if available.


  Commit: 3c80576290bccbc5a6b1842cdadba37e952dbdb6
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3c80576290bccbc5a6b1842cdadba37e952dbdb6
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M dtml/addLexicon.dtml

  Log Message:
  -----------
  Oops!  Somehow the hidden input field didn't work.  Reverting the last checkin.


  Commit: 511e9183fe7dcb54adfed76ca8560b2037f2eb61
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/511e9183fe7dcb54adfed76ca8560b2037f2eb61
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M HTMLSplitter.py
    A IPipelineElementFactory.py
    M Lexicon.py
    A PipelineFactory.py
    M ZCTextIndex.py
    M __init__.py
    M dtml/addLexicon.dtml
    M dtml/addZCTextIndex.dtml
    A dtml/manageLexicon.dtml
    A tests/testPipelineFactory.py

  Log Message:
  -----------
  Improved Zope integration

  * A pipeline factory registry now allows registration of possible
    pipeline elements for use by Zope lexicons.

  * ZMI constructor form for lexicon uses pipeline registry to generate form
    fields

  * ZMI constructor form for ZCTextindex allows you to choose between
    Okapi and Cosine relevance algorithms


  Commit: 23649fb36d00e7d0ff58073736f65e961a89eb89
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/23649fb36d00e7d0ff58073736f65e961a89eb89
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  Add full globbing.  This implements * and ? like in the shell,
but the pattern may not begin with a glob character (else
someone specifying "*" as the pattern can tie up the CPU for
a long time).


  Commit: 819fcc7edaf858195dda178bf80b456a05b26f3c
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/819fcc7edaf858195dda178bf80b456a05b26f3c
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M IIndex.py
    M ILexicon.py
    M QueryParser.py

  Log Message:
  -----------
  Follow-up changes for complete globbing.


  Commit: e356217507dcdddb8bd1c540d93007e47b6f85e5
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/e356217507dcdddb8bd1c540d93007e47b6f85e5
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M HTMLSplitter.py
    M IPipelineElementFactory.py
    M Lexicon.py
    M PipelineFactory.py
    M ZCTextIndex.py
    M __init__.py
    M dtml/addLexicon.dtml
    M tests/testPipelineFactory.py

  Log Message:
  -----------
  Enhanced pipeline element factory so that you can group elements that must be
selected in a mutally exclusive manner (such as splitters).

Existing pipeline elements have been grouped appropriately.

Added a stop word remover that does not remove single char words.

Modified ZMI lexicon add form to use pipeline element groups to render form.
Groups with multiple elements are rendered as selects, singletons are rendered
as checkboxes.


  Commit: 4b55e62a9af31290574cf4bf55870d24e851877b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/4b55e62a9af31290574cf4bf55870d24e851877b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M HTMLSplitter.py

  Log Message:
  -----------
  Get rid of the unused HTMLSplitter class (it's too simple).
Add glob support to the HTMLWordSplitter class.


  Commit: 5a51ea26691ce0290c8e362049f42bfce83dca23
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/5a51ea26691ce0290c8e362049f42bfce83dca23
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Looks like we have to tell ZCTextIndex which kind of index now.


  Commit: 21f3d620e4da67eea88310c7a283a7b9ef186874
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/21f3d620e4da67eea88310c7a283a7b9ef186874
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Buncha updates:

- Use slightly more portable values for the Data.fs and
  Zope/lib/python.

- Add -t NNN option to specify how often to commit a transaction;
  default 20,000.

- Change -p into -p NNN to specify how often (counted in commits) to
  pack (default 0 -- never pack).

- Reworked the commit and pack logic to maintain the various counters
  across folders.

- Store relative paths (e.g. "inbox/1").

- Store the mtime of indexed messages in doctimes[docid].

- Store the mtime of indexed folders in watchfolders[folder] (unused).

- Refactor updatefolder() to:

  (a) Avoid indexing messages it's already indexed and whose mtime
      hasn't changed.  (This probably needs an override just in case.)

  (b) Unindex messages that no longer exist in the folder.

- Include the folder name and the message header fields from, to, cc,
  bcc, and subject in the text to be indexed.


  Commit: 388fd664760ce6cf3c3d01d40b33dac5c778370c
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/388fd664760ce6cf3c3d01d40b33dac5c778370c
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-22 (Wed, 22 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Add usage message and -h option.

Add -w and -W option to dump the word list (by word and by wid,
respectively).

Except KeyboardInterrupt from unqualified except clauses.


  Commit: e660e04058c79556066f824d16b635191b1a7890
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/e660e04058c79556066f824d16b635191b1a7890
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Typo.


  Commit: 001e5e7e0a921d2190624a4e17899abe9f001807
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/001e5e7e0a921d2190624a4e17899abe9f001807
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  Make the Lexicon class persistent.


  Commit: 50f3b66d1677200c9ceffce200125f3cdb88e4f3
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/50f3b66d1677200c9ceffce200125f3cdb88e4f3
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Lexicon is now persistent, so PLexicon doesn't need to mix in the
Persistent class.


  Commit: 9ce0ed68512e9ae9797df40b8fa5c6c8feccb0bb
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/9ce0ed68512e9ae9797df40b8fa5c6c8feccb0bb
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Dump word frequencies as well.


  Commit: 1a537a223e8c088d51eed677b9731ef73ddec954
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/1a537a223e8c088d51eed677b9731ef73ddec954
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M HTMLSplitter.py
    M IPipelineElementFactory.py
    M Lexicon.py
    M PipelineFactory.py
    M ZCTextIndex.py
    M __init__.py
    M tests/queryhtml.py
    M tests/testPipelineFactory.py

  Log Message:
  -----------
  Whitespace normalization.


  Commit: abf4cf6b55edc4010cd792aeed67bdf3d0faa3be
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/abf4cf6b55edc4010cd792aeed67bdf3d0faa3be
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Add a primitive way to show the full message.


  Commit: 97be9890ccc726c8ec04637d125b323ad491c1d1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/97be9890ccc726c8ec04637d125b323ad491c1d1
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  get_words:  repair docstring.


  Commit: a1ffe036b90f9f04008acc1cbd146e74987b12d4
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a1ffe036b90f9f04008acc1cbd146e74987b12d4
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-23 (Thu, 23 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Changed index_doc to call a new _mass_add_wordinfo method, instead of
calling _add_wordinfo in a loop.  This is a simple way to save oodles
of functions calls.  In a brief but non-trivial test, this boosted
overall indexing rate by 12% (so huge bang for the buck).


  Commit: ae8772598ff0713e9f6e4eeafbc108ddd97c613b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ae8772598ff0713e9f6e4eeafbc108ddd97c613b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-24 (Fri, 24 May 2002)

  Changed paths:
    A IQueryParseTree.py
    M IQueryParser.py
    M ParseTree.py
    M QueryParser.py
    M tests/testQueryParser.py

  Log Message:
  -----------
  Move IQueryParseTree to a separate file, to conform to style
guidelines.  Added some conformance tests.


  Commit: f6fb29f84bc8d66fc488740af3f7fca000ba2814
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f6fb29f84bc8d66fc488740af3f7fca000ba2814
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-26 (Sun, 26 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  search_phrase():  cleaned_wids is the same is wids, and it was confusing
to use both after the test to ensure they were the same.


  Commit: 64a01549038eae970bb6c857abfa217eae5b2d42
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/64a01549038eae970bb6c857abfa217eae5b2d42
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-26 (Sun, 26 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  _del_wordinfo:  compute the length only once; BTree len can be arbitrarily
expensive.


  Commit: 1c6fa5e4c044e7a55639b9022deb3fff970632e0
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/1c6fa5e4c044e7a55639b9022deb3fff970632e0
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-26 (Sun, 26 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  _add_wordinfo() and _mass_add_wordinfo():  it's never necessary to call
len(IIBTree) in these guys, so don't.


  Commit: 972a56fe75f1026af9efd6f2767dd2100337c568
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/972a56fe75f1026af9efd6f2767dd2100337c568
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-26 (Sun, 26 May 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Whitespace repair.


  Commit: a3fc5301466835ee8a4baf9cc7ef2b2920cda170
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a3fc5301466835ee8a4baf9cc7ef2b2920cda170
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-28 (Tue, 28 May 2002)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M IIndex.py
    M OkapiIndex.py
    M tests/mailtest.py

  Log Message:
  -----------
  OkapiIndex.query_weight():  return an upper bound on possible doc scores.

CosineIndex.query_weight():  rewrote to squash code duplication.  No
change in what it returns (it's always returned an upper bound on
possible doc scores, although people probably haven't thought of it
that way before).

Elsewhere:  consequent changes.

Problems:

+ mhindex.py needs repair, but I can't run it.  Note that its current
  use of query_weight isn't legitimate (the usage doesn't conform to
  the IIndex interface -- passing a string is passing "a sequence",
  but not the intended sequence <wink>).

+ ZCTextIndex doesn't pass query_weight() on.

+ We've defined no methods to help clients compute what needs to be
  passed to query_weight (a sequence of only the positive terms).

  I changed mailtest.py to cheat, but it's doing a wrong thing for
  negative terms.

+ I expect it will be impossible to shake people from the belief that
  100.0 * score / query_weight is some kind of "relevance score".  It
  isn't.  So perhaps better not to expose this in ZCTextIndex.


  Commit: 450e6731be6c1734efc52e392a20f39d1f60384c
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/450e6731be6c1734efc52e392a20f39d1f60384c
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M tests/hs-tool.py

  Log Message:
  -----------
  print_results():  Don't print the "Bad unpack" message; it's not
    right.  Added a comment explaining what it represents in the
    function.


  Commit: 8d8afd8cd1f24eab349773610c22296257376549
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/8d8afd8cd1f24eab349773610c22296257376549
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Fix the query weight computation.


  Commit: 4e6a4dcc0093845533ec8d87f69d376bdb690e3e
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/4e6a4dcc0093845533ec8d87f69d376bdb690e3e
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Compuate query_weight a right(er) way.


  Commit: 0b14b834519e6fda9a5e2db249006c4c9fba1439
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/0b14b834519e6fda9a5e2db249006c4c9fba1439
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Add "-b ALL" to built-index all folders.


  Commit: d6a335234514bfde378053eb1bf95b6be8262d86
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d6a335234514bfde378053eb1bf95b6be8262d86
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M okascore.c

  Log Message:
  -----------
  Micro optimizations determined while talking with Tim.


  Commit: ea136a45ffacd05e7e6211daf8b62e8579351f98
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ea136a45ffacd05e7e6211daf8b62e8579351f98
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Refactor to avoid profiling setup and reporting, and add an option to
profile with a warm database cache instead of the cold cache.


  Commit: d5bd87a9a50e0e1e21d1dfd7253e210a705af9dc
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d5bd87a9a50e0e1e21d1dfd7253e210a705af9dc
  Author: Fred Drake <fdrake at acm.org>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M OkapiIndex.py

  Log Message:
  -----------
  _search_wids(): Move the import of okascore out of the function so
    so the import machinery is not invoked on each call.


  Commit: 4438cfdb6a2ab115595ab26229b4d662891a9a68
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/4438cfdb6a2ab115595ab26229b4d662891a9a68
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2002-05-29 (Wed, 29 May 2002)

  Changed paths:
    M SetOps.py

  Log Message:
  -----------
  These guys actually return IIBuckets, not IIBTrees.  Rewrote the docs
and code accordingly.

Also rewrote the code to never create a new IIBucket unless one is
really needed (for example, if the input list has only one (bucket, weight)
pair, and the weight is 1, the input bucket can be returned as-is; and
this case will be common with score maps produced by an Okapi index).


  Commit: 6a7c85aa3bf7879146fffe8d9a4384a59bef5de3
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6a7c85aa3bf7879146fffe8d9a4384a59bef5de3
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-06-04 (Tue, 04 Jun 2002)

  Changed paths:
    M __init__.py

  Log Message:
  -----------
  It's not experimental any more.


  Commit: d65012434888ba24accaa16c8ccc8e35517e72cc
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d65012434888ba24accaa16c8ccc8e35517e72cc
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-06-04 (Tue, 04 Jun 2002)

  Changed paths:
    A README.txt

  Log Message:
  -----------
  A first attempt at high-level documentation as requested by Brial.
Casey, you have the baton now.


  Commit: 251c833dcf37cbf6ad62c69f54103071b3a20423
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/251c833dcf37cbf6ad62c69f54103071b3a20423
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-04 (Tue, 04 Jun 2002)

  Changed paths:
    M README.txt
    M __init__.py
    M dtml/addLexicon.dtml
    M dtml/addZCTextIndex.dtml
    A help/Lexicon_Add.stx
    A help/ZCTextIndex_Add.stx

  Log Message:
  -----------
  Added online help for ZCTextIndex and Lexicon add forms


  Commit: 2bdf2c865b1b05d99451ff2b2d83e08e5b9f14e2
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/2bdf2c865b1b05d99451ff2b2d83e08e5b9f14e2
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-06-04 (Tue, 04 Jun 2002)

  Changed paths:
    M README.txt

  Log Message:
  -----------
  Mention the help subdirectory.


  Commit: ba7c130b34425a8c00f5632b7ff21c412340ba49
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ba7c130b34425a8c00f5632b7ff21c412340ba49
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-05 (Wed, 05 Jun 2002)

  Changed paths:
    M ZCTextIndex.py
    M dtml/manageLexicon.dtml
    M dtml/manageZCTextIndex.dtml
    A dtml/queryLexicon.dtml
    M help/Lexicon_Add.stx

  Log Message:
  -----------
  Added management interface to query words in the lexicon and in the process uncovered a BTreeItems bug, whee!


  Commit: 3c433a295537d131ce2bf748ab9623048f0a94c7
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3c433a295537d131ce2bf748ab9623048f0a94c7
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-06-06 (Thu, 06 Jun 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Don't die when a message can't be opened.


  Commit: 2b7531aaa0da9971f80445410617a962139931ca
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/2b7531aaa0da9971f80445410617a962139931ca
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-06 (Thu, 06 Jun 2002)

  Changed paths:
    M ZCTextIndex.py
    M dtml/queryLexicon.dtml

  Log Message:
  -----------
  Finished lexicon query screen.
Completed Zope integration.


  Commit: 44950855b2b727cb5e8b5e3f9ff1f69e8b6cfced
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/44950855b2b727cb5e8b5e3f9ff1f69e8b6cfced
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-06 (Thu, 06 Jun 2002)

  Changed paths:
    M BaseIndex.py
    M IIndex.py
    M ZCTextIndex.py
    M tests/testIndex.py

  Log Message:
  -----------
  Added has_doc method to Index API.
Allows clean implementation of ZCTextIndex's unindex_object method so that it plays better with ZCatalog's unindex behavior.


  Commit: c9edf2b3287059daf7df5a16474548c4f883bfef
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c9edf2b3287059daf7df5a16474548c4f883bfef
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-06 (Thu, 06 Jun 2002)

  Changed paths:
    M dtml/queryLexicon.dtml

  Log Message:
  -----------
  Doh! Forgot trailing bracket... For once NS 4.x was actually helpful...


  Commit: f18938b68bf782b3d93235c09895eb7cb8167fea
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f18938b68bf782b3d93235c09895eb7cb8167fea
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-06-10 (Mon, 10 Jun 2002)

  Changed paths:
    M tests/testQueryParser.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Disable tests using verify_class_implementation(), which has
disappeared from the Interface package.  What replaces it?


  Commit: 142ee65613cbd376d099965c082f03cabe0c8f8b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/142ee65613cbd376d099965c082f03cabe0c8f8b
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-06-10 (Mon, 10 Jun 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  The uniqueValues() method should support optional arguments name and
withLengths to pass the new verifyClass tests.


  Commit: 0bf123761cb837b3f348a9518adea395e6ddfa6d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/0bf123761cb837b3f348a9518adea395e6ddfa6d
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-06-10 (Mon, 10 Jun 2002)

  Changed paths:
    M tests/testQueryParser.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Use verifyClass().


  Commit: b587692bb07990199f9f73daa714dcbf40685b30
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/b587692bb07990199f9f73daa714dcbf40685b30
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-12 (Wed, 12 Jun 2002)

  Changed paths:
    M BaseIndex.py
    M tests/testIndex.py

  Log Message:
  -----------
  Reimplemented Index.length to use a BTree.Length. Previous dynamic computation was way too slow for big indexes.
Updated tests to include length value checks


  Commit: 98e75d50e0f7c9e4462e77a5f2e5f6687ead1fc0
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/98e75d50e0f7c9e4462e77a5f2e5f6687ead1fc0
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-13 (Thu, 13 Jun 2002)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Removed unused class attr that I added yesterday


  Commit: afe64e7bbaa0c4ca282cdedf1ee74c78d70b1e03
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/afe64e7bbaa0c4ca282cdedf1ee74c78d70b1e03
  Author: Jeremy Hylton <jeremy at svn.zope.org>
  Date:   2002-06-17 (Mon, 17 Jun 2002)

  Changed paths:
    M tests/mailtest.py

  Log Message:
  -----------
  Make sure that docs is defined even if EXCLUDE_TEXT is defined.


  Commit: 7599214544742b853e692c12aee39d6aba74baa3
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/7599214544742b853e692c12aee39d6aba74baa3
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-26 (Wed, 26 Jun 2002)

  Changed paths:
    M ZCTextIndex.py
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  Added api to retrieve the indexed field name from the index.
Updated Overview managment screen so it shows more info about the index.


  Commit: c475e717244284bddec5e69847f43c3604fc0776
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c475e717244284bddec5e69847f43c3604fc0776
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-06-28 (Fri, 28 Jun 2002)

  Changed paths:
    M ZCTextIndex.py
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  ZCatalog Fixup:

  * Collector #446 - Index managment permissions fixed

  * Index managment ui is now integrated into ZCatalog rather than being
    a tab leading to the Indexes subobject manage_main

ZCTextIndex fixed to work under this management scheme and now can be instantiated without that silly "extra" record thingy.


  Commit: 92b7a44a6feb50e6585d515967a76070ac385c96
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/92b7a44a6feb50e6585d515967a76070ac385c96
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-07-10 (Wed, 10 Jul 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Don't die if a message doesn't exist.  Unindex it instead.


  Commit: abe3c87709e5d7ebd759cf749772f3933287adab
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/abe3c87709e5d7ebd759cf749772f3933287adab
  Author: Martijn Pieters <mj at zopatista.co>
  Date:   2002-08-05 (Mon, 05 Aug 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  As extra is no longer mandatory, grab the correct lexicon ID for the error message and in the process escape it so no HTML can be sneaked in.


  Commit: 161bc6252abed5f8ef135d46871424685cd933d7
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/161bc6252abed5f8ef135d46871424685cd933d7
  Author: Martijn Pieters <mj at zopatista.co>
  Date:   2002-08-05 (Mon, 05 Aug 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Escape the other REQUEST-sourced value as well.


  Commit: 3fca62ba383295848b71d7064a6e1b2e6a65329f
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3fca62ba383295848b71d7064a6e1b2e6a65329f
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-08-14 (Wed, 14 Aug 2002)

  Changed paths:
    M ZCTextIndex.py
    M dtml/manageZCTextIndex.dtml
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Fix for issue #505
ZCTextIndex is now associated by path to its lexicon. After replacing a lexicon used by an index, clear the index to make it use the new lexicon.


  Commit: cfdc8231dfecbb583553f4663ab79cb6ee7f4163
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/cfdc8231dfecbb583553f4663ab79cb6ee7f4163
  Author: Martijn Pieters <mj at zopatista.co>
  Date:   2002-08-14 (Wed, 14 Aug 2002)

  Changed paths:
    M BaseIndex.py
    M IIndex.py
    M ZCTextIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Clean up indentation and trailing whitespace.


  Commit: 716fc76e3f7b238a9ed58d83586f143969b1950d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/716fc76e3f7b238a9ed58d83586f143969b1950d
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-08-15 (Thu, 15 Aug 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  fix typo


  Commit: 4fb09392a3bdb18405beb93d60a591f1dcbf97a8
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/4fb09392a3bdb18405beb93d60a591f1dcbf97a8
  Author: Shane Hathaway <shane at hathawaymix.org>
  Date:   2002-09-05 (Thu, 05 Sep 2002)

  Changed paths:
    M ZCTextIndex.py
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  Changed ZCTextIndex to store a lexicon ID rather than a physical path to the
lexicon.  Before this, it was not safe to move, rename, or mount in a
different location a ZCatalog containing a ZCTextIndex.

In general, we need to avoid physical paths when a simple ID will suffice.


  Commit: a276db3e2f0b1588adb779b33fa9fc6377a31b86
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/a276db3e2f0b1588adb779b33fa9fc6377a31b86
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-10-15 (Tue, 15 Oct 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Convert mtime to int.


  Commit: 522bd314587046cc4bdef9b2b5709c39ff8bee72
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/522bd314587046cc4bdef9b2b5709c39ff8bee72
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-10-24 (Thu, 24 Oct 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Collector #640: Fixed security assertion on query method


  Commit: 65d36de05cab28ebd24419acecce5d54d626d7ce
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/65d36de05cab28ebd24419acecce5d54d626d7ce
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-12-01 (Sun, 01 Dec 2002)

  Changed paths:
    M HTMLSplitter.py
    M Lexicon.py
    M tests/testLexicon.py
    M tests/testStopper.py

  Log Message:
  -----------
  Collector #597: Added locale support to ZCTextindex splitters. Added unittest
Added ZPL header to stopper test module


  Commit: 76e58a2b05db35e051e3b6cefa4d3c63ad0dc509
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/76e58a2b05db35e051e3b6cefa4d3c63ad0dc509
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-12-03 (Tue, 03 Dec 2002)

  Changed paths:
    M tests/mhindex.py

  Log Message:
  -----------
  Fix a bug in unindexing removed messages (it was iterating over a lazy
list that was being modified as we went).
[Backport from Zope3; I'm not actually sure if the list returned by
**Btree.keys() is lazy, but I assume it is.]


  Commit: d66663597543641c4087d3ca787ae0abbd814cb0
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/d66663597543641c4087d3ca787ae0abbd814cb0
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2002-12-10 (Tue, 10 Dec 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Fixed getLexicon so that it can properly raise an error when it cannot find the proper lexicon object.


  Commit: 56594cd08d695f0252161de735f73ee81ee282eb
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/56594cd08d695f0252161de735f73ee81ee282eb
  Author: Shane Hathaway <shane at hathawaymix.org>
  Date:   2002-12-16 (Mon, 16 Dec 2002)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  The lexicon was getting wrapped before storing in ZODB.  Fixed.

ZODB works around this situation, but it probably shouldn't.
AdaptableStorage doesn't allow it.


  Commit: 8431db66d8a4b1b4968820f27de77d1904f07b85
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/8431db66d8a4b1b4968820f27de77d1904f07b85
  Author: Guido van Rossum <guido at python.org>
  Date:   2002-12-19 (Thu, 19 Dec 2002)

  Changed paths:
    M tests/testLexicon.py

  Log Message:
  -----------
  Backport two fixes to testSplitterLocaleAwareness() from the Zope 3
version:

- If the setlocale() call fails, don't fail the test -- just skip it
  silently.  XXX This is not ideal, but what else can we do?  Locale
  names are not standardized; the test fails on Mac OSX, and
  apparently on older Linux versions (e.g. my Mandrake 8.1).

- Don't use non-ASCII literals; use \xXX escapes.


  Commit: 3af08f26398eafea69ceba47f5606c0a6d7409ce
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3af08f26398eafea69ceba47f5606c0a6d7409ce
  Author: Florent Guillaume <fg at nuxeo.com>
  Date:   2002-12-22 (Sun, 22 Dec 2002)

  Changed paths:
    M dtml/addLexicon.dtml
    M dtml/addZCTextIndex.dtml
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  Merged efge-death-to-dtml-var-branch into HEAD:

Removed most <dtml-var> to replace them with &dtml-foo;.
This corrects a number of potential XSS holes, and simplifies
auditability of the remaining legitimate <dtml-var>.


  Commit: 166e3bf7dfe0f87059509b57006c0c5ba4b75a18
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/166e3bf7dfe0f87059509b57006c0c5ba4b75a18
  Author: Andreas Jung <yet at gmx.de>
  Date:   2003-01-23 (Thu, 23 Jan 2003)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  added getIndexSourceNames()


  Commit: c8113383d14c922c3d1c44e7cca4eb6864ac5465
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c8113383d14c922c3d1c44e7cca4eb6864ac5465
  Author: Guido van Rossum <guido at python.org>
  Date:   2003-01-24 (Fri, 24 Jan 2003)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Implement getIndexSourceNames() correctly.


  Commit: b54fba1685547b92230d5d0a18abfcda69c97383
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/b54fba1685547b92230d5d0a18abfcda69c97383
  Author: Sidnei da Silva <sidnei.da.silva at gmail.com>
  Date:   2003-01-28 (Tue, 28 Jan 2003)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  this would cause a keyerror if request is none


  Commit: 420d76191990ea8b74840d29656ca0a40aae2b9f
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/420d76191990ea8b74840d29656ca0a40aae2b9f
  Author: Florent Guillaume <fg at nuxeo.com>
  Date:   2003-01-28 (Tue, 28 Jan 2003)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Style.


  Commit: 8d832361c02eba6eaefc09248cd34f0f2ffe42da
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/8d832361c02eba6eaefc09248cd34f0f2ffe42da
  Author: Andreas Jung <yet at gmx.de>
  Date:   2003-02-02 (Sun, 02 Feb 2003)

  Changed paths:
    M ZCTextIndex.py
    M dtml/addZCTextIndex.dtml
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  ZCTextIndex is now able to index more than one attribute of an object


  Commit: 1181f490ba022b1eeea6802fc1b5f3867f6985ee
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/1181f490ba022b1eeea6802fc1b5f3867f6985ee
  Author: Andreas Jung <yet at gmx.de>
  Date:   2003-02-02 (Sun, 02 Feb 2003)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  reverting changes to revision 1.42. Unittests passed in wrong
environment but not on a fresh checkout.


  Commit: f0ff5b0d11001e4322acfe7037b41aa4fbca815d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f0ff5b0d11001e4322acfe7037b41aa4fbca815d
  Author: Andreas Jung <yet at gmx.de>
  Date:   2003-02-02 (Sun, 02 Feb 2003)

  Changed paths:
    M dtml/addZCTextIndex.dtml
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  reverting to last  revision since unittests fail with a fresh checkout


  Commit: b8fa02651bc69a8082b6e11929993bfb832a867d
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/b8fa02651bc69a8082b6e11929993bfb832a867d
  Author: Andreas Jung <yet at gmx.de>
  Date:   2003-02-02 (Sun, 02 Feb 2003)

  Changed paths:
    M ZCTextIndex.py
    M dtml/addZCTextIndex.dtml
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  re-added multiple attribute support - all unit tests pass


  Commit: 451133495d73dd27c41e7188fba779b6096c7f12
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/451133495d73dd27c41e7188fba779b6096c7f12
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2003-02-04 (Tue, 04 Feb 2003)

  Changed paths:
    M BaseIndex.py

  Log Message:
  -----------
  Merge unindex speed optimization from branch


  Commit: ef5bf87ad426542fe80e7afdb8ef3e284d0774e1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ef5bf87ad426542fe80e7afdb8ef3e284d0774e1
  Author: Chris McDonough <chrism at plope.com>
  Date:   2003-02-28 (Fri, 28 Feb 2003)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  - Fix small bug related to ZCTextIndex attempting to index the
  results of a callable.  Do not attempt to index None.


  Commit: 71053423cf7ab9ff96fe4d192e27be51898803c1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/71053423cf7ab9ff96fe4d192e27be51898803c1
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2003-06-05 (Thu, 05 Jun 2003)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M IIndex.py
    M Lexicon.py
    M OkapiIndex.py
    M ZCTextIndex.py
    M tests/mhindex.py
    M tests/testIndex.py
    M tests/testLexicon.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Merge casey-zctextindex-fewer-conflicts-branch:

  - Indexes and Lexicon now much less likely to generate write conflicts.
    Previously *any* concurrent index/unindex operation would conflict

  - Performance and scalability fix for queries


  Commit: ca3d95fc9bf5e3891aa0ae63361bacf9c5154440
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ca3d95fc9bf5e3891aa0ae63361bacf9c5154440
  Author: Sidnei da Silva <sidnei.da.silva at gmail.com>
  Date:   2003-06-17 (Tue, 17 Jun 2003)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
   - Made all PluginIndexes and ZCTextIndex use 'safe_callable',
  which is aware of extension classes that fill 'tp_callable'
  but don't define '__call__'.

      - Made KeywordIndex be more robust about receiving a value that
  is not a string or an iterable type.


  Commit: e6a773d0f3d9108a074dc49876eebf63126c3ef4
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/e6a773d0f3d9108a074dc49876eebf63126c3ef4
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2003-07-15 (Tue, 15 Jul 2003)

  Changed paths:
    M tests/testIndex.py
    M tests/testLexicon.py

  Log Message:
  -----------
  Collector #960: Conflict tests now properly cleanup after themselves


  Commit: ed92f57b895a972aa42ee04f6c3f08248a7fb27e
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ed92f57b895a972aa42ee04f6c3f08248a7fb27e
  Author: Stuart Bishop <stuart at stuartbishop.net>
  Date:   2003-11-11 (Tue, 11 Nov 2003)

  Changed paths:
    M dtml/manageZCTextIndex.dtml

  Log Message:
  -----------
  Fix bad link


  Commit: 1894b93bc88b74425fd7474bd85c415e52b22905
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/1894b93bc88b74425fd7474bd85c415e52b22905
  Author: Tres Seaver <tseaver at palladion.com>
  Date:   2003-11-18 (Tue, 18 Nov 2003)

  Changed paths:
    M tests/testZCTextIndex.py

  Log Message:
  -----------
   - Merge tseaver-strexp_delenda-branch to the head.


  Commit: 6e20f3a25d4a58d5c2ea3e656900310885ce1158
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6e20f3a25d4a58d5c2ea3e656900310885ce1158
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2004-04-30 (Fri, 30 Apr 2004)

  Changed paths:
    M Lexicon.py

  Log Message:
  -----------
  Update comment re MVCC


  Commit: f3897a71ed97cc0f6c6d8751e322ca8766f6ba12
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/f3897a71ed97cc0f6c6d8751e322ca8766f6ba12
  Author: root <root at svn.zope.org>
  Date:   2004-05-11 (Tue, 11 May 2004)

  Log Message:
  -----------
  Set mime-type or svn-eol property from cvs expansion data


  Commit: caf5f879dfdc36b775db9406a9c90e53fb45c601
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/caf5f879dfdc36b775db9406a9c90e53fb45c601
  Author: Casey Duncan <casey.duncan at gmail.com>
  Date:   2004-07-23 (Fri, 23 Jul 2004)

  Changed paths:
    M ILexicon.py
    M IPipelineElement.py
    M IPipelineElementFactory.py
    M ISplitter.py

  Log Message:
  -----------
  Import Interface directly rather than Base


  Commit: 6b81d53a2a1faa9e7226f4c7bbd71d4a88ed6401
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/6b81d53a2a1faa9e7226f4c7bbd71d4a88ed6401
  Author: Chris Withers <chris at simplistix.co.uk>
  Date:   2004-09-24 (Fri, 24 Sep 2004)

  Changed paths:
    M __init__.py

  Log Message:
  -----------
  Collector #1457: ZCTextIndex's QueryError and ParseError are now available for import from untrusted code.


  Commit: 52fe67c215fc948db065574318464637d19d279b
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/52fe67c215fc948db065574318464637d19d279b
  Author: Florent Guillaume <fg at nuxeo.com>
  Date:   2004-11-26 (Fri, 26 Nov 2004)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Fail a bit more gracefully if no lexicon is passed.


  Commit: b37f80e0c7174dd1a3bc5b657733252a339e41ff
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/b37f80e0c7174dd1a3bc5b657733252a339e41ff
  Author: Andreas Jung <yet at gmx.de>
  Date:   2005-02-04 (Fri, 04 Feb 2005)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  - PluggableIndexes interface: + indexSize()
- browser for stored values for all UnIndex derived indexes


  Commit: 2d1508b3576da769d522129d24ede22759965490
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/2d1508b3576da769d522129d24ede22759965490
  Author: Tim Peters <tim.one at comcast.net>
  Date:   2005-03-28 (Mon, 28 Mar 2005)

  Changed paths:
    M tests/indexhtml.py
    M tests/mailtest.py
    M tests/mhindex.py
    M tests/testIndex.py
    M tests/testLexicon.py

  Log Message:
  -----------
  __builtin__.get_transaction() is officially deprecated in ZODB 3.4.

Got rid of it in the Zope source.  The remaining instances are in
code stitched in from ZODB.  Those will go away by magic when
ZODB 3.4 gets stitched in.


  Commit: eb8733fad1d743d2a93eae1937c6013e3c851de0
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/eb8733fad1d743d2a93eae1937c6013e3c851de0
  Author: Andreas Jung <yet at gmx.de>
  Date:   2005-05-17 (Tue, 17 May 2005)

  Changed paths:
    M ZCTextIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
        - Collector #1784: fixed handling of multiple attributes in ZCTextIndex


  Commit: c1c66673cbf337f058ffe527b51a8fd73cbbdf8c
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/c1c66673cbf337f058ffe527b51a8fd73cbbdf8c
  Author: Andreas Jung <yet at gmx.de>
  Date:   2005-07-04 (Mon, 04 Jul 2005)

  Changed paths:
    M IIndex.py
    M ZCTextIndex.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
        - Collector #1815: ZCTextIndex accepts (again) sequences of strings to 
  be indexed.


  Commit: 191524acf58f717e27bfb8aace26aed031f434eb
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/191524acf58f717e27bfb8aace26aed031f434eb
  Author:  <y.2011 at wcm-solutions.de>
  Date:   2005-07-04 (Mon, 04 Jul 2005)

  Changed paths:
    M ZCTextIndex.py
    A interfaces.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  added some z3 interfaces for catalog related classes


  Commit: 9bb8208177a4c5278205bde416df6ec5e2d38224
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/9bb8208177a4c5278205bde416df6ec5e2d38224
  Author:  <y.2011 at wcm-solutions.de>
  Date:   2005-07-04 (Mon, 04 Jul 2005)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  synced whitespace with Zope-2_8-branch


  Commit: 3bcbfc3336f8848fc5d9fb49c97642d6eef9b8d1
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/3bcbfc3336f8848fc5d9fb49c97642d6eef9b8d1
  Author: Fred Drake <fdrake at acm.org>
  Date:   2005-08-26 (Fri, 26 Aug 2005)

  Changed paths:
    A SETUP.cfg

  Log Message:
  -----------
  add preliminary packaging metadata


  Commit: ab48ff3cc86649b6901c79ccdb67d538d33018a7
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/ab48ff3cc86649b6901c79ccdb67d538d33018a7
  Author: Florent Guillaume <fg at nuxeo.com>
  Date:   2005-09-09 (Fri, 09 Sep 2005)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  Removed old comment.


  Commit: 76c1837fcd238ef88d3367addca90475d73a4786
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/76c1837fcd238ef88d3367addca90475d73a4786
  Author:  <y.2011 at wcm-solutions.de>
  Date:   2005-10-31 (Mon, 31 Oct 2005)

  Changed paths:
    M ILexicon.py
    M Lexicon.py
    M ZCTextIndex.py
    M interfaces.py
    M tests/testLexicon.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  - converted ILexicon to z3 and bridged it back
- ZCTextIndex now accepts lexicons with the z3 interface


  Commit: 84859d7d97afa24a43cc5dea2780e66583193eca
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/84859d7d97afa24a43cc5dea2780e66583193eca
  Author: Andreas Jung <yet at gmx.de>
  Date:   2005-11-18 (Fri, 18 Nov 2005)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M HTMLSplitter.py
    M IIndex.py
    M ILexicon.py
    M INBest.py
    M IPipelineElement.py
    M IPipelineElementFactory.py
    M IQueryParseTree.py
    M IQueryParser.py
    M ISplitter.py
    M Lexicon.py
    M NBest.py
    M OkapiIndex.py
    M ParseTree.py
    M PipelineFactory.py
    M QueryParser.py
    M RiceCode.py
    M SetOps.py
    M StopDict.py
    M WidCode.py
    M ZCTextIndex.py
    M __init__.py
    M okascore.c
    M stopper.c
    M tests/__init__.py
    M tests/testIndex.py
    M tests/testLexicon.py
    M tests/testNBest.py
    M tests/testPipelineFactory.py
    M tests/testQueryEngine.py
    M tests/testQueryParser.py
    M tests/testSetOps.py
    M tests/testStopper.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  updated to ZPL 2.1 to be in sync with Zope 3


  Commit: b2412f439632b29b3694c33e34834fd10ab968ff
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/b2412f439632b29b3694c33e34834fd10ab968ff
  Author:  <y.2011 at wcm-solutions.de>
  Date:   2007-01-30 (Tue, 30 Jan 2007)

  Changed paths:
    M ZCTextIndex.py

  Log Message:
  -----------
  - some minor plugin indexes cleanup


  Commit: 78cc04d4306bae7859ab701a884953ccb2b26a0f
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/78cc04d4306bae7859ab701a884953ccb2b26a0f
  Author: Tres Seaver <tseaver at palladion.com>
  Date:   2008-04-28 (Mon, 28 Apr 2008)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M HTMLSplitter.py
    M IIndex.py
    R ILexicon.py
    M INBest.py
    M IPipelineElement.py
    M IPipelineElementFactory.py
    M IQueryParseTree.py
    M IQueryParser.py
    M ISplitter.py
    M Lexicon.py
    M NBest.py
    M OkapiIndex.py
    M ParseTree.py
    M PipelineFactory.py
    M QueryParser.py
    M ZCTextIndex.py
    M tests/testLexicon.py
    A tests/testParseTree.py
    M tests/testPipelineFactory.py
    M tests/testQueryParser.py
    M tests/testZCTextIndex.py

  Log Message:
  -----------
  Zope2 Interfaces package delenda est\!


  Commit: 900f40b7ae5ab18faab5476a369c2774da4a3335
      https://github.com/zopefoundation/Products.ZCTextIndex/commit/900f40b7ae5ab18faab5476a369c2774da4a3335
  Author: Tres Seaver <tseaver at palladion.com>
  Date:   2009-01-02 (Fri, 02 Jan 2009)

  Changed paths:
    M BaseIndex.py
    M CosineIndex.py
    M HTMLSplitter.py
    M Lexicon.py
    M OkapiIndex.py
    M ParseTree.py
    M QueryParser.py
    M SetOps.py
    M ZCTextIndex.py

  Log Message:
  -----------
  Merged 'tseaver-no_globals_imports' branch:

o Replaced  imports from the 'Globals' module throughout the tree with
  imports from the actual modules;  the 'Globals' module was always intended
  to be an area for shared data, rather than a "facade" for imports.

o Added 'zope.deferredimport.deprecation' entries to 'Globals/__init__.py'
  for all previously imported symbols / modules.

o Moved 'ApplicationdefaultPermissions' from 'App/class_init.py' to
  'AccessCoontrol/Permission.py', to avoid possible import cycle in
  third-party code.

o Moved canonical location of UNIQUE / REPLACEABLE / NOT_REPLACEABLE
  constants from 'Globals' to 'OFS.ObjectManager'.

o Removed 'stuffGlobals' hack in favor of the deferred / deprecation
  imports.


Compare: https://github.com/zopefoundation/Products.ZCTextIndex/compare/232ee1ad34d2^...900f40b7ae5a


More information about the checkins mailing list