[Zope-dev] chinese text and zope.index

[Manabu TERADA]

Hi

I think zope.index will not work for indexing simplified or traditional
Chinese.  That is my observation of zope.index when I was working on
Plone4 CJK indexing.  However by looking at SVN record of zope.indexing,
I see some changes.  It could be working on Chinese, now.

(On Plone4 CJK indexing I am using Products.ZCTextIndex instead of
zope.indexing.)

I feel that zope.index should be fixed to work on CJK as well.
However, I have not get at it.  When will be the due date for the new
zope.index which works CJK indexing. (It should not that hard to fix it.)

PS:
I don't think it is good idea to use CJKSplitter on a new project.  None
is maintaining CJKSplitter any more.  Moreover, CJKSplitter will not
work on Japanese, and some problem on indexing English.

Cheers,
Manabu TERADA


2010/7/26 Wichert Akkerman <wichert at wiggy.net>:
> Does anyone have the text index from zope.index working for simplified
> or traditional Chinese? The default pipeline is ships with effectively
> makes sure I never get a search result. I tried to drop the splitter
> from http://www.zope.org/Members/panjunyong/CJKSplitter in. This worked
> a bit better in that I got search results, but there seems to be little
> relation between my query and the result.
>
> Wichert.
>
> --
> Wichert Akkerman <wichert at wiggy.net>   It is simple to make things.
> http://www.wiggy.net/                  It is hard to make things simple.
> _______________________________________________
> Zope-Dev maillist  -  Zope-Dev at zope.org
> https://mail.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  https://mail.zope.org/mailman/listinfo/zope-announce
>  https://mail.zope.org/mailman/listinfo/zope )
>