java.lang.AssertionError: last hit token must be a search term

10 views
Skip to first unread message

BT

unread,
Aug 25, 2017, 5:05:14 PM8/25/17
to XTF Users List
Hi,

If you go to this EAD


and you "Search this collection" for a term that has a match, such as "secret police"


Then the user gets an error "java.lang.AssertionError: last hit token must be a search term"


Any ideas what could be the cause/solution to this issue?


Thanks -- Brian


Martin Haye

unread,
Aug 25, 2017, 6:04:55 PM8/25/17
to xtf-...@googlegroups.com
This is almost always due to unusual Unicode characters messing up XTF's tokenizers. One tokenizer is used at index time, a different one at query time. They're supposed to act identically, but there have been many bugs in the past where they don't.

First thing to do is check that you've incorporated the latest fixes, e.g. https://github.com/cdlib/xtf/commit/697885f7bbc1ae8f8d4557be006c2e6b7dd01f3d

--Martin

--
You received this message because you are subscribed to the Google Groups "XTF Users List" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xtf-user+unsubscribe@googlegroups.com.
To post to this group, send email to xtf-...@googlegroups.com.
Visit this group at https://groups.google.com/group/xtf-user.
For more options, visit https://groups.google.com/d/optout.

BT

unread,
Aug 29, 2017, 12:08:36 PM8/29/17
to XTF Users List
I've got the latest from hg pull http://hg.code.sf.net/p/xtf/code -- and that has this commit.


On Friday, August 25, 2017 at 3:04:55 PM UTC-7, Martin Haye wrote:
This is almost always due to unusual Unicode characters messing up XTF's tokenizers. One tokenizer is used at index time, a different one at query time. They're supposed to act identically, but there have been many bugs in the past where they don't.

First thing to do is check that you've incorporated the latest fixes, e.g. https://github.com/cdlib/xtf/commit/697885f7bbc1ae8f8d4557be006c2e6b7dd01f3d

--Martin
On Fri, Aug 25, 2017 at 2:05 PM, BT <brian.tingl...@gmail.com> wrote:
Hi,

If you go to this EAD


and you "Search this collection" for a term that has a match, such as "secret police"


Then the user gets an error "java.lang.AssertionError: last hit token must be a search term"


Any ideas what could be the cause/solution to this issue?


Thanks -- Brian


--
You received this message because you are subscribed to the Google Groups "XTF Users List" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xtf-user+u...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages