Gmail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
AgileWiki search ranking solved!
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  3 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
William la Forge  
View profile  
 More options Aug 14, 11:16 pm
From: William la Forge <laforg...@gmail.com>
Date: Sat, 15 Aug 2009 08:46:13 +0530
Local: Fri, Aug 14 2009 11:16 pm
Subject: AgileWiki search ranking solved!

For some time now I have been pondering how to search, keyword search being
just one example. The problem is ordering the result set, which ideally
should be in reverse chronological order.
Reverse chronological ordering is ideal for searching. First because in many
cases, like link and inverse link lists, there is no other order with is
reasonable. Second because reverse chronological ordering answers the
question, what's new? Answering this question is especially important when
there are multiple users. Indeed, the biggest problem with search engines
like Google is that they are unable to order their result sets this way
without devaluing the search. (They order based on frequency of hits, which
in turn is based largely on their ordering, creating a ranking which is not
fully meaningful.) Currently there is not a good web2.0 search, except for
limited domains like twitter.

The key for me was the implementation of table iterator prefilter which I
mentioned earlier. It got me thinking about links. I need to introduce a new
type of link whose key/name is the timestamp of when it was created. This
new type of link then can be used in relation usage, qualifier usage, and
for subject->object and object->subject links. And this is all we need for
ordering our search results.

Obvious, of course. At least in retrospect. :-)


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bill  
View profile  
 More options Aug 15, 9:56 am
From: Bill <laforg...@gmail.com>
Date: Sat, 15 Aug 2009 06:56:57 -0700 (PDT)
Local: Sat, Aug 15 2009 9:56 am
Subject: Re: AgileWiki search ranking solved!
My first solution for search result ordering has problems. Since we
are now using the uuid in the prefilter, i.e. doing joins on the uuid,
we  can not switch to a timestamp. Now in the case of a keyword or
other qualifier, we can easily just use the journal of the keyword or
qualifier rolon in place of a search. But this is also the start of a
general solution as well.

Consider the following link. How do we order the list of links? The
answer is to display a subset of the intersection of the user's
journal and the journal of the following link. This gives us all the
addFollowing and removeFollowing journal entries made by the user.
This is actually more interesting than just a long list of all the
rolons which a user is following. And a good intersection search can
be fast.

Journaling is generally underrated.

Bill

On Aug 15, 8:16 am, William la Forge <laforg...@gmail.com> wrote:


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
laforge49  
View profile  
 More options Aug 27, 8:52 am
From: laforge49 <laforg...@gmail.com>
Date: Thu, 27 Aug 2009 05:52:45 -0700 (PDT)
Local: Thurs, Aug 27 2009 8:52 am
Subject: Re: AgileWiki search ranking solved!
Finally some progress on this issue. The new following table displays
the list of rolons being followed in reverse chronological order based
on the date when following was elected. The process is fast and
scalable, but a bit indirect.

When a following link is created, the journal entry for this change is
added to the ark, to the user, to the rolon being followed and to the
following relation. In addition, the timestamp of the journal entry is
saved in the link connecting the user's rolon with the rolon being
followed.

The following table is produced by iterating through the intersection
of the user journal and the following relation rolon. (The
intersection search is very fast--it does NOT use a sequential scan!)
Any journal entries are checked to see if the rolon of any journals
containing that journal entry is being followed by the user--this
becomes a candidate for display. However the link to that rolon must
contain the timestamp of the journal entry, as otherwise duplicates
will be displayed.

That's how far I've progressed. Next I want to include in the table a
link to the journal entry. This way users can see how the results are
ordered, i.e. the timestamp of the journal entry, and by clicking on
the journal entry they can also see who created the link. (Though this
is a bit redundant for following links.)

This then will be a model for other tables.

On Aug 15, 6:56 pm, Bill <laforg...@gmail.com> wrote:


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google