term extraction

1 view
Skip to first unread message

Zishan Ahmad

unread,
May 28, 2010, 10:42:50 AM5/28/10
to hn-ch...@googlegroups.com
Hey guys,

As part of the matching platform I'm developing to (hopefully) be used across several verticals (i.e. co-founder match, employee match, spouse match, etc), I'm mining the user's social exhaust (as Harper calls it) to assess and/or validate their true "persona".

I'm looking for some pre-existing term extraction tool. I saw the yahoo web service but it's limited to 5000 requests per IP per day (which may suffice for now), and I see several others listed here, but I haven't gone through them yet.

Any recommendations (or libraries you've written yourself)? 

Jonathan Nelson

unread,
May 28, 2010, 10:00:58 PM5/28/10
to HN Chicago
What you're looking for is generally called "named entity extraction'
python's Natural Language Toolkit (NLTK).

I'm currently using Reuter's OpenCalais api to do entity extraction
for me. You can try it in their sandbox at viewer.opencalais.com.



On May 28, 10:42 am, Zishan Ahmad <zishan.ah...@gmail.com> wrote:
> Hey guys,
>
> As part of the matching platform I'm developing to (hopefully) be used
> across several verticals (i.e. co-founder match, employee match, spouse
> match, etc), I'm mining the user's social exhaust (as Harper calls it) to
> assess and/or validate their true "persona".
>
> I'm looking for some pre-existing term extraction tool. I saw the yahoo web
> service <http://developer.yahoo.com/search/content/V1/termExtraction.html> but
> it's limited to 5000 requests per IP per day (which may suffice for now),
> and I see several others listed
> here<http://en.wikipedia.org/wiki/Terminology_extraction>,

Harper Reed

unread,
May 29, 2010, 1:03:47 AM5/29/10
to hn-ch...@googlegroups.com
There are a lot of options.

I have used:
http://pypi.python.org/pypi/topia.termextract/

It runs on appengine:
http://github.com/straup/gae-termextractor
and
http://termextractor.appspot.com/

works well enough.

--
Harper Reed
blog: nata2.org
twitter: @harper
home: harperreed.org
phone: +1 (773) 980-6667

Reply all
Reply to author
Forward
0 new messages