On Jan 27, 2007, at 10:23 AM, Eric Lease Morgan wrote:
> Do y'all know of any open source text summarizers?
Thank you for the prompt replies, and in the end I used a combination
of summarizers:
1. First I used the Perl module Lingua::EN::Keywords. This works
quite well. Given some text it returns five words it thinks are most
significant.
2. Second, I used Lingua::EN::Summarizer. Given a text it returns
one or two sentences from a text it thinks are relevant. This does
not work as well as Summarizer #1.
3. OTS (Open Text Summarizer), like Lingua::EN::Keywords, returns
a list of words it thinks are relevant. So, so.
My real goal was to create a list of tags to associate with full-text
files. To create my tags I:
1. Got a list of words from Lingua::EN::Keywords.
2. Added the words from Lingua::EN::Summarizer.
3. Added the words from OTS.
4. Added the words from the file's title.
5. Added the words from the file's author.
6. Normalized all the words (lowered case, removed punctuation, etc.)
7. Removed duplicates.
8. Removed stop words.
Finally, I used Net::Delicious to upload 675 Alex Catalogue of
Electronic Texts links to del.icio.us. The results aren't too bad.
Heck, I certainly couldn't catalog 675 items that quickly. See:
http://del.icio.us/infomotions/alex
No, it is not perfect, but it is certainly better than nothing!
--
Eric Lease Morgan
University Libraries of Notre Dame
|