Hi Ya-aqov,

Many of the indexes we've built over the last three years or so at the UVa
Library have been Lucene/Solr.  What I am working on is actually in no way
connected to blacklight.  I'm interested in using Solr with the subjects for
autosuggest because I can generate XForms instances dynamically from
TermsComponent.

Ethan

On Fri, Dec 11, 2009 at 10:12 AM, Ya'aqov Ziso <[log in to unmask]> wrote:

> Ethan, kind thanks, and three questions to you (and I presume UVirginia¹s
> Solr refers to Blacklight, thus am CC-ing Vufind-ers):
>
> 1. I asked myself Œif WorldCat indexes and upkeeps FAST, why do you need to
> index FAST in your local Solr?¹, and I answered: because you want to link
> FAST to your local bibs. Is this the case?
> 2. If it is the case, are you going to load FAST on a weekly basis, cronjob
> the procedure?
> 3. If you are, what do you need FAST autusoggester for?
>
> Ya¹aqov
>
>
>
>
> On 12/10/09 4:35 PM, "Ethan Gruber" <[log in to unmask]> wrote:
>
> > Nice work, Ralph.  That's really slick.  I have all the subject terms in
> the
> > solr index, but I would like to eventually integrate the Worldcat data to
> > make the results more relevant (rather than just sorted alphabetically
> since
> > each subject occurs only once).
> >
> > I have yet to adapt my Orbeon forms to handle dynamic querying of the
> terms
> > in Solr, but would like to have that done in the next week or two (I
> hope!).
> >
> > Here's a sample of the data:
> >
> >
> http://beta.scholarslab.org:9080/solr-1.4/terms?terms.fl=subject&terms.limit=2
> > 5&terms.prefix=Egy
> >
> > The terms.prefix parameter displays terms that start with the letters
> > inputted.  It's extremely fast, so I have no doubt I can use it for
> > autosuggest per keystroke.
> >
> > Ethan
> >
> > On Thu, Dec 10, 2009 at 4:07 PM, LeVan,Ralph <[log in to unmask]> wrote:
> >
> >> > In a rare demonstration of doing as promised, I have a FAST
> >> > AutoSuggester running based on that data.  An HTML demonstration of
> the
> >> > service can be found at http://orlabs.oclc.org/FAST/autosuggest.htmland
> >> > the underlying AutoSuggester is running at
> >> > http://orlabs.oclc.org/FAST/AutoSuggest.  Searches from the HTML go
> to
> >> > WorldCat.
> >> >
> >> > An example of a suggestion request would be
> >> > http://orlabs.oclc.org/FAST/AutoSuggest?query=0
> >> >
> >> > It returns JSON, which the above HTML link demonstrates the use of.
> >> >
> >> > My AutoSuggester is just a thin interface to an SRU database.  The
> query
> >> > that comes to the AutoSuggester is turned into an SRU query and the
> >> > resulting record is dropped into the AutoSuggester response.  The link
> >> > to the SRU database for the above query for "0" would be
> >> >
> http://orlabs.oclc.org/identities/search/AutoSuggestFAST?query=fragment+
> >> >
> >> exact+%220%22<
> http://orlabs.oclc.org/identities/search/AutoSuggestFAST?query=
> >> fragment+%0Aexact+%220%22>
> >> >
> >> > I've put up a file containing all the records I loaded into my
> database.
> >> > The records contain 2 tab delimited fields.  The first field is the
> key
> >> > to the record and corresponds to the user's keystrokes (e.g. '0'
> above).
> >> > The second field contains the JSON response which is an ordered array
> of
> >> > terms.  I load that into the moral equivalent of Lucene and you see
> the
> >> > results in that SRU search.  The file can be found at
> >> > http://orlabs.oclc.org/FAST/AutoSuggestFAST.zip
> >> >
> >> > Let me know if you have any problems or questions.
> >> >
> >> > Ralph
> >> >
> >> >
> >>> > > -----Original Message-----
> >>> > > From: LeVan,Ralph
> >>> > > Sent: Thursday, December 10, 2009 11:12 AM
> >>> > > To: [log in to unmask]
> >>> > > Subject: RE: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web
> >> > service
> >>> > >
> >>> > > We've made some progress on this topic.
> >>> > >
> >>> > > I have available a list of our FAST subject headings.  They are
> >> > derived from
> >>> > > LCSH and may be of some use.  The folks that produced this file are
> >> > working on
> >>> > > producing a similar file for LCSH.
> >>> > >
> >>> > > The file can be found at
> http://orlabs.oclc.org/FAST/fastOutput.zip.
> >>> > >
> >>> > > The file contains tab delimited records.  The first column is the
> ID
> >> > number of the
> >>> > > FAST record that the term comes from.  The second column is the
> MARC
> >>> > > Authorities field that the term came from.  The third column is the
> >> > term itself.  The
> >>> > > 4th column is the count of records in WorldCat that are retrieved
> when
> >> > that term
> >>> > > is used in the Keyword index.  The 5th column is the count of
> records
> >> > in
> >>> > > WorldCat that are retrieved when that term is used in the Subject
> >> > index.
> >>> > >
> >>> > > I expect to have an AutoSuggester built on this today.
> >>> > >
> >>> > > Ralph
> >> >
>