What I should have said at my talk: this approach to relevancy testing leaves a lot of room for improvement. What else is out there? My slides, as a pdf: http://www.stanford.edu/~ndushay/code4lib2011/code4lib2011-dushay-relevancy-testing.pdf Additional documents: http://www.stanford.edu/~ndushay/code4lib2011/ My blog: http://discovery-grindstone.blogspot.com/ - instruction to a lay-person on how and why to write cucumber scenarios for search feedback. - the four different types of indexing / search result testing. - more on those four approaches - how I put our call number searching requirements into cucumber tests and was able to tweak the field analysis to meet the requirements - Naomi